Jul 15 16:15:50.589478 ip-10-0-141-253 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 16:15:51.057318 ip-10-0-141-253 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 16:15:51.057318 ip-10-0-141-253 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 16:15:51.057318 ip-10-0-141-253 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 16:15:51.057318 ip-10-0-141-253 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 16:15:51.057851 ip-10-0-141-253 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 16:15:51.058332 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.058242    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 16:15:51.063084 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063070    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:15:51.063084 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063084    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063088    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063092    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063095    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063099    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063103    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063106    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063109    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063112    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063115    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063117    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063120    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063123    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063125    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063128    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063132    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063136    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063139    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063142    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063148    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:15:51.063150 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063151    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063156    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063160    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063163    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063166    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063169    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063172    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063175    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063178    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063180    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063196    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063200    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063203    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063206    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063208    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063211    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063213    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063216    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063218    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:15:51.063625 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063221    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063223    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063226    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063229    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063231    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063234    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063237    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063239    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063242    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063244    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063246    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063249    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063251    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063254    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063257    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063260    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063262    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063265    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063267    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063270    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:15:51.064108 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063273    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063275    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063277    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063280    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063282    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063285    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063287    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063289    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063292    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063295    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063297    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063300    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063302    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063306    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063308    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063311    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063313    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063316    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063319    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063322    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:15:51.064594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063324    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063327    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063330    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063332    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063335    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063338    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063341    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063343    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063346    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063348    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063352    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063356    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063359    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063362    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063364    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063367    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063369    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063372    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.063374    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064052    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:15:51.065060 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064058    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:15:51.065537 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064061    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:15:51.065537 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064064    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:15:51.065537 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064067    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:15:51.065537 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064070    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:15:51.065537 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064074    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:15:51.065537 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064078    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:15:51.065537 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064081    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:15:51.065537 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064084    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:15:51.065537 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064086    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:15:51.065537 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064089    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:15:51.065537 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064092    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:15:51.065537 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064095    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:15:51.065537 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064097    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:15:51.065537 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064100    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:15:51.065537 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064103    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:15:51.065537 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064106    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:15:51.065537 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064110    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:15:51.065537 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064114    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064117    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064120    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064123    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064125    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064129    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064131    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064134    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064137    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064140    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064143    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064146    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064149    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064151    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064154    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064157    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064160    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064162    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064165    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064168    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:15:51.065977 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064171    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064173    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064176    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064179    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064182    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064201    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064205    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064207    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064210    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064212    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064215    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064218    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064221    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064224    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064227    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064229    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064232    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064234    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064237    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064239    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:15:51.066508 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064242    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064245    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064247    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064250    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064252    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064255    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064257    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064260    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064262    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064265    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064267    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064270    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064273    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064275    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064278    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064281    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064283    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064286    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064289    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064293    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:15:51.066992 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064296    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064299    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064302    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064305    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064307    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064310    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064312    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064315    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064318    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064320    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064323    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064333    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064336    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064339    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064341    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064343    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064346    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064349    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064351    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064354    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:15:51.067478 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064728    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064733    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064736    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064739    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064743    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064746    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064748    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064751    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064754    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064756    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064759    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064761    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064764    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064766    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064769    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064773    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064775    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064777    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064781    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064784    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:15:51.067958 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064787    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064790    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064792    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064794    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064797    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064800    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064802    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064805    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064807    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064810    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064812    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064815    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064817    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064819    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064822    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064824    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064827    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064830    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064832    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064835    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:15:51.068444 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064837    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064840    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064842    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064844    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064847    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064849    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064852    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064854    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064858    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064860    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064863    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064865    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064868    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064870    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064873    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064875    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064878    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064881    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064883    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064885    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:15:51.068914 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064888    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064891    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064893    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064895    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064898    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064902    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064905    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064908    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064910    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064913    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064916    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064919    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064921    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064924    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064926    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064928    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064931    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064934    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064937    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:15:51.069404 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064939    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064944    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064946    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064949    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064951    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064954    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064957    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064960    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064962    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064966    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064969    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064972    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064975    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064978    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064981    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064983    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064986    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064988    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064991    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.064994    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:15:51.069858 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065054    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065065    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065071    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065075    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065079    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065084    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065091    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065096    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065101    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065105    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065110    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065113    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065116    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065120    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065123    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065126    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065129    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065131    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065136    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065139    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065142    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065145    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065148    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065151    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 16:15:51.070329 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065154    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065157    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065160    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065163    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065166    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065169    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065172    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065175    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065179    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065182    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065199    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065204    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065208    2582 flags.go:64] FLAG: --enable-server="true"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065211    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065215    2582 flags.go:64] FLAG: --event-burst="100"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065218    2582 flags.go:64] FLAG: --event-qps="50"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065221    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065224    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065228    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065232    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065235    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065239    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065242    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065245    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065248    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 16:15:51.070894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065251    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065254    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065256    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065259    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065262    2582 flags.go:64] FLAG: --feature-gates=""
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065265    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065269    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065272    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065275    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065278    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065281    2582 flags.go:64] FLAG: --help="false"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065283    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-141-253.ec2.internal"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065287    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065289    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065292    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065296    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065299    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065302    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065304    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065307    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065310    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065313    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065317    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065319    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 15 16:15:51.071545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065322    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065326    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065329    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065332    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065337    2582 flags.go:64] FLAG: --lock-file=""
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065339    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065342    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065345    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065350    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065353    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065356    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065359    2582 flags.go:64] FLAG: --logging-format="text"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065362    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065365    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065368    2582 flags.go:64] FLAG: --manifest-url=""
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065371    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065375    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065378    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065381    2582 flags.go:64] FLAG: --max-pods="110"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065384    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065387    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065390    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065393    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065396    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065399    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 16:15:51.072128 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065401    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065408    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065412    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065414    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065417    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065420    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065426    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065428    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065431    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065436    2582 flags.go:64] FLAG: --port="10250"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065439    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065443    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ccb83d0759a3110b"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065446    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065449    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065452    2582 flags.go:64] FLAG: --register-node="true"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065455    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065458    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065461    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065464    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065466    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065470    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065473    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065476    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065478    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065481    2582 flags.go:64] FLAG: --runonce="false"
Jul 15 16:15:51.072786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065484    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065487    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065490    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065493    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065496    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065498    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065501    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065504    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065507    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065510    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065513    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065515    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065518    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065521    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065524    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065529    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065533    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065536    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065541    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065544    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065547    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065550    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065553    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065556    2582 flags.go:64] FLAG: --v="2"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065559    2582 flags.go:64] FLAG: --version="false"
Jul 15 16:15:51.073404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065563    2582 flags.go:64] FLAG: --vmodule=""
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065566    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.065570    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065680    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065684    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065687    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065690    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065692    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065695    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065697    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065699    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065703    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065705    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065708    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065710    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065712    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065715    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065717    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065720    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:15:51.074007 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065722    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065725    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065729    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065733    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065737    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065740    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065744    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065746    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065749    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065751    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065754    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065756    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065759    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065761    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065764    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065766    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065769    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065771    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065774    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:15:51.074476 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065776    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065779    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065781    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065784    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065786    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065789    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065792    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065794    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065796    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065799    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065801    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065804    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065806    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065809    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065811    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065814    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065818    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065823    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065826    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065829    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:15:51.074932 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065832    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065835    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065837    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065840    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065842    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065845    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065848    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065850    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065852    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065855    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065857    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065860    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065863    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065865    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065868    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065870    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065873    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065876    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065878    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065881    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:15:51.075464 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065884    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065886    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065889    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065891    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065894    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065896    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065899    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065901    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065904    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065911    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065914    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065916    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065919    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065921    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065924    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065926    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065929    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065931    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065934    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:15:51.075940 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065936    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:15:51.076414 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065940    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:15:51.076414 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065944    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:15:51.076414 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065947    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:15:51.076414 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.065950    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:15:51.076414 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.066675    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 16:15:51.076414 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.074521    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 16:15:51.076414 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.074537    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 16:15:51.076414 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.074554    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 16:15:51.076414 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.074562    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 16:15:51.076414 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074642    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:15:51.076414 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074649    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:15:51.076414 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074654    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:15:51.076414 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074658    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:15:51.076414 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074664    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074670    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074675    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074679    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074683    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074687    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074692    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074696    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074707    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074712    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074716    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074721    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074725    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074729    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074733    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074736    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074741    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074745    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074749    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074753    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:15:51.076774 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074756    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074760    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074763    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074767    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074771    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074778    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074783    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074787    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074791    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074796    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074799    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074803    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074807    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074810    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074814    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074818    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074822    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074825    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074829    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:15:51.077261 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074833    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074836    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074848    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074853    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074857    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074860    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074864    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074868    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074871    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074875    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074878    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074882    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074886    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074890    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074894    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074897    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074901    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074905    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074909    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074913    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:15:51.077706 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074917    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074921    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074924    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074928    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074932    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074936    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074940    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074944    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074948    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074951    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074955    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074958    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074962    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074966    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074970    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074981    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074985    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074989    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.074993    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075004    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:15:51.078264 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075008    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:15:51.078761 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075011    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:15:51.078761 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075015    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:15:51.078761 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075019    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:15:51.078761 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075022    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:15:51.078761 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075026    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:15:51.078761 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075029    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:15:51.078761 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075033    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:15:51.078761 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075037    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:15:51.078761 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075041    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:15:51.078761 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075045    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:15:51.078761 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075048    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:15:51.078761 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075052    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:15:51.078761 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075056    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:15:51.078761 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075061    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:15:51.078761 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075066    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:15:51.079166 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.075073    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 16:15:51.079166 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075286    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:15:51.079166 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075293    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:15:51.079166 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075297    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:15:51.079166 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075302    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:15:51.079166 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075305    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:15:51.079166 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075309    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:15:51.079166 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075312    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:15:51.079166 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075316    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:15:51.079166 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075320    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:15:51.079166 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075324    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:15:51.079166 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075328    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:15:51.079166 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075339    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:15:51.079166 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075343    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:15:51.079166 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075347    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075350    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075354    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075358    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075363    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075368    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075373    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075377    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075381    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075385    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075388    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075392    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075396    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075400    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075404    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075408    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075412    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075415    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075419    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:15:51.079549 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075423    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075427    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075430    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075434    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075438    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075441    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075445    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075449    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075452    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075456    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075459    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075463    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075474    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075478    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075482    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075485    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075489    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075493    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075497    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075501    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:15:51.080001 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075504    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075508    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075512    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075515    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075519    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075523    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075527    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075531    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075535    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075538    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075542    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075546    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075550    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075554    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075557    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075561    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075564    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075568    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075572    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075576    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:15:51.080594 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075579    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:15:51.081073 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075583    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:15:51.081073 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075586    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:15:51.081073 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075590    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:15:51.081073 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075596    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:15:51.081073 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075608    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:15:51.081073 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075613    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:15:51.081073 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075616    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:15:51.081073 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075620    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:15:51.081073 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075624    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:15:51.081073 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075628    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:15:51.081073 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075631    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:15:51.081073 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075635    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:15:51.081073 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075638    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:15:51.081073 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075644    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:15:51.081073 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075649    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:15:51.081073 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075653    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:15:51.081073 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075656    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:15:51.081073 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075660    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:15:51.081516 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075664    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:15:51.081516 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075667    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:15:51.081516 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075671    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:15:51.081516 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075675    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:15:51.081516 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075678    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:15:51.081516 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075682    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:15:51.081516 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075685    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:15:51.081516 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:51.075689    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:15:51.081516 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.075696    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 16:15:51.081516 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.075842    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 16:15:51.081516 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.078812    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 16:15:51.081516 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.080472    2582 server.go:1019] "Starting client certificate rotation"
Jul 15 16:15:51.081516 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.080584    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 16:15:51.081516 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.080619    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 16:15:51.083601 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.083585    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 16:15:51.087886 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.087865    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 16:15:51.098926 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.098905    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 15 16:15:51.102760 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.102746    2582 log.go:25] "Validated CRI v1 image API"
Jul 15 16:15:51.103607 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.103590    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 16:15:51.106392 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.106375    2582 fs.go:135] Filesystem UUIDs: map[1452db2e-8ca8-4707-ab2a-149bab5bc1ee:/dev/nvme0n1p3 5e0b0749-9481-451b-a252-b5a56951d690:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 15 16:15:51.106455 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.106393    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 16:15:51.111517 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.111404    2582 manager.go:216] Machine: {Timestamp:2026-07-15 16:15:51.109965694 +0000 UTC m=+0.374941033 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3122860 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f7c88d13b43da4e7400963560ea34 SystemUUID:ec2f7c88-d13b-43da-4e74-00963560ea34 BootID:b3de13df-a01f-4d4f-bd83-f00750d57539 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c8:d9:17:3d:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c8:d9:17:3d:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:30:20:2a:12:64 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 16:15:51.111517 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.111503    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 16:15:51.111654 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.111571    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 16:15:51.115027 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.114999    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 16:15:51.115157 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.115028    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-253.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 16:15:51.115581 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.115558    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 16:15:51.115988 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.115976    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 16:15:51.116026 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.115992    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 16:15:51.116026 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.116000    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 16:15:51.116026 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.116013    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 16:15:51.117841 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.117830    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 16:15:51.122486 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.122473    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 16:15:51.122629 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.122618    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 16:15:51.122670 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.122651    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 16:15:51.122670 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.122664    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 16:15:51.122730 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.122689    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 16:15:51.122730 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.122703    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 15 16:15:51.122730 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.122722    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 16:15:51.123040 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.123029    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 16:15:51.123072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.123047    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 16:15:51.125508 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.125492    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 16:15:51.127823 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.127807    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 16:15:51.127895 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.127847    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 16:15:51.128033 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.128023    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 16:15:51.128063 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.128041    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 16:15:51.128063 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.128049    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 16:15:51.128116 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.128065    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 16:15:51.128116 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.128076    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 16:15:51.128116 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.128084    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 16:15:51.128810 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.128796    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 16:15:51.128810 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.128808    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 16:15:51.128871 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.128817    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 16:15:51.128871 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.128824    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 16:15:51.128871 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.128844    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 16:15:51.128871 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.128854    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 16:15:51.129814 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.129802    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 16:15:51.129856 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.129816    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 16:15:51.133410 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.133389    2582 server.go:1268] "Started kubelet"
Jul 15 16:15:51.133666 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.133498    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 16:15:51.133666 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.133575    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 16:15:51.133666 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.133562    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 16:15:51.133933 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.133860    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 16:15:51.134121 ip-10-0-141-253 systemd[1]: Started Kubernetes Kubelet.
Jul 15 16:15:51.134504 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.134278    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 16:15:51.134504 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.134339    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 16:15:51.138904 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.138884    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 16:15:51.139963 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.139940    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 16:15:51.140495 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.140476    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 16:15:51.144564 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.143390    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-253.ec2.internal.18c282bd1ca84cc9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-253.ec2.internal,UID:ip-10-0-141-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-253.ec2.internal,},FirstTimestamp:2026-07-15 16:15:51.133359305 +0000 UTC m=+0.398334628,LastTimestamp:2026-07-15 16:15:51.133359305 +0000 UTC m=+0.398334628,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-253.ec2.internal,}"
Jul 15 16:15:51.146433 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.146410    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 16:15:51.146433 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.146426    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 16:15:51.146557 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.146519    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found"
Jul 15 16:15:51.147246 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.147231    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 16:15:51.147343 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.147256    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 16:15:51.147343 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.147345    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 16:15:51.147485 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.147449    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 16:15:51.147485 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.147459    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 16:15:51.147561 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.147509    2582 factory.go:153] Registering CRI-O factory
Jul 15 16:15:51.147561 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.147525    2582 factory.go:223] Registration of the crio container factory successfully
Jul 15 16:15:51.147631 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.147576    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 16:15:51.147631 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.147586    2582 factory.go:55] Registering systemd factory
Jul 15 16:15:51.147631 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.147593    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 15 16:15:51.147631 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.147614    2582 factory.go:103] Registering Raw factory
Jul 15 16:15:51.147631 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.147629    2582 manager.go:1196] Started watching for new ooms in manager
Jul 15 16:15:51.148286 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.148271    2582 manager.go:349] Starting recovery of all containers
Jul 15 16:15:51.153139 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.153112    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 16:15:51.153238 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.153214    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 16:15:51.158375 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.158358    2582 manager.go:354] Recovery completed
Jul 15 16:15:51.162554 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.162542    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:15:51.164348 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.164334    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:15:51.164417 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.164365    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:15:51.164417 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.164378    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:15:51.164822 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.164811    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 16:15:51.164869 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.164825    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 16:15:51.164869 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.164839    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 16:15:51.164922 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.164813    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:15:51.165646 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.165629    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:15:51.165710 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.165665    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:15:51.165710 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.165679    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:15:51.166727 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.166639    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-253.ec2.internal.18c282bd1e812f05  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-253.ec2.internal,UID:ip-10-0-141-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-253.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-253.ec2.internal,},FirstTimestamp:2026-07-15 16:15:51.164350213 +0000 UTC m=+0.429325535,LastTimestamp:2026-07-15 16:15:51.164350213 +0000 UTC m=+0.429325535,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-253.ec2.internal,}"
Jul 15 16:15:51.167008 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.166997    2582 policy_none.go:49] "None policy: Start"
Jul 15 16:15:51.167039 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.167013    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 16:15:51.167039 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.167023    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 16:15:51.168961 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.168951    2582 policy_none.go:47] "Start"
Jul 15 16:15:51.180087 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.179954    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-253.ec2.internal.18c282bd1e818305  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-253.ec2.internal,UID:ip-10-0-141-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-253.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-253.ec2.internal,},FirstTimestamp:2026-07-15 16:15:51.164371717 +0000 UTC m=+0.429347037,LastTimestamp:2026-07-15 16:15:51.164371717 +0000 UTC m=+0.429347037,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-253.ec2.internal,}"
Jul 15 16:15:51.189552 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.189492    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-253.ec2.internal.18c282bd1e81aa0b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-253.ec2.internal,UID:ip-10-0-141-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-253.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-253.ec2.internal,},FirstTimestamp:2026-07-15 16:15:51.164381707 +0000 UTC m=+0.429357026,LastTimestamp:2026-07-15 16:15:51.164381707 +0000 UTC m=+0.429357026,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-253.ec2.internal,}"
Jul 15 16:15:51.199493 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.199438    2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-253.ec2.internal.18c282bd1e812f05\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-253.ec2.internal.18c282bd1e812f05  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-253.ec2.internal,UID:ip-10-0-141-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-253.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-253.ec2.internal,},FirstTimestamp:2026-07-15 16:15:51.164350213 +0000 UTC m=+0.429325535,LastTimestamp:2026-07-15 16:15:51.165644212 +0000 UTC m=+0.430619538,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-253.ec2.internal,}"
Jul 15 16:15:51.227787 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.209240    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sd9v5"
Jul 15 16:15:51.227787 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.209821    2582 manager.go:337] "Starting Device Plugin manager"
Jul 15 16:15:51.227787 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.209845    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 16:15:51.227787 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.209854    2582 server.go:87] "Starting device plugin registration server"
Jul 15 16:15:51.227787 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.210090    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 16:15:51.227787 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.210102    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 16:15:51.227787 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.210202    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 16:15:51.227787 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.210283    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 16:15:51.227787 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.210293    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 16:15:51.227787 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.210780    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 16:15:51.227787 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.210834    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-253.ec2.internal\" not found"
Jul 15 16:15:51.227787 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.210990    2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-253.ec2.internal.18c282bd1e818305\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-253.ec2.internal.18c282bd1e818305  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-253.ec2.internal,UID:ip-10-0-141-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-253.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-253.ec2.internal,},FirstTimestamp:2026-07-15 16:15:51.164371717 +0000 UTC m=+0.429347037,LastTimestamp:2026-07-15 16:15:51.165671729 +0000 UTC m=+0.430647055,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-253.ec2.internal,}"
Jul 15 16:15:51.227787 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.219597    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sd9v5"
Jul 15 16:15:51.227787 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.223579    2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-253.ec2.internal.18c282bd1e81aa0b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-253.ec2.internal.18c282bd1e81aa0b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-253.ec2.internal,UID:ip-10-0-141-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-253.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-253.ec2.internal,},FirstTimestamp:2026-07-15 16:15:51.164381707 +0000 UTC m=+0.429357026,LastTimestamp:2026-07-15 16:15:51.165683463 +0000 UTC m=+0.430658790,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-253.ec2.internal,}"
Jul 15 16:15:51.242807 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.242780    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 16:15:51.243883 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.243863    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 16:15:51.243959 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.243896    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 16:15:51.243959 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.243911    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 16:15:51.243959 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.243938    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 16:15:51.247625 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.247607    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:15:51.311211 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.311160    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:15:51.312570 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.312555    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:15:51.312654 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.312587    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:15:51.312654 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.312601    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:15:51.312654 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.312627    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-253.ec2.internal"
Jul 15 16:15:51.326036 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.326013    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-253.ec2.internal"
Jul 15 16:15:51.326036 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.326031    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-253.ec2.internal\": node \"ip-10-0-141-253.ec2.internal\" not found"
Jul 15 16:15:51.344688 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.344669    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal"]
Jul 15 16:15:51.344753 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.344718    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:15:51.346122 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.346108    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:15:51.346220 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.346136    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:15:51.346220 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.346150    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:15:51.348479 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.348465    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:15:51.348575 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.348562    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal"
Jul 15 16:15:51.348630 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.348587    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:15:51.349908 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.349893    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:15:51.349971 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.349920    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:15:51.349971 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.349929    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:15:51.349971 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.349896    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:15:51.350061 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.349991    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:15:51.350061 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.350003    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:15:51.352215 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.352198    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal"
Jul 15 16:15:51.352215 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.352225    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:15:51.353383 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.353366    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:15:51.353454 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.353400    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:15:51.353454 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.353414    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:15:51.375702 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.375680    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-253.ec2.internal\" not found" node="ip-10-0-141-253.ec2.internal"
Jul 15 16:15:51.379978 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.379962    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-253.ec2.internal\" not found" node="ip-10-0-141-253.ec2.internal"
Jul 15 16:15:51.380061 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.380047    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found"
Jul 15 16:15:51.448487 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.448464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6095f02d0d4f4a0c3d104c65bcb58cd3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal\" (UID: \"6095f02d0d4f4a0c3d104c65bcb58cd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal"
Jul 15 16:15:51.448553 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.448497    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6095f02d0d4f4a0c3d104c65bcb58cd3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal\" (UID: \"6095f02d0d4f4a0c3d104c65bcb58cd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal"
Jul 15 16:15:51.480624 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:51.480607    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found"
Jul 15 16:15:51.549120 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.549100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6095f02d0d4f4a0c3d104c65bcb58cd3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal\" (UID: \"6095f02d0d4f4a0c3d104c65bcb58cd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal"
Jul 15 16:15:51.549177 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.549132    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6095f02d0d4f4a0c3d104c65bcb58cd3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal\" (UID: \"6095f02d0d4f4a0c3d104c65bcb58cd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal"
Jul 15 16:15:51.549177 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.549161    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3aa295c57b47767de99fcd5136c816cd-config\") pod \"kube-apiserver-proxy-ip-10-0-141-253.ec2.internal\" (UID: \"3aa295c57b47767de99fcd5136c816cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal"
Jul 15 16:15:51.549177 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.549164    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6095f02d0d4f4a0c3d104c65bcb58cd3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal\" (UID: \"6095f02d0d4f4a0c3d104c65bcb58cd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal"
Jul 15 16:15:51.549287 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:51.549218    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6095f02d0d4f4a0c3d104c65bcb58cd3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal\" (UID: \"6095f02d0d4f4a0c3d104c65bcb58cd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal"
Jul 15 16:15:53.308877 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:53.308833    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found"
Jul 15 16:15:53.376450 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.376432    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3aa295c57b47767de99fcd5136c816cd-config\") pod \"kube-apiserver-proxy-ip-10-0-141-253.ec2.internal\" (UID: \"3aa295c57b47767de99fcd5136c816cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal"
Jul 15 16:15:53.376503 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.376468    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3aa295c57b47767de99fcd5136c816cd-config\") pod \"kube-apiserver-proxy-ip-10-0-141-253.ec2.internal\" (UID: \"3aa295c57b47767de99fcd5136c816cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal"
Jul 15 16:15:53.404582 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.404558    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal"
Jul 15 16:15:53.409386 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:53.409267    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found"
Jul 15 16:15:53.409386 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.409301    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal"
Jul 15 16:15:53.510157 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:53.510121    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found"
Jul 15 16:15:53.610669 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:53.610614    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-253.ec2.internal\" not found"
Jul 15 16:15:53.703932 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.703900    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:15:53.774738 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.774711    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal"
Jul 15 16:15:53.797080 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.797062    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 16:15:53.798363 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.798351    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal"
Jul 15 16:15:53.806926 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.806912    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 16:15:53.807042 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.807015    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 16:15:53.807079 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.807062    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 16:15:53.807118 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:53.807075    2582 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://ab36543983eef4133a18ebfe3c4a5b02-66c6581781024fb4.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-system/pods\": read tcp 10.0.141.253:48940->100.51.199.144:6443: use of closed network connection" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal"
Jul 15 16:15:53.851029 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.851008    2582 apiserver.go:52] "Watching apiserver"
Jul 15 16:15:53.869183 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.869141    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 16:15:53.869624 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.869602    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal","openshift-dns/node-resolver-746j8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal","openshift-network-diagnostics/network-check-target-9h4t6","openshift-network-operator/iptables-alerter-67fct","openshift-ovn-kubernetes/ovnkube-node-jcp65","kube-system/konnectivity-agent-th64x","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2","openshift-cluster-node-tuning-operator/tuned-lzmrz","openshift-image-registry/node-ca-f9v7g","openshift-multus/multus-additional-cni-plugins-tp94d","openshift-multus/multus-dx9mh","openshift-multus/network-metrics-daemon-ht28p","kube-system/global-pull-secret-syncer-z7zbh"]
Jul 15 16:15:53.872013 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.871997    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-746j8"
Jul 15 16:15:53.873987 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.873971    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 16:15:53.874437 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.874421    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:15:53.874510 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:53.874485    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9h4t6" podUID="bc941219-34a4-4e54-aae8-6feb420ddac5"
Jul 15 16:15:53.874624 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.874610    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 16:15:53.875110 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.874982    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5wphh\""
Jul 15 16:15:53.875212 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.875163    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 16:15:53.877086 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.877064    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-67fct"
Jul 15 16:15:53.879434 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.879409    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/725f8d4f-c7db-452b-a0b8-bb292c501156-tmp-dir\") pod \"node-resolver-746j8\" (UID: \"725f8d4f-c7db-452b-a0b8-bb292c501156\") " pod="openshift-dns/node-resolver-746j8"
Jul 15 16:15:53.879538 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.879446    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzzll\" (UniqueName: \"kubernetes.io/projected/725f8d4f-c7db-452b-a0b8-bb292c501156-kube-api-access-nzzll\") pod \"node-resolver-746j8\" (UID: \"725f8d4f-c7db-452b-a0b8-bb292c501156\") " pod="openshift-dns/node-resolver-746j8"
Jul 15 16:15:53.879538 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.879483    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptwnx\" (UniqueName: \"kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx\") pod \"network-check-target-9h4t6\" (UID: \"bc941219-34a4-4e54-aae8-6feb420ddac5\") " pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:15:53.879538 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.879506    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.879702 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.879543    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b4e0c32c-4fc8-4015-a95b-bf2aadd4554f-iptables-alerter-script\") pod \"iptables-alerter-67fct\" (UID: \"b4e0c32c-4fc8-4015-a95b-bf2aadd4554f\") " pod="openshift-network-operator/iptables-alerter-67fct"
Jul 15 16:15:53.879702 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.879577    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4e0c32c-4fc8-4015-a95b-bf2aadd4554f-host-slash\") pod \"iptables-alerter-67fct\" (UID: \"b4e0c32c-4fc8-4015-a95b-bf2aadd4554f\") " pod="openshift-network-operator/iptables-alerter-67fct"
Jul 15 16:15:53.879702 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.879590    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 16:15:53.879702 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.879600    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/725f8d4f-c7db-452b-a0b8-bb292c501156-hosts-file\") pod \"node-resolver-746j8\" (UID: \"725f8d4f-c7db-452b-a0b8-bb292c501156\") " pod="openshift-dns/node-resolver-746j8"
Jul 15 16:15:53.879702 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.879623    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzn89\" (UniqueName: \"kubernetes.io/projected/b4e0c32c-4fc8-4015-a95b-bf2aadd4554f-kube-api-access-nzn89\") pod \"iptables-alerter-67fct\" (UID: \"b4e0c32c-4fc8-4015-a95b-bf2aadd4554f\") " pod="openshift-network-operator/iptables-alerter-67fct"
Jul 15 16:15:53.879988 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.879964    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 16:15:53.880260 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.880238    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 16:15:53.880376 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.880326    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bl22k\""
Jul 15 16:15:53.881780 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.881759    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-th64x"
Jul 15 16:15:53.884383 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.884367    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 16:15:53.884589 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.884574    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:53.884687 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.884669    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 16:15:53.885013 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.884993    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 16:15:53.885092 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.885047    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 16:15:53.885092 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.885057    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 16:15:53.885092 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.885072    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nbbnk\""
Jul 15 16:15:53.885533 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.885519    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 16:15:53.886757 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.886739    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:53.886839 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.886761    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 16:15:53.889053 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.889027    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f9v7g"
Jul 15 16:15:53.891409 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.891211    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:53.893689 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.893670    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:53.895274 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.895258    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 16:15:53.895543 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.895526    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hcm2g\""
Jul 15 16:15:53.896326 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.896309    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 16:15:53.896591 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.896575    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 16:15:53.896676 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.896656    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:15:53.896758 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:53.896741    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht28p" podUID="e68bcad1-c436-4799-89f3-72d611f5716d"
Jul 15 16:15:53.896967 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.896950    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 16:15:53.896967 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.896961    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 16:15:53.897483 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.897464    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 16:15:53.897588 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.897551    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 16:15:53.897981 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.897965    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 16:15:53.898081 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.898053    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nngdk\""
Jul 15 16:15:53.898150 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.898062    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-c5qhj\""
Jul 15 16:15:53.898478 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.898460    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ls8w2\""
Jul 15 16:15:53.898478 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.898474    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 16:15:53.898614 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.898525    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 16:15:53.898827 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.898811    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 16:15:53.898916 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.898861    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:15:53.898916 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:53.898901    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7zbh" podUID="d0d24e92-1685-4d42-b291-4ceebc12c881"
Jul 15 16:15:53.899295 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.899278    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-84c9g\""
Jul 15 16:15:53.902382 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.902364    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 16:15:53.902382 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.902373    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 16:15:53.902702 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.902684    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 16:15:53.904880 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.904862    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r2758\""
Jul 15 16:15:53.906279 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.906261    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 16:15:53.906279 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.906276    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 16:15:53.951254 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.951226    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 16:10:52 +0000 UTC" deadline="2028-04-26 16:34:08.437857082 +0000 UTC"
Jul 15 16:15:53.951354 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.951254    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15624h18m14.486606551s"
Jul 15 16:15:53.960104 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.960086    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kv92x"
Jul 15 16:15:53.976573 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.976554    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 16:15:53.979877 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.979856    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b4e0c32c-4fc8-4015-a95b-bf2aadd4554f-iptables-alerter-script\") pod \"iptables-alerter-67fct\" (UID: \"b4e0c32c-4fc8-4015-a95b-bf2aadd4554f\") " pod="openshift-network-operator/iptables-alerter-67fct"
Jul 15 16:15:53.979953 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.979885    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-system-cni-dir\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:53.979953 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.979903    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-host-run-k8s-cni-cncf-io\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:53.979953 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.979920    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-run-ovn-kubernetes\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.979953 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.979936    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-env-overrides\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.979953 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.979950    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3c080-f558-431e-b4f7-527663feedc0-registration-dir\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:53.980097 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.979966    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-systemd\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:53.980097 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980005    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:53.980097 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980024    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-multus-conf-dir\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:53.980097 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980039    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-modprobe-d\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:53.980097 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980073    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-run\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:53.980097 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980097    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-tmp\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:53.980271 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980115    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d0d24e92-1685-4d42-b291-4ceebc12c881-dbus\") pod \"global-pull-secret-syncer-z7zbh\" (UID: \"d0d24e92-1685-4d42-b291-4ceebc12c881\") " pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:15:53.980271 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980141    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9787ee82-eeaf-4476-9925-1aa7774e6f6d-konnectivity-ca\") pod \"konnectivity-agent-th64x\" (UID: \"9787ee82-eeaf-4476-9925-1aa7774e6f6d\") " pod="kube-system/konnectivity-agent-th64x"
Jul 15 16:15:53.980271 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980158    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-systemd-units\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.980271 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980172    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-node-log\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.980271 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980188    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8glr\" (UniqueName: \"kubernetes.io/projected/d7a3c080-f558-431e-b4f7-527663feedc0-kube-api-access-w8glr\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:53.980271 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980213    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xrjv\" (UniqueName: \"kubernetes.io/projected/e68bcad1-c436-4799-89f3-72d611f5716d-kube-api-access-9xrjv\") pod \"network-metrics-daemon-ht28p\" (UID: \"e68bcad1-c436-4799-89f3-72d611f5716d\") " pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:15:53.980271 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980234    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-run-netns\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.980271 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980249    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-multus-socket-dir-parent\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:53.980271 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980262    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-host-run-netns\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:53.980574 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980280    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-host-var-lib-kubelet\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:53.980574 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980300    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b4e0c32c-4fc8-4015-a95b-bf2aadd4554f-iptables-alerter-script\") pod \"iptables-alerter-67fct\" (UID: \"b4e0c32c-4fc8-4015-a95b-bf2aadd4554f\") " pod="openshift-network-operator/iptables-alerter-67fct"
Jul 15 16:15:53.980574 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980308    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4d99d675-1134-4c0f-bcab-5c9820f49002-multus-daemon-config\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:53.980574 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980354    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-host-run-multus-certs\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:53.980574 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980390    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-sysconfig\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:53.980574 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980409    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-log-socket\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.980574 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980423    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-cni-netd\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.980574 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980456    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-multus-cni-dir\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:53.980574 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980479    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4d99d675-1134-4c0f-bcab-5c9820f49002-cni-binary-copy\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:53.980574 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980497    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzn89\" (UniqueName: \"kubernetes.io/projected/b4e0c32c-4fc8-4015-a95b-bf2aadd4554f-kube-api-access-nzn89\") pod \"iptables-alerter-67fct\" (UID: \"b4e0c32c-4fc8-4015-a95b-bf2aadd4554f\") " pod="openshift-network-operator/iptables-alerter-67fct"
Jul 15 16:15:53.980574 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980512    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-ovnkube-script-lib\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.980574 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980526    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-var-lib-kubelet\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:53.980574 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980550    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdqrq\" (UniqueName: \"kubernetes.io/projected/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-kube-api-access-kdqrq\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:53.981085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980582    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-hostroot\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:53.981085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980611    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk4gt\" (UniqueName: \"kubernetes.io/projected/f99fdc7b-743b-4fae-b826-c2bd4c75aadc-kube-api-access-mk4gt\") pod \"node-ca-f9v7g\" (UID: \"f99fdc7b-743b-4fae-b826-c2bd4c75aadc\") " pod="openshift-image-registry/node-ca-f9v7g"
Jul 15 16:15:53.981085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980636    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-os-release\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:53.981085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980658    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-etc-kubernetes\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:53.981085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980680    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs\") pod \"network-metrics-daemon-ht28p\" (UID: \"e68bcad1-c436-4799-89f3-72d611f5716d\") " pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:15:53.981085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980716    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-run-systemd\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.981085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.981085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980757    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-ovn-node-metrics-cert\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.981085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980778    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3c080-f558-431e-b4f7-527663feedc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:53.981085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980799    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:53.981085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980819    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-sysctl-conf\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:53.981085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980844    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f99fdc7b-743b-4fae-b826-c2bd4c75aadc-serviceca\") pod \"node-ca-f9v7g\" (UID: \"f99fdc7b-743b-4fae-b826-c2bd4c75aadc\") " pod="openshift-image-registry/node-ca-f9v7g"
Jul 15 16:15:53.981085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980866    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/725f8d4f-c7db-452b-a0b8-bb292c501156-tmp-dir\") pod \"node-resolver-746j8\" (UID: \"725f8d4f-c7db-452b-a0b8-bb292c501156\") " pod="openshift-dns/node-resolver-746j8"
Jul 15 16:15:53.981085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980881    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzzll\" (UniqueName: \"kubernetes.io/projected/725f8d4f-c7db-452b-a0b8-bb292c501156-kube-api-access-nzzll\") pod \"node-resolver-746j8\" (UID: \"725f8d4f-c7db-452b-a0b8-bb292c501156\") " pod="openshift-dns/node-resolver-746j8"
Jul 15 16:15:53.981085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980895    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-cni-bin\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.981085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980913    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-lib-modules\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:53.981766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.980986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/725f8d4f-c7db-452b-a0b8-bb292c501156-hosts-file\") pod \"node-resolver-746j8\" (UID: \"725f8d4f-c7db-452b-a0b8-bb292c501156\") " pod="openshift-dns/node-resolver-746j8"
Jul 15 16:15:53.981766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981023    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs8tl\" (UniqueName: \"kubernetes.io/projected/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-kube-api-access-vs8tl\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:53.981766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981031    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/725f8d4f-c7db-452b-a0b8-bb292c501156-hosts-file\") pod \"node-resolver-746j8\" (UID: \"725f8d4f-c7db-452b-a0b8-bb292c501156\") " pod="openshift-dns/node-resolver-746j8"
Jul 15 16:15:53.981766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981047    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-kubelet\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.981766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981071    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-etc-openvswitch\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.981766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981079    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/725f8d4f-c7db-452b-a0b8-bb292c501156-tmp-dir\") pod \"node-resolver-746j8\" (UID: \"725f8d4f-c7db-452b-a0b8-bb292c501156\") " pod="openshift-dns/node-resolver-746j8"
Jul 15 16:15:53.981766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-ovnkube-config\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.981766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981132    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-sys\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:53.981766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981152    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-host\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:53.981766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981178    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d0d24e92-1685-4d42-b291-4ceebc12c881-kubelet-config\") pod \"global-pull-secret-syncer-z7zbh\" (UID: \"d0d24e92-1685-4d42-b291-4ceebc12c881\") " pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:15:53.981766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981207    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-host-var-lib-cni-bin\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:53.981766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981230    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d7a3c080-f558-431e-b4f7-527663feedc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:53.981766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981260    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-system-cni-dir\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:53.981766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981284    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-cnibin\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:53.981766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981307    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-cnibin\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:53.981766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981330    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-os-release\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:53.981766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981368    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3c080-f558-431e-b4f7-527663feedc0-device-dir\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:53.982365 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981382    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-kubernetes\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:53.982365 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981400    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4e0c32c-4fc8-4015-a95b-bf2aadd4554f-host-slash\") pod \"iptables-alerter-67fct\" (UID: \"b4e0c32c-4fc8-4015-a95b-bf2aadd4554f\") " pod="openshift-network-operator/iptables-alerter-67fct"
Jul 15 16:15:53.982365 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981415    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:53.982365 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981429    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f99fdc7b-743b-4fae-b826-c2bd4c75aadc-host\") pod \"node-ca-f9v7g\" (UID: \"f99fdc7b-743b-4fae-b826-c2bd4c75aadc\") " pod="openshift-image-registry/node-ca-f9v7g"
Jul 15 16:15:53.982365 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981434    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4e0c32c-4fc8-4015-a95b-bf2aadd4554f-host-slash\") pod \"iptables-alerter-67fct\" (UID: \"b4e0c32c-4fc8-4015-a95b-bf2aadd4554f\") " pod="openshift-network-operator/iptables-alerter-67fct"
Jul 15 16:15:53.982365 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981444    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptwnx\" (UniqueName: \"kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx\") pod \"network-check-target-9h4t6\" (UID: \"bc941219-34a4-4e54-aae8-6feb420ddac5\") " pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:15:53.982365 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981458    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-sysctl-d\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:53.982365 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981473    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret\") pod \"global-pull-secret-syncer-z7zbh\" (UID: \"d0d24e92-1685-4d42-b291-4ceebc12c881\") " pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:15:53.982365 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981488    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-host-var-lib-cni-multus\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:53.982365 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981501    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-slash\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.982365 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981515    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-run-openvswitch\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.982365 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981529    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7t76\" (UniqueName: \"kubernetes.io/projected/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-kube-api-access-l7t76\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.982365 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981563    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3c080-f558-431e-b4f7-527663feedc0-socket-dir\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:53.982365 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981589    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-tuned\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:53.982365 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981611    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9787ee82-eeaf-4476-9925-1aa7774e6f6d-agent-certs\") pod \"konnectivity-agent-th64x\" (UID: \"9787ee82-eeaf-4476-9925-1aa7774e6f6d\") " pod="kube-system/konnectivity-agent-th64x"
Jul 15 16:15:53.982365 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981634    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:53.982814 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981669    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lndjh\" (UniqueName: \"kubernetes.io/projected/4d99d675-1134-4c0f-bcab-5c9820f49002-kube-api-access-lndjh\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:53.982814 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981692    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-run-ovn\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.982814 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981714    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d7a3c080-f558-431e-b4f7-527663feedc0-sys-fs\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:53.982814 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.981741    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-var-lib-openvswitch\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:53.984597 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.984582    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:15:53.996061 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:53.996042    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kv92x"
Jul 15 16:15:54.000058 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.000035    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 16:15:54.000145 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:54.000110    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:15:54.000145 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:54.000131    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:15:54.000145 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:54.000143    2582 projected.go:196] Error preparing data for projected volume kube-api-access-ptwnx for pod openshift-network-diagnostics/network-check-target-9h4t6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:15:54.000259 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:54.000218    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx podName:bc941219-34a4-4e54-aae8-6feb420ddac5 nodeName:}" failed. No retries permitted until 2026-07-15 16:15:54.500199541 +0000 UTC m=+2.038025195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ptwnx" (UniqueName: "kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx") pod "network-check-target-9h4t6" (UID: "bc941219-34a4-4e54-aae8-6feb420ddac5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:15:54.003147 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.003126    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzn89\" (UniqueName: \"kubernetes.io/projected/b4e0c32c-4fc8-4015-a95b-bf2aadd4554f-kube-api-access-nzn89\") pod \"iptables-alerter-67fct\" (UID: \"b4e0c32c-4fc8-4015-a95b-bf2aadd4554f\") " pod="openshift-network-operator/iptables-alerter-67fct"
Jul 15 16:15:54.010842 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:54.010794    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa295c57b47767de99fcd5136c816cd.slice/crio-a6c169481775862b3aada60890c675267a3e02b481b4c5d427dd83e054386827 WatchSource:0}: Error finding container a6c169481775862b3aada60890c675267a3e02b481b4c5d427dd83e054386827: Status 404 returned error can't find the container with id a6c169481775862b3aada60890c675267a3e02b481b4c5d427dd83e054386827
Jul 15 16:15:54.011406 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:54.011385    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6095f02d0d4f4a0c3d104c65bcb58cd3.slice/crio-9b87ffd76ea11eab90b45a799120c695e347e55e46f63b69a48cc47ae48e7282 WatchSource:0}: Error finding container 9b87ffd76ea11eab90b45a799120c695e347e55e46f63b69a48cc47ae48e7282: Status 404 returned error can't find the container with id 9b87ffd76ea11eab90b45a799120c695e347e55e46f63b69a48cc47ae48e7282
Jul 15 16:15:54.014970 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.014944    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 16:15:54.019207 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.019190    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzzll\" (UniqueName: \"kubernetes.io/projected/725f8d4f-c7db-452b-a0b8-bb292c501156-kube-api-access-nzzll\") pod \"node-resolver-746j8\" (UID: \"725f8d4f-c7db-452b-a0b8-bb292c501156\") " pod="openshift-dns/node-resolver-746j8"
Jul 15 16:15:54.082663 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082644    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-node-log\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.082740 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082669    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8glr\" (UniqueName: \"kubernetes.io/projected/d7a3c080-f558-431e-b4f7-527663feedc0-kube-api-access-w8glr\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:54.082740 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082684    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xrjv\" (UniqueName: \"kubernetes.io/projected/e68bcad1-c436-4799-89f3-72d611f5716d-kube-api-access-9xrjv\") pod \"network-metrics-daemon-ht28p\" (UID: \"e68bcad1-c436-4799-89f3-72d611f5716d\") " pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:15:54.082740 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082702    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-run-netns\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.082740 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082720    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-multus-socket-dir-parent\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.082931 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082734    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-host-run-netns\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.082931 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082771    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-host-var-lib-kubelet\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.082931 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082744    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-node-log\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.082931 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082809    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-run-netns\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.082931 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082815    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-host-run-netns\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.082931 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082825    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-host-var-lib-kubelet\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.082931 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082801    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4d99d675-1134-4c0f-bcab-5c9820f49002-multus-daemon-config\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.082931 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082793    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-multus-socket-dir-parent\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.082931 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-host-run-multus-certs\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.082931 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082886    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-sysconfig\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.082931 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082901    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-log-socket\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.082931 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082914    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-cni-netd\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.082931 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-multus-cni-dir\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.083634 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082957    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4d99d675-1134-4c0f-bcab-5c9820f49002-cni-binary-copy\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.083634 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082972    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-log-socket\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.083634 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082982    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-ovnkube-script-lib\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.083634 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082982    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-host-run-multus-certs\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.083634 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082973    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-sysconfig\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.083634 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.082980    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-cni-netd\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.083634 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083020    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-var-lib-kubelet\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.083634 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083041    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdqrq\" (UniqueName: \"kubernetes.io/projected/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-kube-api-access-kdqrq\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.083634 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083057    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-hostroot\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.083634 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083077    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk4gt\" (UniqueName: \"kubernetes.io/projected/f99fdc7b-743b-4fae-b826-c2bd4c75aadc-kube-api-access-mk4gt\") pod \"node-ca-f9v7g\" (UID: \"f99fdc7b-743b-4fae-b826-c2bd4c75aadc\") " pod="openshift-image-registry/node-ca-f9v7g"
Jul 15 16:15:54.083634 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083079    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-multus-cni-dir\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.083634 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083113    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-hostroot\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.083634 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083102    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-os-release\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:54.083634 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083124    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-var-lib-kubelet\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.083634 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083156    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-os-release\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:54.083634 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-etc-kubernetes\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.083634 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083194    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-etc-kubernetes\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.083634 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083195    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs\") pod \"network-metrics-daemon-ht28p\" (UID: \"e68bcad1-c436-4799-89f3-72d611f5716d\") " pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:15:54.084503 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083229    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-run-systemd\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.084503 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.084503 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:54.083264    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:15:54.084503 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083280    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4d99d675-1134-4c0f-bcab-5c9820f49002-multus-daemon-config\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.084503 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083282    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-ovn-node-metrics-cert\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.084503 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083310    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.084503 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3c080-f558-431e-b4f7-527663feedc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:54.084503 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083368    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-run-systemd\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.084503 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083413    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3c080-f558-431e-b4f7-527663feedc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:54.084503 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083439    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:54.084503 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:54.083490    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs podName:e68bcad1-c436-4799-89f3-72d611f5716d nodeName:}" failed. No retries permitted until 2026-07-15 16:15:54.583450361 +0000 UTC m=+2.121276019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs") pod "network-metrics-daemon-ht28p" (UID: "e68bcad1-c436-4799-89f3-72d611f5716d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:15:54.084503 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-sysctl-conf\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.084503 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083597    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-ovnkube-script-lib\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.084503 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083598    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f99fdc7b-743b-4fae-b826-c2bd4c75aadc-serviceca\") pod \"node-ca-f9v7g\" (UID: \"f99fdc7b-743b-4fae-b826-c2bd4c75aadc\") " pod="openshift-image-registry/node-ca-f9v7g"
Jul 15 16:15:54.084503 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083672    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-cni-bin\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.084503 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083697    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-lib-modules\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.084503 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083701    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4d99d675-1134-4c0f-bcab-5c9820f49002-cni-binary-copy\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.085293 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083722    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-sysctl-conf\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.085293 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083726    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs8tl\" (UniqueName: \"kubernetes.io/projected/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-kube-api-access-vs8tl\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:54.085293 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083765    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-kubelet\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.085293 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083791    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-etc-openvswitch\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.085293 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083814    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-ovnkube-config\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.085293 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083835    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-sys\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.085293 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083857    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-host\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.085293 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083865    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-cni-bin\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.085293 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083882    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d0d24e92-1685-4d42-b291-4ceebc12c881-kubelet-config\") pod \"global-pull-secret-syncer-z7zbh\" (UID: \"d0d24e92-1685-4d42-b291-4ceebc12c881\") " pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:15:54.085293 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-host-var-lib-cni-bin\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.085293 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083929    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d7a3c080-f558-431e-b4f7-527663feedc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:54.085293 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083940    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:54.085293 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083953    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-system-cni-dir\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:54.085293 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083972    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-etc-openvswitch\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.085293 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083982    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-lib-modules\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.085293 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083990    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-kubelet\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.085293 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.083976    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-cnibin\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:54.086072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084028    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-cnibin\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.086072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084037    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-host\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.086072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084047    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-os-release\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.086072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3c080-f558-431e-b4f7-527663feedc0-device-dir\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:54.086072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084081    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-host-var-lib-cni-bin\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.086072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084085    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-kubernetes\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.086072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084096    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-cnibin\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.086072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084106    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-system-cni-dir\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:54.086072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084120    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:54.086072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084128    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-kubernetes\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.086072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084113    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d7a3c080-f558-431e-b4f7-527663feedc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:54.086072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084147    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f99fdc7b-743b-4fae-b826-c2bd4c75aadc-host\") pod \"node-ca-f9v7g\" (UID: \"f99fdc7b-743b-4fae-b826-c2bd4c75aadc\") " pod="openshift-image-registry/node-ca-f9v7g"
Jul 15 16:15:54.086072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084153    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d0d24e92-1685-4d42-b291-4ceebc12c881-kubelet-config\") pod \"global-pull-secret-syncer-z7zbh\" (UID: \"d0d24e92-1685-4d42-b291-4ceebc12c881\") " pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:15:54.086072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084165    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-os-release\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.086072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084180    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3c080-f558-431e-b4f7-527663feedc0-device-dir\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:54.086072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084182    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-cnibin\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:54.086072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084191    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-sys\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.086072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-sysctl-d\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.086646 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084216    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f99fdc7b-743b-4fae-b826-c2bd4c75aadc-host\") pod \"node-ca-f9v7g\" (UID: \"f99fdc7b-743b-4fae-b826-c2bd4c75aadc\") " pod="openshift-image-registry/node-ca-f9v7g"
Jul 15 16:15:54.086646 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084230    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret\") pod \"global-pull-secret-syncer-z7zbh\" (UID: \"d0d24e92-1685-4d42-b291-4ceebc12c881\") " pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:15:54.086646 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-host-var-lib-cni-multus\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.086646 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084290    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-sysctl-d\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.086646 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084302    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-host-var-lib-cni-multus\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.086646 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:54.084320    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:15:54.086646 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084367    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-slash\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.086646 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:54.084388    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret podName:d0d24e92-1685-4d42-b291-4ceebc12c881 nodeName:}" failed. No retries permitted until 2026-07-15 16:15:54.584372327 +0000 UTC m=+2.122197976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret") pod "global-pull-secret-syncer-z7zbh" (UID: "d0d24e92-1685-4d42-b291-4ceebc12c881") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:15:54.086646 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084392    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-slash\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.086646 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084421    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-run-openvswitch\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.086646 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084449    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7t76\" (UniqueName: \"kubernetes.io/projected/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-kube-api-access-l7t76\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.086646 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084475    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3c080-f558-431e-b4f7-527663feedc0-socket-dir\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:54.086646 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084519    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-run-openvswitch\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.086646 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-tuned\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.086646 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084615    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9787ee82-eeaf-4476-9925-1aa7774e6f6d-agent-certs\") pod \"konnectivity-agent-th64x\" (UID: \"9787ee82-eeaf-4476-9925-1aa7774e6f6d\") " pod="kube-system/konnectivity-agent-th64x"
Jul 15 16:15:54.086646 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084630    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:54.086646 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084639    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:54.087174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lndjh\" (UniqueName: \"kubernetes.io/projected/4d99d675-1134-4c0f-bcab-5c9820f49002-kube-api-access-lndjh\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.087174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084704    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-run-ovn\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.087174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084588    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3c080-f558-431e-b4f7-527663feedc0-socket-dir\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:54.087174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084728    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d7a3c080-f558-431e-b4f7-527663feedc0-sys-fs\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:54.087174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084754    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-var-lib-openvswitch\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.087174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084773    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f99fdc7b-743b-4fae-b826-c2bd4c75aadc-serviceca\") pod \"node-ca-f9v7g\" (UID: \"f99fdc7b-743b-4fae-b826-c2bd4c75aadc\") " pod="openshift-image-registry/node-ca-f9v7g"
Jul 15 16:15:54.087174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084798    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:54.087174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084804    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-system-cni-dir\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.087174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084826    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-run-ovn\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.087174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084859    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d7a3c080-f558-431e-b4f7-527663feedc0-sys-fs\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:54.087174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084843    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-host-run-k8s-cni-cncf-io\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.087174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084883    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-var-lib-openvswitch\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.087174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084903    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-run-ovn-kubernetes\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.087174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084910    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-system-cni-dir\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.087174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-env-overrides\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.087174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084923    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-host-run-k8s-cni-cncf-io\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.087174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084957    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-host-run-ovn-kubernetes\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.087659 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084966    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3c080-f558-431e-b4f7-527663feedc0-registration-dir\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:54.087659 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.084992    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-systemd\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.087659 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085007    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d7a3c080-f558-431e-b4f7-527663feedc0-registration-dir\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:54.087659 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085030    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:54.087659 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085054    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-systemd\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.087659 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085080    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-multus-conf-dir\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.087659 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085095    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-ovnkube-config\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.087659 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085116    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-modprobe-d\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.087659 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085138    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-run\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.087659 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085155    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4d99d675-1134-4c0f-bcab-5c9820f49002-multus-conf-dir\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.087659 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085176    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-tmp\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.087659 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085207    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d0d24e92-1685-4d42-b291-4ceebc12c881-dbus\") pod \"global-pull-secret-syncer-z7zbh\" (UID: \"d0d24e92-1685-4d42-b291-4ceebc12c881\") " pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:15:54.087659 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085231    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9787ee82-eeaf-4476-9925-1aa7774e6f6d-konnectivity-ca\") pod \"konnectivity-agent-th64x\" (UID: \"9787ee82-eeaf-4476-9925-1aa7774e6f6d\") " pod="kube-system/konnectivity-agent-th64x"
Jul 15 16:15:54.087659 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085246    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-modprobe-d\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.087659 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-systemd-units\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.087659 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085323    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-systemd-units\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.087659 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085465    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d0d24e92-1685-4d42-b291-4ceebc12c881-dbus\") pod \"global-pull-secret-syncer-z7zbh\" (UID: \"d0d24e92-1685-4d42-b291-4ceebc12c881\") " pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:15:54.088106 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085500    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:54.088106 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085567    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-run\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.088106 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085833    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9787ee82-eeaf-4476-9925-1aa7774e6f6d-konnectivity-ca\") pod \"konnectivity-agent-th64x\" (UID: \"9787ee82-eeaf-4476-9925-1aa7774e6f6d\") " pod="kube-system/konnectivity-agent-th64x"
Jul 15 16:15:54.088106 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.085879    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-ovn-node-metrics-cert\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.088106 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.086129    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-env-overrides\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.088106 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.086911    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9787ee82-eeaf-4476-9925-1aa7774e6f6d-agent-certs\") pod \"konnectivity-agent-th64x\" (UID: \"9787ee82-eeaf-4476-9925-1aa7774e6f6d\") " pod="kube-system/konnectivity-agent-th64x"
Jul 15 16:15:54.088106 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.087015    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-etc-tuned\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.088106 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.087177    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-tmp\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.091652 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.091634    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8glr\" (UniqueName: \"kubernetes.io/projected/d7a3c080-f558-431e-b4f7-527663feedc0-kube-api-access-w8glr\") pod \"aws-ebs-csi-driver-node-2ttn2\" (UID: \"d7a3c080-f558-431e-b4f7-527663feedc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:54.092778 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.092760    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xrjv\" (UniqueName: \"kubernetes.io/projected/e68bcad1-c436-4799-89f3-72d611f5716d-kube-api-access-9xrjv\") pod \"network-metrics-daemon-ht28p\" (UID: \"e68bcad1-c436-4799-89f3-72d611f5716d\") " pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:15:54.093216 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.093199    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdqrq\" (UniqueName: \"kubernetes.io/projected/1e5eaa1e-616d-42ea-a5f3-ed827517b0d8-kube-api-access-kdqrq\") pod \"tuned-lzmrz\" (UID: \"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8\") " pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.094149 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.094132    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk4gt\" (UniqueName: \"kubernetes.io/projected/f99fdc7b-743b-4fae-b826-c2bd4c75aadc-kube-api-access-mk4gt\") pod \"node-ca-f9v7g\" (UID: \"f99fdc7b-743b-4fae-b826-c2bd4c75aadc\") " pod="openshift-image-registry/node-ca-f9v7g"
Jul 15 16:15:54.094950 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.094935    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs8tl\" (UniqueName: \"kubernetes.io/projected/a0d9fd90-7de4-4f7e-bffc-f17eed184e8c-kube-api-access-vs8tl\") pod \"multus-additional-cni-plugins-tp94d\" (UID: \"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c\") " pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:54.098193 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.098173    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7t76\" (UniqueName: \"kubernetes.io/projected/e83119d2-cd50-4da7-8e8c-1ecfb586cdd6-kube-api-access-l7t76\") pod \"ovnkube-node-jcp65\" (UID: \"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.098447 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.098433    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lndjh\" (UniqueName: \"kubernetes.io/projected/4d99d675-1134-4c0f-bcab-5c9820f49002-kube-api-access-lndjh\") pod \"multus-dx9mh\" (UID: \"4d99d675-1134-4c0f-bcab-5c9820f49002\") " pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.130548 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.130500    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:15:54.203865 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.203839    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-746j8"
Jul 15 16:15:54.212944 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:54.212920    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod725f8d4f_c7db_452b_a0b8_bb292c501156.slice/crio-0542ec6b41630264eb69ca8b55c0aacdc738dea4a3c945ec0ed41dfa92e5d4c7 WatchSource:0}: Error finding container 0542ec6b41630264eb69ca8b55c0aacdc738dea4a3c945ec0ed41dfa92e5d4c7: Status 404 returned error can't find the container with id 0542ec6b41630264eb69ca8b55c0aacdc738dea4a3c945ec0ed41dfa92e5d4c7
Jul 15 16:15:54.213614 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.213597    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-67fct"
Jul 15 16:15:54.221240 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:54.221220    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e0c32c_4fc8_4015_a95b_bf2aadd4554f.slice/crio-47ce54bb979dc6589af3b64efe7b897ecbf120204f30cffe71ac0e8f96aac03a WatchSource:0}: Error finding container 47ce54bb979dc6589af3b64efe7b897ecbf120204f30cffe71ac0e8f96aac03a: Status 404 returned error can't find the container with id 47ce54bb979dc6589af3b64efe7b897ecbf120204f30cffe71ac0e8f96aac03a
Jul 15 16:15:54.222782 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.222765    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:15:54.230452 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:54.230433    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode83119d2_cd50_4da7_8e8c_1ecfb586cdd6.slice/crio-a8a4fbf05d0bd48f7ffb168bbbd6aaa672ea6e6ae20b802536984a1d10d5a387 WatchSource:0}: Error finding container a8a4fbf05d0bd48f7ffb168bbbd6aaa672ea6e6ae20b802536984a1d10d5a387: Status 404 returned error can't find the container with id a8a4fbf05d0bd48f7ffb168bbbd6aaa672ea6e6ae20b802536984a1d10d5a387
Jul 15 16:15:54.235053 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.235039    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-th64x"
Jul 15 16:15:54.242530 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:54.242513    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9787ee82_eeaf_4476_9925_1aa7774e6f6d.slice/crio-e691f2225aceca6c397c8affb3e50f9321a7b6328c4522f740072ec3c841c8ab WatchSource:0}: Error finding container e691f2225aceca6c397c8affb3e50f9321a7b6328c4522f740072ec3c841c8ab: Status 404 returned error can't find the container with id e691f2225aceca6c397c8affb3e50f9321a7b6328c4522f740072ec3c841c8ab
Jul 15 16:15:54.249983 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.249968    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2"
Jul 15 16:15:54.257801 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:54.257783    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a3c080_f558_431e_b4f7_527663feedc0.slice/crio-f320248e44dcf5928f4f0f118094cf7aab48d0724ba5083f177e74888578f861 WatchSource:0}: Error finding container f320248e44dcf5928f4f0f118094cf7aab48d0724ba5083f177e74888578f861: Status 404 returned error can't find the container with id f320248e44dcf5928f4f0f118094cf7aab48d0724ba5083f177e74888578f861
Jul 15 16:15:54.267588 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.267570    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lzmrz"
Jul 15 16:15:54.273569 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.273554    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f9v7g"
Jul 15 16:15:54.275223 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:54.275203    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e5eaa1e_616d_42ea_a5f3_ed827517b0d8.slice/crio-6885c9fe09d233af92c4b671b5176ced3ca2a07b1b446cb9488d82a8560f4812 WatchSource:0}: Error finding container 6885c9fe09d233af92c4b671b5176ced3ca2a07b1b446cb9488d82a8560f4812: Status 404 returned error can't find the container with id 6885c9fe09d233af92c4b671b5176ced3ca2a07b1b446cb9488d82a8560f4812
Jul 15 16:15:54.282609 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:54.282585    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf99fdc7b_743b_4fae_b826_c2bd4c75aadc.slice/crio-d3ebea0877255dab0632ea40750e92c320f2064cc87d75a7a3c9950d055341a9 WatchSource:0}: Error finding container d3ebea0877255dab0632ea40750e92c320f2064cc87d75a7a3c9950d055341a9: Status 404 returned error can't find the container with id d3ebea0877255dab0632ea40750e92c320f2064cc87d75a7a3c9950d055341a9
Jul 15 16:15:54.293445 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.293429    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tp94d"
Jul 15 16:15:54.301501 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:54.301484    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d9fd90_7de4_4f7e_bffc_f17eed184e8c.slice/crio-6a831a5194ceac1bf9ebdc601c374f89e8292b5f81933ebed90c0b6245e80c11 WatchSource:0}: Error finding container 6a831a5194ceac1bf9ebdc601c374f89e8292b5f81933ebed90c0b6245e80c11: Status 404 returned error can't find the container with id 6a831a5194ceac1bf9ebdc601c374f89e8292b5f81933ebed90c0b6245e80c11
Jul 15 16:15:54.302040 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.302026    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dx9mh"
Jul 15 16:15:54.309596 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:15:54.309579    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d99d675_1134_4c0f_bcab_5c9820f49002.slice/crio-7ff653c53070a65d2fd2ec9dd6497d58d6a5bb5bb4fc636986f896c3951275e4 WatchSource:0}: Error finding container 7ff653c53070a65d2fd2ec9dd6497d58d6a5bb5bb4fc636986f896c3951275e4: Status 404 returned error can't find the container with id 7ff653c53070a65d2fd2ec9dd6497d58d6a5bb5bb4fc636986f896c3951275e4
Jul 15 16:15:54.589366 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.589274    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs\") pod \"network-metrics-daemon-ht28p\" (UID: \"e68bcad1-c436-4799-89f3-72d611f5716d\") " pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:15:54.589366 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.589355    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptwnx\" (UniqueName: \"kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx\") pod \"network-check-target-9h4t6\" (UID: \"bc941219-34a4-4e54-aae8-6feb420ddac5\") " pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:15:54.589589 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:54.589386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret\") pod \"global-pull-secret-syncer-z7zbh\" (UID: \"d0d24e92-1685-4d42-b291-4ceebc12c881\") " pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:15:54.589589 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:54.589495    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:15:54.589589 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:54.589550    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:15:54.589589 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:54.589560    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret podName:d0d24e92-1685-4d42-b291-4ceebc12c881 nodeName:}" failed. No retries permitted until 2026-07-15 16:15:55.589535169 +0000 UTC m=+3.127360816 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret") pod "global-pull-secret-syncer-z7zbh" (UID: "d0d24e92-1685-4d42-b291-4ceebc12c881") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:15:54.589589 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:54.589588    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs podName:e68bcad1-c436-4799-89f3-72d611f5716d nodeName:}" failed. No retries permitted until 2026-07-15 16:15:55.589577414 +0000 UTC m=+3.127403055 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs") pod "network-metrics-daemon-ht28p" (UID: "e68bcad1-c436-4799-89f3-72d611f5716d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:15:54.589867 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:54.589662    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:15:54.589867 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:54.589678    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:15:54.589867 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:54.589691    2582 projected.go:196] Error preparing data for projected volume kube-api-access-ptwnx for pod openshift-network-diagnostics/network-check-target-9h4t6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:15:54.589867 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:54.589724    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx podName:bc941219-34a4-4e54-aae8-6feb420ddac5 nodeName:}" failed. No retries permitted until 2026-07-15 16:15:55.589714189 +0000 UTC m=+3.127539823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptwnx" (UniqueName: "kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx") pod "network-check-target-9h4t6" (UID: "bc941219-34a4-4e54-aae8-6feb420ddac5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:15:55.000150 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.000065    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 16:10:53 +0000 UTC" deadline="2028-02-27 14:46:25.639545348 +0000 UTC"
Jul 15 16:15:55.000150 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.000103    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14206h30m30.63944662s"
Jul 15 16:15:55.002460 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.002402    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65" event={"ID":"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6","Type":"ContainerStarted","Data":"a8a4fbf05d0bd48f7ffb168bbbd6aaa672ea6e6ae20b802536984a1d10d5a387"}
Jul 15 16:15:55.018105 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.018078    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-67fct" event={"ID":"b4e0c32c-4fc8-4015-a95b-bf2aadd4554f","Type":"ContainerStarted","Data":"47ce54bb979dc6589af3b64efe7b897ecbf120204f30cffe71ac0e8f96aac03a"}
Jul 15 16:15:55.024776 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.024730    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-746j8" event={"ID":"725f8d4f-c7db-452b-a0b8-bb292c501156","Type":"ContainerStarted","Data":"0542ec6b41630264eb69ca8b55c0aacdc738dea4a3c945ec0ed41dfa92e5d4c7"}
Jul 15 16:15:55.038202 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.038177    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal" event={"ID":"3aa295c57b47767de99fcd5136c816cd","Type":"ContainerStarted","Data":"a6c169481775862b3aada60890c675267a3e02b481b4c5d427dd83e054386827"}
Jul 15 16:15:55.057332 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.057305    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dx9mh" event={"ID":"4d99d675-1134-4c0f-bcab-5c9820f49002","Type":"ContainerStarted","Data":"7ff653c53070a65d2fd2ec9dd6497d58d6a5bb5bb4fc636986f896c3951275e4"}
Jul 15 16:15:55.064392 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.064321    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-th64x" event={"ID":"9787ee82-eeaf-4476-9925-1aa7774e6f6d","Type":"ContainerStarted","Data":"e691f2225aceca6c397c8affb3e50f9321a7b6328c4522f740072ec3c841c8ab"}
Jul 15 16:15:55.073871 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.073847    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal" event={"ID":"6095f02d0d4f4a0c3d104c65bcb58cd3","Type":"ContainerStarted","Data":"9b87ffd76ea11eab90b45a799120c695e347e55e46f63b69a48cc47ae48e7282"}
Jul 15 16:15:55.080289 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.080232    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tp94d" event={"ID":"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c","Type":"ContainerStarted","Data":"6a831a5194ceac1bf9ebdc601c374f89e8292b5f81933ebed90c0b6245e80c11"}
Jul 15 16:15:55.099387 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.099363    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f9v7g" event={"ID":"f99fdc7b-743b-4fae-b826-c2bd4c75aadc","Type":"ContainerStarted","Data":"d3ebea0877255dab0632ea40750e92c320f2064cc87d75a7a3c9950d055341a9"}
Jul 15 16:15:55.113411 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.113375    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lzmrz" event={"ID":"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8","Type":"ContainerStarted","Data":"6885c9fe09d233af92c4b671b5176ced3ca2a07b1b446cb9488d82a8560f4812"}
Jul 15 16:15:55.124446 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.124374    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2" event={"ID":"d7a3c080-f558-431e-b4f7-527663feedc0","Type":"ContainerStarted","Data":"f320248e44dcf5928f4f0f118094cf7aab48d0724ba5083f177e74888578f861"}
Jul 15 16:15:55.345305 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.345223    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:15:55.599387 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.598456    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs\") pod \"network-metrics-daemon-ht28p\" (UID: \"e68bcad1-c436-4799-89f3-72d611f5716d\") " pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:15:55.599387 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.598510    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptwnx\" (UniqueName: \"kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx\") pod \"network-check-target-9h4t6\" (UID: \"bc941219-34a4-4e54-aae8-6feb420ddac5\") " pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:15:55.599387 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.598541    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret\") pod \"global-pull-secret-syncer-z7zbh\" (UID: \"d0d24e92-1685-4d42-b291-4ceebc12c881\") " pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:15:55.599387 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:55.598670    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:15:55.599387 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:55.598728    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret podName:d0d24e92-1685-4d42-b291-4ceebc12c881 nodeName:}" failed. No retries permitted until 2026-07-15 16:15:57.59871087 +0000 UTC m=+5.136536510 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret") pod "global-pull-secret-syncer-z7zbh" (UID: "d0d24e92-1685-4d42-b291-4ceebc12c881") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:15:55.599387 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:55.599094    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:15:55.599387 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:55.599141    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs podName:e68bcad1-c436-4799-89f3-72d611f5716d nodeName:}" failed. No retries permitted until 2026-07-15 16:15:57.599125719 +0000 UTC m=+5.136951356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs") pod "network-metrics-daemon-ht28p" (UID: "e68bcad1-c436-4799-89f3-72d611f5716d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:15:55.599387 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:55.599217    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:15:55.599387 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:55.599235    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:15:55.599387 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:55.599246    2582 projected.go:196] Error preparing data for projected volume kube-api-access-ptwnx for pod openshift-network-diagnostics/network-check-target-9h4t6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:15:55.599387 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:55.599291    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx podName:bc941219-34a4-4e54-aae8-6feb420ddac5 nodeName:}" failed. No retries permitted until 2026-07-15 16:15:57.599270267 +0000 UTC m=+5.137095906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptwnx" (UniqueName: "kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx") pod "network-check-target-9h4t6" (UID: "bc941219-34a4-4e54-aae8-6feb420ddac5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:15:55.826059 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.826023    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:15:55.973130 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.972125    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:15:55.973130 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:55.972280    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7zbh" podUID="d0d24e92-1685-4d42-b291-4ceebc12c881"
Jul 15 16:15:55.973130 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.972813    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:15:55.973130 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:55.972910    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht28p" podUID="e68bcad1-c436-4799-89f3-72d611f5716d"
Jul 15 16:15:55.973130 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:55.972967    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:15:55.973130 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:55.973037    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9h4t6" podUID="bc941219-34a4-4e54-aae8-6feb420ddac5"
Jul 15 16:15:56.000793 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:56.000742    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 16:10:53 +0000 UTC" deadline="2027-12-21 04:15:56.065827724 +0000 UTC"
Jul 15 16:15:56.000793 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:56.000791    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12564h0m0.065040696s"
Jul 15 16:15:57.616101 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:57.615754    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs\") pod \"network-metrics-daemon-ht28p\" (UID: \"e68bcad1-c436-4799-89f3-72d611f5716d\") " pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:15:57.616101 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:57.615816    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptwnx\" (UniqueName: \"kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx\") pod \"network-check-target-9h4t6\" (UID: \"bc941219-34a4-4e54-aae8-6feb420ddac5\") " pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:15:57.616101 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:57.615845    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret\") pod \"global-pull-secret-syncer-z7zbh\" (UID: \"d0d24e92-1685-4d42-b291-4ceebc12c881\") " pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:15:57.616101 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:57.615981    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:15:57.616101 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:57.616037    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret podName:d0d24e92-1685-4d42-b291-4ceebc12c881 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:01.616020314 +0000 UTC m=+9.153845952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret") pod "global-pull-secret-syncer-z7zbh" (UID: "d0d24e92-1685-4d42-b291-4ceebc12c881") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:15:57.616745 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:57.616246    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:15:57.616745 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:57.616270    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:15:57.616745 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:57.616283    2582 projected.go:196] Error preparing data for projected volume kube-api-access-ptwnx for pod openshift-network-diagnostics/network-check-target-9h4t6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:15:57.616745 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:57.616347    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx podName:bc941219-34a4-4e54-aae8-6feb420ddac5 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:01.616318229 +0000 UTC m=+9.154143876 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptwnx" (UniqueName: "kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx") pod "network-check-target-9h4t6" (UID: "bc941219-34a4-4e54-aae8-6feb420ddac5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:15:57.616745 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:57.616374    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:15:57.616745 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:57.616419    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs podName:e68bcad1-c436-4799-89f3-72d611f5716d nodeName:}" failed. No retries permitted until 2026-07-15 16:16:01.61640637 +0000 UTC m=+9.154232014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs") pod "network-metrics-daemon-ht28p" (UID: "e68bcad1-c436-4799-89f3-72d611f5716d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:15:57.971747 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:57.971675    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:15:57.971902 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:57.971802    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9h4t6" podUID="bc941219-34a4-4e54-aae8-6feb420ddac5"
Jul 15 16:15:57.971966 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:57.971898    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:15:57.972014 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:57.971993    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht28p" podUID="e68bcad1-c436-4799-89f3-72d611f5716d"
Jul 15 16:15:57.972062 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:57.972036    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:15:57.972481 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:57.972105    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7zbh" podUID="d0d24e92-1685-4d42-b291-4ceebc12c881"
Jul 15 16:15:59.972622 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:59.972076    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:15:59.972622 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:59.972198    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9h4t6" podUID="bc941219-34a4-4e54-aae8-6feb420ddac5"
Jul 15 16:15:59.972622 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:59.972579    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:15:59.973109 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:15:59.972571    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:15:59.973109 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:59.972698    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht28p" podUID="e68bcad1-c436-4799-89f3-72d611f5716d"
Jul 15 16:15:59.973109 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:15:59.972795    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7zbh" podUID="d0d24e92-1685-4d42-b291-4ceebc12c881"
Jul 15 16:16:01.650871 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:01.650760    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs\") pod \"network-metrics-daemon-ht28p\" (UID: \"e68bcad1-c436-4799-89f3-72d611f5716d\") " pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:01.650871 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:01.650830    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptwnx\" (UniqueName: \"kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx\") pod \"network-check-target-9h4t6\" (UID: \"bc941219-34a4-4e54-aae8-6feb420ddac5\") " pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:01.650871 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:01.650858    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret\") pod \"global-pull-secret-syncer-z7zbh\" (UID: \"d0d24e92-1685-4d42-b291-4ceebc12c881\") " pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:01.651489 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:01.650940    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:16:01.651489 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:01.651014    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs podName:e68bcad1-c436-4799-89f3-72d611f5716d nodeName:}" failed. No retries permitted until 2026-07-15 16:16:09.650992677 +0000 UTC m=+17.188818330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs") pod "network-metrics-daemon-ht28p" (UID: "e68bcad1-c436-4799-89f3-72d611f5716d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:16:01.651489 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:01.651036    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:16:01.651489 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:01.651058    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:16:01.651489 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:01.651071    2582 projected.go:196] Error preparing data for projected volume kube-api-access-ptwnx for pod openshift-network-diagnostics/network-check-target-9h4t6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:16:01.651489 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:01.651091    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:16:01.651489 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:01.651121    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx podName:bc941219-34a4-4e54-aae8-6feb420ddac5 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:09.651104708 +0000 UTC m=+17.188930357 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptwnx" (UniqueName: "kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx") pod "network-check-target-9h4t6" (UID: "bc941219-34a4-4e54-aae8-6feb420ddac5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:16:01.651489 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:01.651186    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret podName:d0d24e92-1685-4d42-b291-4ceebc12c881 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:09.651169392 +0000 UTC m=+17.188995040 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret") pod "global-pull-secret-syncer-z7zbh" (UID: "d0d24e92-1685-4d42-b291-4ceebc12c881") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:16:01.971659 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:01.971574    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:01.971814 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:01.971722    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht28p" podUID="e68bcad1-c436-4799-89f3-72d611f5716d"
Jul 15 16:16:01.971814 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:01.971745    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:01.971929 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:01.971841    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9h4t6" podUID="bc941219-34a4-4e54-aae8-6feb420ddac5"
Jul 15 16:16:01.971929 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:01.971891    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:01.972015 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:01.971949    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7zbh" podUID="d0d24e92-1685-4d42-b291-4ceebc12c881"
Jul 15 16:16:03.971535 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:03.971485    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:03.971535 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:03.971533    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:03.972034 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:03.971532    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:03.972034 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:03.971624    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7zbh" podUID="d0d24e92-1685-4d42-b291-4ceebc12c881"
Jul 15 16:16:03.972034 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:03.971775    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9h4t6" podUID="bc941219-34a4-4e54-aae8-6feb420ddac5"
Jul 15 16:16:03.972034 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:03.971886    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht28p" podUID="e68bcad1-c436-4799-89f3-72d611f5716d"
Jul 15 16:16:05.972200 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:05.972165    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:05.972624 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:05.972288    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:05.972624 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:05.972304    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9h4t6" podUID="bc941219-34a4-4e54-aae8-6feb420ddac5"
Jul 15 16:16:05.972624 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:05.972323    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:05.972624 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:05.972437    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht28p" podUID="e68bcad1-c436-4799-89f3-72d611f5716d"
Jul 15 16:16:05.972624 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:05.972522    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7zbh" podUID="d0d24e92-1685-4d42-b291-4ceebc12c881"
Jul 15 16:16:07.972041 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:07.972010    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:07.972446 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:07.972147    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:07.972446 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:07.972164    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:07.972446 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:07.972167    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7zbh" podUID="d0d24e92-1685-4d42-b291-4ceebc12c881"
Jul 15 16:16:07.972446 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:07.972234    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht28p" podUID="e68bcad1-c436-4799-89f3-72d611f5716d"
Jul 15 16:16:07.972446 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:07.972321    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9h4t6" podUID="bc941219-34a4-4e54-aae8-6feb420ddac5"
Jul 15 16:16:09.718485 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:09.718283    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs\") pod \"network-metrics-daemon-ht28p\" (UID: \"e68bcad1-c436-4799-89f3-72d611f5716d\") " pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:09.718916 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:09.718525    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptwnx\" (UniqueName: \"kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx\") pod \"network-check-target-9h4t6\" (UID: \"bc941219-34a4-4e54-aae8-6feb420ddac5\") " pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:09.718916 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:09.718552    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret\") pod \"global-pull-secret-syncer-z7zbh\" (UID: \"d0d24e92-1685-4d42-b291-4ceebc12c881\") " pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:09.718916 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:09.718444    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:16:09.718916 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:09.718633    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs podName:e68bcad1-c436-4799-89f3-72d611f5716d nodeName:}" failed. No retries permitted until 2026-07-15 16:16:25.718609496 +0000 UTC m=+33.256435135 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs") pod "network-metrics-daemon-ht28p" (UID: "e68bcad1-c436-4799-89f3-72d611f5716d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:16:09.718916 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:09.718659    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:16:09.718916 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:09.718663    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:16:09.718916 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:09.718680    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:16:09.718916 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:09.718690    2582 projected.go:196] Error preparing data for projected volume kube-api-access-ptwnx for pod openshift-network-diagnostics/network-check-target-9h4t6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:16:09.718916 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:09.718712    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret podName:d0d24e92-1685-4d42-b291-4ceebc12c881 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:25.718696259 +0000 UTC m=+33.256521893 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret") pod "global-pull-secret-syncer-z7zbh" (UID: "d0d24e92-1685-4d42-b291-4ceebc12c881") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:16:09.718916 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:09.718733    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx podName:bc941219-34a4-4e54-aae8-6feb420ddac5 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:25.718718606 +0000 UTC m=+33.256544240 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptwnx" (UniqueName: "kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx") pod "network-check-target-9h4t6" (UID: "bc941219-34a4-4e54-aae8-6feb420ddac5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:16:09.971712 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:09.971631    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:09.971712 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:09.971654    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:09.971712 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:09.971668    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:09.972039 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:09.971763    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht28p" podUID="e68bcad1-c436-4799-89f3-72d611f5716d"
Jul 15 16:16:09.972039 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:09.971838    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7zbh" podUID="d0d24e92-1685-4d42-b291-4ceebc12c881"
Jul 15 16:16:09.972039 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:09.971932    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9h4t6" podUID="bc941219-34a4-4e54-aae8-6feb420ddac5"
Jul 15 16:16:11.971606 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:11.971564    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:11.971606 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:11.971592    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:11.972093 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:11.971597    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:11.972093 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:11.971686    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7zbh" podUID="d0d24e92-1685-4d42-b291-4ceebc12c881"
Jul 15 16:16:11.972093 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:11.971774    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9h4t6" podUID="bc941219-34a4-4e54-aae8-6feb420ddac5"
Jul 15 16:16:11.972093 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:11.971868    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht28p" podUID="e68bcad1-c436-4799-89f3-72d611f5716d"
Jul 15 16:16:13.971997 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:13.971582    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:13.971997 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:13.971718    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht28p" podUID="e68bcad1-c436-4799-89f3-72d611f5716d"
Jul 15 16:16:13.971997 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:13.971936    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:13.972521 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:13.972029    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7zbh" podUID="d0d24e92-1685-4d42-b291-4ceebc12c881"
Jul 15 16:16:13.972521 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:13.972110    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:13.972521 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:13.972210    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9h4t6" podUID="bc941219-34a4-4e54-aae8-6feb420ddac5"
Jul 15 16:16:14.161107 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:14.160918    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal" event={"ID":"3aa295c57b47767de99fcd5136c816cd","Type":"ContainerStarted","Data":"23c38e2a01ee7db00184148443157645dc71aac06f6d7adcff9b3fe3b3b88dee"}
Jul 15 16:16:14.163174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:14.163139    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dx9mh" event={"ID":"4d99d675-1134-4c0f-bcab-5c9820f49002","Type":"ContainerStarted","Data":"e9efc6f94b38398b97e088fb8dc1304b3160a0bedb86681671dac00fdf1cd4b7"}
Jul 15 16:16:14.164796 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:14.164769    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lzmrz" event={"ID":"1e5eaa1e-616d-42ea-a5f3-ed827517b0d8","Type":"ContainerStarted","Data":"721cce240f08a4ab10546ecd28714d4d6b9e42dade0119a05da95ad720755d1a"}
Jul 15 16:16:14.166529 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:14.166510    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:16:14.166895 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:14.166876    2582 generic.go:356] "Generic (PLEG): container finished" podID="e83119d2-cd50-4da7-8e8c-1ecfb586cdd6" containerID="ec9be2d245ab1ef116cfcfb42befd971c5a9c2878782f3bf10d58a9f0e3c5b91" exitCode=1
Jul 15 16:16:14.166954 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:14.166904    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65" event={"ID":"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6","Type":"ContainerDied","Data":"ec9be2d245ab1ef116cfcfb42befd971c5a9c2878782f3bf10d58a9f0e3c5b91"}
Jul 15 16:16:14.166954 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:14.166950    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65" event={"ID":"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6","Type":"ContainerStarted","Data":"4682de9e19022b1d3595a95490a447463595138c508de61c3ddd76e0fa8b28e3"}
Jul 15 16:16:14.182581 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:14.182429    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-253.ec2.internal" podStartSLOduration=21.18241041 podStartE2EDuration="21.18241041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:15:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:14.18222125 +0000 UTC m=+21.720046906" watchObservedRunningTime="2026-07-15 16:16:14.18241041 +0000 UTC m=+21.720236118"
Jul 15 16:16:14.205779 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:14.205731    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lzmrz" podStartSLOduration=1.6882717870000001 podStartE2EDuration="21.205714597s" totalImagesPullingTime="19.51744281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:14.205665982 +0000 UTC m=+21.743491640" watchObservedRunningTime="2026-07-15 16:16:14.205714597 +0000 UTC m=+21.743540253"
Jul 15 16:16:14.230911 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:14.230859    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dx9mh" podStartSLOduration=1.6443081510000002 podStartE2EDuration="21.2308375s" totalImagesPullingTime="19.586529349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:14.230649634 +0000 UTC m=+21.768475293" watchObservedRunningTime="2026-07-15 16:16:14.2308375 +0000 UTC m=+21.768663157"
Jul 15 16:16:15.170536 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.170350    2582 generic.go:356] "Generic (PLEG): container finished" podID="a0d9fd90-7de4-4f7e-bffc-f17eed184e8c" containerID="2d9f9eac9b496489bb90ec6ee6dd15f5a52f7b94a70c9aee607d492ce9f634e3" exitCode=0
Jul 15 16:16:15.171263 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.170441    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tp94d" event={"ID":"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c","Type":"ContainerDied","Data":"2d9f9eac9b496489bb90ec6ee6dd15f5a52f7b94a70c9aee607d492ce9f634e3"}
Jul 15 16:16:15.172124 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.172106    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f9v7g" event={"ID":"f99fdc7b-743b-4fae-b826-c2bd4c75aadc","Type":"ContainerStarted","Data":"c97d054655881fcdf1758c091936ece41645e59bfea54a89e001e2f593f95e20"}
Jul 15 16:16:15.173569 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.173550    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2" event={"ID":"d7a3c080-f558-431e-b4f7-527663feedc0","Type":"ContainerStarted","Data":"d8406faed38ebd15db5e8af55c04c0765ba66f976cda3d0af5e4c9cb6eb25bc4"}
Jul 15 16:16:15.176210 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.176193    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:16:15.176547 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.176528    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65" event={"ID":"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6","Type":"ContainerStarted","Data":"d214c6f34c700dd131c1b5316934dd1990bb0edd145b53dd8897c8c57a65eed0"}
Jul 15 16:16:15.176611 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.176585    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65" event={"ID":"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6","Type":"ContainerStarted","Data":"32c66350e5affddafb64889cc393778cf3463630bc57983c2914508a5ef7d17b"}
Jul 15 16:16:15.176671 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.176625    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65" event={"ID":"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6","Type":"ContainerStarted","Data":"214a0c51f0db99c82decb40e8f6924b4ed75d67c5a96c2ead43915591249b4d1"}
Jul 15 16:16:15.176671 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.176654    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65" event={"ID":"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6","Type":"ContainerStarted","Data":"558f12c0c8faa3ab58b815402c0d8a5eb8e8e3f2bcaeef62130346041bf7a27d"}
Jul 15 16:16:15.178109 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.178089    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-746j8" event={"ID":"725f8d4f-c7db-452b-a0b8-bb292c501156","Type":"ContainerStarted","Data":"35d6c4fc3b69090f150c4e872b11b1876af77b86019bb35853e8aeb3c1cb4548"}
Jul 15 16:16:15.179359 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.179324    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-th64x" event={"ID":"9787ee82-eeaf-4476-9925-1aa7774e6f6d","Type":"ContainerStarted","Data":"6108d12b2abad033f58e14119965d0310e4c3085bc49118ead4679aeeb94735f"}
Jul 15 16:16:15.180656 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.180634    2582 generic.go:356] "Generic (PLEG): container finished" podID="6095f02d0d4f4a0c3d104c65bcb58cd3" containerID="7aea820698030b5a1e14d23a738a63229a9967c4be0265580bc83ab3c411b59c" exitCode=0
Jul 15 16:16:15.180751 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.180710    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal" event={"ID":"6095f02d0d4f4a0c3d104c65bcb58cd3","Type":"ContainerDied","Data":"7aea820698030b5a1e14d23a738a63229a9967c4be0265580bc83ab3c411b59c"}
Jul 15 16:16:15.260541 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.260502    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f9v7g" podStartSLOduration=2.796576532 podStartE2EDuration="22.260487509s" totalImagesPullingTime="19.463910977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:15.225947122 +0000 UTC m=+22.763772777" watchObservedRunningTime="2026-07-15 16:16:15.260487509 +0000 UTC m=+22.798313166"
Jul 15 16:16:15.322975 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.322936    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-th64x" podStartSLOduration=2.818920617 podStartE2EDuration="22.322921284s" totalImagesPullingTime="19.504000667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:15.321764219 +0000 UTC m=+22.859589876" watchObservedRunningTime="2026-07-15 16:16:15.322921284 +0000 UTC m=+22.860746939"
Jul 15 16:16:15.323330 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.323310    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-746j8" podStartSLOduration=2.789967388 podStartE2EDuration="22.323303458s" totalImagesPullingTime="19.53333607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:15.284964632 +0000 UTC m=+22.822790288" watchObservedRunningTime="2026-07-15 16:16:15.323303458 +0000 UTC m=+22.861129113"
Jul 15 16:16:15.542907 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.542888    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 16:16:15.952581 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.952406    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T16:16:15.54290338Z","UUID":"1bbef828-2549-4470-b553-e76ed47eefbf","Handler":null,"Name":"","Endpoint":""}
Jul 15 16:16:15.954033 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.954011    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 16:16:15.954149 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.954053    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 16:16:15.971542 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.971516    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:15.971668 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:15.971645    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht28p" podUID="e68bcad1-c436-4799-89f3-72d611f5716d"
Jul 15 16:16:15.972029 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.971972    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:15.972029 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:15.971989    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:15.972157 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:15.972067    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9h4t6" podUID="bc941219-34a4-4e54-aae8-6feb420ddac5"
Jul 15 16:16:15.972157 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:15.972144    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7zbh" podUID="d0d24e92-1685-4d42-b291-4ceebc12c881"
Jul 15 16:16:16.185854 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:16.185801    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2" event={"ID":"d7a3c080-f558-431e-b4f7-527663feedc0","Type":"ContainerStarted","Data":"c8a6046eac17c2e271a8c507055d417c9e430ce7c442190cc1bc4b68d3a540ab"}
Jul 15 16:16:16.187790 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:16.187763    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-67fct" event={"ID":"b4e0c32c-4fc8-4015-a95b-bf2aadd4554f","Type":"ContainerStarted","Data":"24cbd08e3acc7b1d10efa0a20a1ad90aab76c628b839059c5819cef58b3ccd46"}
Jul 15 16:16:16.190285 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:16.190256    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal" event={"ID":"6095f02d0d4f4a0c3d104c65bcb58cd3","Type":"ContainerStarted","Data":"6bd8182fdbb881608042424d2e3ae38f5aa809754f2a2a692393f40cf66cdb28"}
Jul 15 16:16:16.206557 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:16.206480    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-67fct" podStartSLOduration=3.629448284 podStartE2EDuration="23.206463335s" totalImagesPullingTime="19.577015051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:16.206047925 +0000 UTC m=+23.743873615" watchObservedRunningTime="2026-07-15 16:16:16.206463335 +0000 UTC m=+23.744288992"
Jul 15 16:16:16.223879 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:16.223819    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-253.ec2.internal" podStartSLOduration=23.223802656 podStartE2EDuration="23.223802656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:15:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:16.222958366 +0000 UTC m=+23.760784041" watchObservedRunningTime="2026-07-15 16:16:16.223802656 +0000 UTC m=+23.761628314"
Jul 15 16:16:17.194878 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:17.194735    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2" event={"ID":"d7a3c080-f558-431e-b4f7-527663feedc0","Type":"ContainerStarted","Data":"7a83c5636ff7105889b8132090cfee48e9773a87c526a4623187419c5b8f58b8"}
Jul 15 16:16:17.198094 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:17.198073    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:16:17.198528 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:17.198501    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65" event={"ID":"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6","Type":"ContainerStarted","Data":"8fec1b53f90dac64493b80e6c41b8d8cccca5f7bb93aa3115b84873744d1a9cc"}
Jul 15 16:16:17.221486 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:17.221442    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ttn2" podStartSLOduration=2.461412961 podStartE2EDuration="24.221428608s" totalImagesPullingTime="21.760015647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:15:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:17.221169649 +0000 UTC m=+24.758995366" watchObservedRunningTime="2026-07-15 16:16:17.221428608 +0000 UTC m=+24.759254263"
Jul 15 16:16:17.972392 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:17.972187    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:17.972564 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:17.972207    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:17.972564 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:17.972473    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7zbh" podUID="d0d24e92-1685-4d42-b291-4ceebc12c881"
Jul 15 16:16:17.972564 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:17.972555    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9h4t6" podUID="bc941219-34a4-4e54-aae8-6feb420ddac5"
Jul 15 16:16:17.972697 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:17.972262    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:17.972697 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:17.972638    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht28p" podUID="e68bcad1-c436-4799-89f3-72d611f5716d"
Jul 15 16:16:19.422204 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:19.422178    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-th64x"
Jul 15 16:16:19.422845 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:19.422829    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-th64x"
Jul 15 16:16:19.971835 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:19.971659    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:19.971970 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:19.971664    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:19.971970 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:19.971897    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7zbh" podUID="d0d24e92-1685-4d42-b291-4ceebc12c881"
Jul 15 16:16:19.972042 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:19.971995    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht28p" podUID="e68bcad1-c436-4799-89f3-72d611f5716d"
Jul 15 16:16:19.972042 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:19.971665    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:19.972128 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:19.972109    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9h4t6" podUID="bc941219-34a4-4e54-aae8-6feb420ddac5"
Jul 15 16:16:20.207165 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:20.207137    2582 generic.go:356] "Generic (PLEG): container finished" podID="a0d9fd90-7de4-4f7e-bffc-f17eed184e8c" containerID="48a088dfc36c29e25b84bcf932b4e1178cd4b7a03a6c5bc854b16e6072bde1d5" exitCode=0
Jul 15 16:16:20.207322 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:20.207224    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tp94d" event={"ID":"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c","Type":"ContainerDied","Data":"48a088dfc36c29e25b84bcf932b4e1178cd4b7a03a6c5bc854b16e6072bde1d5"}
Jul 15 16:16:20.210679 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:20.210664    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:16:20.211048 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:20.211029    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65" event={"ID":"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6","Type":"ContainerStarted","Data":"77eb6ecd225fe6530661199b0fee192a861d0b5b1312d44b586e4500eca99574"}
Jul 15 16:16:20.211245 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:20.211227    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-th64x"
Jul 15 16:16:20.211439 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:20.211424    2582 scope.go:117] "RemoveContainer" containerID="ec9be2d245ab1ef116cfcfb42befd971c5a9c2878782f3bf10d58a9f0e3c5b91"
Jul 15 16:16:20.211589 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:20.211575    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-th64x"
Jul 15 16:16:21.216797 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:21.216770    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:16:21.217381 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:21.217123    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65" event={"ID":"e83119d2-cd50-4da7-8e8c-1ecfb586cdd6","Type":"ContainerStarted","Data":"c995548a3016184307d7cfe5b92e392bd18c8c4360d7926e29216ddf0f8c4c42"}
Jul 15 16:16:21.217381 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:21.217302    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:16:21.217526 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:21.217396    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:16:21.217526 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:21.217446    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:16:21.231483 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:21.231462    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:16:21.231769 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:21.231759    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:16:21.255190 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:21.253917    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65" podStartSLOduration=8.673766317 podStartE2EDuration="28.253898147s" totalImagesPullingTime="19.58013183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:21.253008206 +0000 UTC m=+28.790833862" watchObservedRunningTime="2026-07-15 16:16:21.253898147 +0000 UTC m=+28.791723804"
Jul 15 16:16:21.365170 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:21.365148    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9h4t6"]
Jul 15 16:16:21.365313 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:21.365301    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:21.365432 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:21.365413    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9h4t6" podUID="bc941219-34a4-4e54-aae8-6feb420ddac5"
Jul 15 16:16:21.368768 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:21.368744    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z7zbh"]
Jul 15 16:16:21.368881 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:21.368840    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:21.368970 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:21.368926    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7zbh" podUID="d0d24e92-1685-4d42-b291-4ceebc12c881"
Jul 15 16:16:21.369638 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:21.369606    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ht28p"]
Jul 15 16:16:21.369775 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:21.369746    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:21.369875 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:21.369850    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht28p" podUID="e68bcad1-c436-4799-89f3-72d611f5716d"
Jul 15 16:16:22.221434 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:22.221402    2582 generic.go:356] "Generic (PLEG): container finished" podID="a0d9fd90-7de4-4f7e-bffc-f17eed184e8c" containerID="f0770c53f8aeebbe065b9e66eb4c6b2da691e9d5cbec74c599d780f19f74e5e5" exitCode=0
Jul 15 16:16:22.221795 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:22.221498    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tp94d" event={"ID":"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c","Type":"ContainerDied","Data":"f0770c53f8aeebbe065b9e66eb4c6b2da691e9d5cbec74c599d780f19f74e5e5"}
Jul 15 16:16:22.976824 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:22.976801    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:22.976939 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:22.976805    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:22.976939 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:22.976898    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9h4t6" podUID="bc941219-34a4-4e54-aae8-6feb420ddac5"
Jul 15 16:16:22.976939 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:22.976906    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:22.977090 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:22.977043    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7zbh" podUID="d0d24e92-1685-4d42-b291-4ceebc12c881"
Jul 15 16:16:22.977144 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:22.977121    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht28p" podUID="e68bcad1-c436-4799-89f3-72d611f5716d"
Jul 15 16:16:24.228466 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:24.228431    2582 generic.go:356] "Generic (PLEG): container finished" podID="a0d9fd90-7de4-4f7e-bffc-f17eed184e8c" containerID="42b545f1c9b132dd7278358d7d790577844114633ff8223a2e305aae18fae50e" exitCode=0
Jul 15 16:16:24.228821 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:24.228506    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tp94d" event={"ID":"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c","Type":"ContainerDied","Data":"42b545f1c9b132dd7278358d7d790577844114633ff8223a2e305aae18fae50e"}
Jul 15 16:16:24.972509 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:24.972249    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:24.972684 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:24.972256    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:24.972684 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:24.972600    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9h4t6" podUID="bc941219-34a4-4e54-aae8-6feb420ddac5"
Jul 15 16:16:24.972781 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:24.972318    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:24.972781 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:24.972691    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7zbh" podUID="d0d24e92-1685-4d42-b291-4ceebc12c881"
Jul 15 16:16:24.972851 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:24.972792    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht28p" podUID="e68bcad1-c436-4799-89f3-72d611f5716d"
Jul 15 16:16:25.745183 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:25.745143    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs\") pod \"network-metrics-daemon-ht28p\" (UID: \"e68bcad1-c436-4799-89f3-72d611f5716d\") " pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:25.745665 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:25.745211    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptwnx\" (UniqueName: \"kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx\") pod \"network-check-target-9h4t6\" (UID: \"bc941219-34a4-4e54-aae8-6feb420ddac5\") " pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:25.745665 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:25.745237    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret\") pod \"global-pull-secret-syncer-z7zbh\" (UID: \"d0d24e92-1685-4d42-b291-4ceebc12c881\") " pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:25.745665 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:25.745316    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:16:25.745665 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:25.745354    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:16:25.745665 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:25.745371    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:16:25.745665 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:25.745384    2582 projected.go:196] Error preparing data for projected volume kube-api-access-ptwnx for pod openshift-network-diagnostics/network-check-target-9h4t6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:16:25.745665 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:25.745401    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs podName:e68bcad1-c436-4799-89f3-72d611f5716d nodeName:}" failed. No retries permitted until 2026-07-15 16:16:57.745382027 +0000 UTC m=+65.283207675 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs") pod "network-metrics-daemon-ht28p" (UID: "e68bcad1-c436-4799-89f3-72d611f5716d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:16:25.745665 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:25.745355    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:16:25.745665 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:25.745421    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx podName:bc941219-34a4-4e54-aae8-6feb420ddac5 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:57.745410875 +0000 UTC m=+65.283236512 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptwnx" (UniqueName: "kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx") pod "network-check-target-9h4t6" (UID: "bc941219-34a4-4e54-aae8-6feb420ddac5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:16:25.745665 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:25.745441    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret podName:d0d24e92-1685-4d42-b291-4ceebc12c881 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:57.745430496 +0000 UTC m=+65.283256129 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret") pod "global-pull-secret-syncer-z7zbh" (UID: "d0d24e92-1685-4d42-b291-4ceebc12c881") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:16:26.971757 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:26.971721    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:26.972224 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:26.971721    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:26.972224 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:26.971831    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht28p" podUID="e68bcad1-c436-4799-89f3-72d611f5716d"
Jul 15 16:16:26.972224 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:26.971736    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:26.972224 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:26.971908    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9h4t6" podUID="bc941219-34a4-4e54-aae8-6feb420ddac5"
Jul 15 16:16:26.972224 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:26.972008    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z7zbh" podUID="d0d24e92-1685-4d42-b291-4ceebc12c881"
Jul 15 16:16:27.680779 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.680691    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-253.ec2.internal" event="NodeReady"
Jul 15 16:16:27.680941 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.680834    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 16:16:27.728042 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.728017    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f4dc4b479-gmdpl"]
Jul 15 16:16:27.732757 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.732735    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.737138 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.737111    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h68pr\""
Jul 15 16:16:27.737138 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.737126    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 16:16:27.737299 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.737272    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 16:16:27.737531 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.737503    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 16:16:27.746231 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.746208    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 16:16:27.752506 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.752473    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f4dc4b479-gmdpl"]
Jul 15 16:16:27.761107 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.761088    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mn7f2"]
Jul 15 16:16:27.764744 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.764727    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-b2p8p"]
Jul 15 16:16:27.764865 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.764849    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:27.768028 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.768012    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b2p8p"
Jul 15 16:16:27.769205 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.769185    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 16:16:27.769297 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.769185    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vkb7c\""
Jul 15 16:16:27.769297 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.769212    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 16:16:27.771737 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.771720    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 16:16:27.771840 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.771785    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7vwjh\""
Jul 15 16:16:27.772683 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.772668    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 16:16:27.773469 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.773448    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 16:16:27.789115 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.789094    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mn7f2"]
Jul 15 16:16:27.789789 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.789769    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b2p8p"]
Jul 15 16:16:27.858878 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.858851    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls\") pod \"dns-default-mn7f2\" (UID: \"ede18ab8-3e09-4aa9-ba0a-67fee4797267\") " pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:27.859002 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.858887    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.859002 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.858909    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d9072a46-a152-48d0-91bb-6625737e00bb-ca-trust-extracted\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.859002 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.858948    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ede18ab8-3e09-4aa9-ba0a-67fee4797267-config-volume\") pod \"dns-default-mn7f2\" (UID: \"ede18ab8-3e09-4aa9-ba0a-67fee4797267\") " pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:27.859002 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.858998    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ede18ab8-3e09-4aa9-ba0a-67fee4797267-tmp-dir\") pod \"dns-default-mn7f2\" (UID: \"ede18ab8-3e09-4aa9-ba0a-67fee4797267\") " pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:27.859178 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.859059    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d9072a46-a152-48d0-91bb-6625737e00bb-image-registry-private-configuration\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.859178 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.859123    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9072a46-a152-48d0-91bb-6625737e00bb-trusted-ca\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.859178 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.859153    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ls6c\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-kube-api-access-7ls6c\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.859298 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.859191    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-bound-sa-token\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.859298 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.859235    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d9072a46-a152-48d0-91bb-6625737e00bb-installation-pull-secrets\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.859298 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.859254    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz9dt\" (UniqueName: \"kubernetes.io/projected/ede18ab8-3e09-4aa9-ba0a-67fee4797267-kube-api-access-fz9dt\") pod \"dns-default-mn7f2\" (UID: \"ede18ab8-3e09-4aa9-ba0a-67fee4797267\") " pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:27.859298 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.859275    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1817aeb5-1f49-4a69-ba0d-75ca3f98fc07-cert\") pod \"ingress-canary-b2p8p\" (UID: \"1817aeb5-1f49-4a69-ba0d-75ca3f98fc07\") " pod="openshift-ingress-canary/ingress-canary-b2p8p"
Jul 15 16:16:27.859490 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.859310    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d9072a46-a152-48d0-91bb-6625737e00bb-registry-certificates\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.859490 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.859331    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgfsm\" (UniqueName: \"kubernetes.io/projected/1817aeb5-1f49-4a69-ba0d-75ca3f98fc07-kube-api-access-tgfsm\") pod \"ingress-canary-b2p8p\" (UID: \"1817aeb5-1f49-4a69-ba0d-75ca3f98fc07\") " pod="openshift-ingress-canary/ingress-canary-b2p8p"
Jul 15 16:16:27.960284 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.960255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgfsm\" (UniqueName: \"kubernetes.io/projected/1817aeb5-1f49-4a69-ba0d-75ca3f98fc07-kube-api-access-tgfsm\") pod \"ingress-canary-b2p8p\" (UID: \"1817aeb5-1f49-4a69-ba0d-75ca3f98fc07\") " pod="openshift-ingress-canary/ingress-canary-b2p8p"
Jul 15 16:16:27.960442 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.960313    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls\") pod \"dns-default-mn7f2\" (UID: \"ede18ab8-3e09-4aa9-ba0a-67fee4797267\") " pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:27.960442 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.960358    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.960442 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.960381    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d9072a46-a152-48d0-91bb-6625737e00bb-ca-trust-extracted\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.960442 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.960404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ede18ab8-3e09-4aa9-ba0a-67fee4797267-config-volume\") pod \"dns-default-mn7f2\" (UID: \"ede18ab8-3e09-4aa9-ba0a-67fee4797267\") " pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:27.960442 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.960424    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ede18ab8-3e09-4aa9-ba0a-67fee4797267-tmp-dir\") pod \"dns-default-mn7f2\" (UID: \"ede18ab8-3e09-4aa9-ba0a-67fee4797267\") " pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:27.960691 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.960451    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d9072a46-a152-48d0-91bb-6625737e00bb-image-registry-private-configuration\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.960691 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:27.960513    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:16:27.960691 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:27.960534    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f4dc4b479-gmdpl: secret "image-registry-tls" not found
Jul 15 16:16:27.960691 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:27.960546    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:16:27.960691 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:27.960594    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls podName:d9072a46-a152-48d0-91bb-6625737e00bb nodeName:}" failed. No retries permitted until 2026-07-15 16:16:28.460573203 +0000 UTC m=+35.998398838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls") pod "image-registry-7f4dc4b479-gmdpl" (UID: "d9072a46-a152-48d0-91bb-6625737e00bb") : secret "image-registry-tls" not found
Jul 15 16:16:27.960691 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:27.960613    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls podName:ede18ab8-3e09-4aa9-ba0a-67fee4797267 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:28.46060422 +0000 UTC m=+35.998429860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls") pod "dns-default-mn7f2" (UID: "ede18ab8-3e09-4aa9-ba0a-67fee4797267") : secret "dns-default-metrics-tls" not found
Jul 15 16:16:27.960691 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.960615    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9072a46-a152-48d0-91bb-6625737e00bb-trusted-ca\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.960691 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.960654    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ls6c\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-kube-api-access-7ls6c\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.960691 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.960685    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-bound-sa-token\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.961050 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.960727    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d9072a46-a152-48d0-91bb-6625737e00bb-installation-pull-secrets\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.961050 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.960756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz9dt\" (UniqueName: \"kubernetes.io/projected/ede18ab8-3e09-4aa9-ba0a-67fee4797267-kube-api-access-fz9dt\") pod \"dns-default-mn7f2\" (UID: \"ede18ab8-3e09-4aa9-ba0a-67fee4797267\") " pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:27.961050 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.960780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1817aeb5-1f49-4a69-ba0d-75ca3f98fc07-cert\") pod \"ingress-canary-b2p8p\" (UID: \"1817aeb5-1f49-4a69-ba0d-75ca3f98fc07\") " pod="openshift-ingress-canary/ingress-canary-b2p8p"
Jul 15 16:16:27.961050 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.960819    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d9072a46-a152-48d0-91bb-6625737e00bb-registry-certificates\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.961050 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.960872    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d9072a46-a152-48d0-91bb-6625737e00bb-ca-trust-extracted\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.961050 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.960908    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ede18ab8-3e09-4aa9-ba0a-67fee4797267-tmp-dir\") pod \"dns-default-mn7f2\" (UID: \"ede18ab8-3e09-4aa9-ba0a-67fee4797267\") " pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:27.961327 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.961102    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ede18ab8-3e09-4aa9-ba0a-67fee4797267-config-volume\") pod \"dns-default-mn7f2\" (UID: \"ede18ab8-3e09-4aa9-ba0a-67fee4797267\") " pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:27.961400 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.961357    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d9072a46-a152-48d0-91bb-6625737e00bb-registry-certificates\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.961627 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.961581    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9072a46-a152-48d0-91bb-6625737e00bb-trusted-ca\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.965048 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.965024    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d9072a46-a152-48d0-91bb-6625737e00bb-installation-pull-secrets\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.965048 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.965041    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1817aeb5-1f49-4a69-ba0d-75ca3f98fc07-cert\") pod \"ingress-canary-b2p8p\" (UID: \"1817aeb5-1f49-4a69-ba0d-75ca3f98fc07\") " pod="openshift-ingress-canary/ingress-canary-b2p8p"
Jul 15 16:16:27.965048 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.965043    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d9072a46-a152-48d0-91bb-6625737e00bb-image-registry-private-configuration\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.976488 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.976452    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgfsm\" (UniqueName: \"kubernetes.io/projected/1817aeb5-1f49-4a69-ba0d-75ca3f98fc07-kube-api-access-tgfsm\") pod \"ingress-canary-b2p8p\" (UID: \"1817aeb5-1f49-4a69-ba0d-75ca3f98fc07\") " pod="openshift-ingress-canary/ingress-canary-b2p8p"
Jul 15 16:16:27.976990 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.976894    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz9dt\" (UniqueName: \"kubernetes.io/projected/ede18ab8-3e09-4aa9-ba0a-67fee4797267-kube-api-access-fz9dt\") pod \"dns-default-mn7f2\" (UID: \"ede18ab8-3e09-4aa9-ba0a-67fee4797267\") " pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:27.977071 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.977007    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-bound-sa-token\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:27.977571 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:27.977554    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ls6c\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-kube-api-access-7ls6c\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:28.079887 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:28.079853    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b2p8p"
Jul 15 16:16:28.231037 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:28.230886    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b2p8p"]
Jul 15 16:16:28.234441 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:16:28.234418    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1817aeb5_1f49_4a69_ba0d_75ca3f98fc07.slice/crio-0fa3d78fe6fda5282dd0f8ec8c0c3e5abb4dad9b9938a43d3faec981c9827317 WatchSource:0}: Error finding container 0fa3d78fe6fda5282dd0f8ec8c0c3e5abb4dad9b9938a43d3faec981c9827317: Status 404 returned error can't find the container with id 0fa3d78fe6fda5282dd0f8ec8c0c3e5abb4dad9b9938a43d3faec981c9827317
Jul 15 16:16:28.238016 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:28.237988    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b2p8p" event={"ID":"1817aeb5-1f49-4a69-ba0d-75ca3f98fc07","Type":"ContainerStarted","Data":"0fa3d78fe6fda5282dd0f8ec8c0c3e5abb4dad9b9938a43d3faec981c9827317"}
Jul 15 16:16:28.464262 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:28.464235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls\") pod \"dns-default-mn7f2\" (UID: \"ede18ab8-3e09-4aa9-ba0a-67fee4797267\") " pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:28.464407 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:28.464269    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:28.464407 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:28.464373    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:16:28.464407 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:28.464383    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f4dc4b479-gmdpl: secret "image-registry-tls" not found
Jul 15 16:16:28.464549 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:28.464433    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls podName:d9072a46-a152-48d0-91bb-6625737e00bb nodeName:}" failed. No retries permitted until 2026-07-15 16:16:29.464419713 +0000 UTC m=+37.002245347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls") pod "image-registry-7f4dc4b479-gmdpl" (UID: "d9072a46-a152-48d0-91bb-6625737e00bb") : secret "image-registry-tls" not found
Jul 15 16:16:28.464549 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:28.464430    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:16:28.464549 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:28.464495    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls podName:ede18ab8-3e09-4aa9-ba0a-67fee4797267 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:29.464476611 +0000 UTC m=+37.002302260 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls") pod "dns-default-mn7f2" (UID: "ede18ab8-3e09-4aa9-ba0a-67fee4797267") : secret "dns-default-metrics-tls" not found
Jul 15 16:16:28.975029 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:28.975003    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:28.975180 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:28.975004    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:28.975238 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:28.975004    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:28.979233 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:28.979208    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 16:16:28.979233 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:28.979224    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 16:16:28.979874 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:28.979262    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wsr6k\""
Jul 15 16:16:28.979874 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:28.979269    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 16:16:28.979874 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:28.979211    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 16:16:28.979874 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:28.979402    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dmv8w\""
Jul 15 16:16:29.243546 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:29.243462    2582 generic.go:356] "Generic (PLEG): container finished" podID="a0d9fd90-7de4-4f7e-bffc-f17eed184e8c" containerID="ba2e840828cad8623acc68b2aa74c7882761dd40717c4c1adb07d51b0a2dfbd7" exitCode=0
Jul 15 16:16:29.243546 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:29.243503    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tp94d" event={"ID":"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c","Type":"ContainerDied","Data":"ba2e840828cad8623acc68b2aa74c7882761dd40717c4c1adb07d51b0a2dfbd7"}
Jul 15 16:16:29.472882 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:29.472844    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls\") pod \"dns-default-mn7f2\" (UID: \"ede18ab8-3e09-4aa9-ba0a-67fee4797267\") " pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:29.472882 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:29.472883    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:29.473054 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:29.473013    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:16:29.473054 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:29.473015    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:16:29.473112 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:29.473086    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls podName:ede18ab8-3e09-4aa9-ba0a-67fee4797267 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:31.473066025 +0000 UTC m=+39.010891672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls") pod "dns-default-mn7f2" (UID: "ede18ab8-3e09-4aa9-ba0a-67fee4797267") : secret "dns-default-metrics-tls" not found
Jul 15 16:16:29.473112 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:29.473026    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f4dc4b479-gmdpl: secret "image-registry-tls" not found
Jul 15 16:16:29.473175 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:29.473144    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls podName:d9072a46-a152-48d0-91bb-6625737e00bb nodeName:}" failed. No retries permitted until 2026-07-15 16:16:31.473132728 +0000 UTC m=+39.010958362 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls") pod "image-registry-7f4dc4b479-gmdpl" (UID: "d9072a46-a152-48d0-91bb-6625737e00bb") : secret "image-registry-tls" not found
Jul 15 16:16:30.249923 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:30.249886    2582 generic.go:356] "Generic (PLEG): container finished" podID="a0d9fd90-7de4-4f7e-bffc-f17eed184e8c" containerID="3161576f285dece0e4b9175b9aeff537e09f5a7d0a7e2849622b26ce9ce9d5d5" exitCode=0
Jul 15 16:16:30.250374 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:30.249943    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tp94d" event={"ID":"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c","Type":"ContainerDied","Data":"3161576f285dece0e4b9175b9aeff537e09f5a7d0a7e2849622b26ce9ce9d5d5"}
Jul 15 16:16:31.255751 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:31.255666    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tp94d" event={"ID":"a0d9fd90-7de4-4f7e-bffc-f17eed184e8c","Type":"ContainerStarted","Data":"3fbaea237d35c4a68537332094377c94e5b41cbf07c8f85eda4a0d61fb16bbc1"}
Jul 15 16:16:31.257027 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:31.257001    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b2p8p" event={"ID":"1817aeb5-1f49-4a69-ba0d-75ca3f98fc07","Type":"ContainerStarted","Data":"7a22e7f6370588292f453db0f6ceb79499b1fa7e91b4149e28cfceadf78762be"}
Jul 15 16:16:31.309086 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:31.309042    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-b2p8p" podStartSLOduration=1.664562348 podStartE2EDuration="4.309026403s" totalImagesPullingTime="2.644464055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:31.308665224 +0000 UTC m=+38.846490903" watchObservedRunningTime="2026-07-15 16:16:31.309026403 +0000 UTC m=+38.846852036"
Jul 15 16:16:31.309441 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:31.309417    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tp94d" podStartSLOduration=8.427857954 podStartE2EDuration="38.309407803s" totalImagesPullingTime="29.881549849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:15:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:31.288794996 +0000 UTC m=+38.826620675" watchObservedRunningTime="2026-07-15 16:16:31.309407803 +0000 UTC m=+38.847233459"
Jul 15 16:16:31.447639 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:31.447605    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:31.487384 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:31.487361    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls\") pod \"dns-default-mn7f2\" (UID: \"ede18ab8-3e09-4aa9-ba0a-67fee4797267\") " pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:31.487489 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:31.487393    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:31.487545 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:31.487502    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:16:31.487545 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:31.487528    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:16:31.487545 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:31.487541    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f4dc4b479-gmdpl: secret "image-registry-tls" not found
Jul 15 16:16:31.487643 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:31.487560    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls podName:ede18ab8-3e09-4aa9-ba0a-67fee4797267 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:35.487543695 +0000 UTC m=+43.025369346 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls") pod "dns-default-mn7f2" (UID: "ede18ab8-3e09-4aa9-ba0a-67fee4797267") : secret "dns-default-metrics-tls" not found
Jul 15 16:16:31.487643 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:31.487586    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls podName:d9072a46-a152-48d0-91bb-6625737e00bb nodeName:}" failed. No retries permitted until 2026-07-15 16:16:35.487575582 +0000 UTC m=+43.025401216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls") pod "image-registry-7f4dc4b479-gmdpl" (UID: "d9072a46-a152-48d0-91bb-6625737e00bb") : secret "image-registry-tls" not found
Jul 15 16:16:31.541815 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:31.541746    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:31.664256 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:31.664096    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:31.765057 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:31.765023    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:34.045005 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:34.044967    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:34.146451 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:34.146425    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:35.516608 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:35.516575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls\") pod \"dns-default-mn7f2\" (UID: \"ede18ab8-3e09-4aa9-ba0a-67fee4797267\") " pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:35.516608 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:35.516612    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:35.517083 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:35.516736    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:16:35.517083 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:35.516753    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:16:35.517083 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:35.516764    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f4dc4b479-gmdpl: secret "image-registry-tls" not found
Jul 15 16:16:35.517083 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:35.516804    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls podName:ede18ab8-3e09-4aa9-ba0a-67fee4797267 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:43.516784463 +0000 UTC m=+51.054610111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls") pod "dns-default-mn7f2" (UID: "ede18ab8-3e09-4aa9-ba0a-67fee4797267") : secret "dns-default-metrics-tls" not found
Jul 15 16:16:35.517083 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:35.516817    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls podName:d9072a46-a152-48d0-91bb-6625737e00bb nodeName:}" failed. No retries permitted until 2026-07-15 16:16:43.51681173 +0000 UTC m=+51.054637364 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls") pod "image-registry-7f4dc4b479-gmdpl" (UID: "d9072a46-a152-48d0-91bb-6625737e00bb") : secret "image-registry-tls" not found
Jul 15 16:16:38.514685 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:38.514655    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:38.855687 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:38.855608    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:39.182206 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:39.182122    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:39.422517 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:39.422472    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:40.633533 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:40.633497    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:40.924426 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:40.924360    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:41.150075 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:41.150041    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:41.290759 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:41.290720    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:42.134986 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.134956    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lfhhc"]
Jul 15 16:16:42.178804 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.178780    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lfhhc"]
Jul 15 16:16:42.178935 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.178865    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lfhhc"
Jul 15 16:16:42.185483 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.185466    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 15 16:16:42.185582 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.185557    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 15 16:16:42.186724 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.186707    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gnlvm\""
Jul 15 16:16:42.187481 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.187464    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj"]
Jul 15 16:16:42.208410 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.208386    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj"
Jul 15 16:16:42.218445 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.218416    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 15 16:16:42.218573 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.218511    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 15 16:16:42.218690 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.218666    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6tgtc\""
Jul 15 16:16:42.219374 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.219357    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 15 16:16:42.219482 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.219360    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj"]
Jul 15 16:16:42.260191 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.260165    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftmzq\" (UniqueName: \"kubernetes.io/projected/e383ad65-70b7-4c08-9609-27d0e18f89af-kube-api-access-ftmzq\") pod \"cluster-samples-operator-65db858894-5zmpj\" (UID: \"e383ad65-70b7-4c08-9609-27d0e18f89af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj"
Jul 15 16:16:42.260309 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.260206    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g72c8\" (UniqueName: \"kubernetes.io/projected/4c0749fd-050f-4f8e-825d-4b87cadc2d15-kube-api-access-g72c8\") pod \"volume-data-source-validator-78495597f6-lfhhc\" (UID: \"4c0749fd-050f-4f8e-825d-4b87cadc2d15\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lfhhc"
Jul 15 16:16:42.260309 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.260296    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e383ad65-70b7-4c08-9609-27d0e18f89af-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5zmpj\" (UID: \"e383ad65-70b7-4c08-9609-27d0e18f89af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj"
Jul 15 16:16:42.269092 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.269062    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"]
Jul 15 16:16:42.294280 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.294204    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-7cwq7"]
Jul 15 16:16:42.294380 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.294265    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"
Jul 15 16:16:42.298726 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.298709    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 15 16:16:42.299865 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.299774    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 16:16:42.301158 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.301141    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 16:16:42.301259 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.301218    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fbhtp\""
Jul 15 16:16:42.301389 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.301322    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 15 16:16:42.314419 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.314403    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-l9sbq"]
Jul 15 16:16:42.314493 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.314487    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.322581 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.322566    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 15 16:16:42.322581 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.322576    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 16:16:42.322723 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.322576    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 16:16:42.326402 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.326388    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 15 16:16:42.327437 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.327425    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-nxbkj\""
Jul 15 16:16:42.338508 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.338488    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"]
Jul 15 16:16:42.338586 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.338518    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-7cwq7"]
Jul 15 16:16:42.338586 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.338532    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-l9sbq"]
Jul 15 16:16:42.338661 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.338586    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:16:42.347100 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.347078    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 15 16:16:42.347194 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.347178    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xpdnk\""
Jul 15 16:16:42.347487 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.347473    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 15 16:16:42.347566 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.347497    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 15 16:16:42.355207 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.355181    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5fd46db8-vfcwl"]
Jul 15 16:16:42.360787 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.360769    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q9jb\" (UniqueName: \"kubernetes.io/projected/15477e9c-792a-45bf-98c1-ff1bc1378da7-kube-api-access-2q9jb\") pod \"insights-operator-68d9dd94cf-7cwq7\" (UID: \"15477e9c-792a-45bf-98c1-ff1bc1378da7\") " pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.360862 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.360802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvmb5\" (UniqueName: \"kubernetes.io/projected/a65995fc-4690-4f8a-8cb6-222b26a0e514-kube-api-access-nvmb5\") pod \"console-operator-7866497494-l9sbq\" (UID: \"a65995fc-4690-4f8a-8cb6-222b26a0e514\") " pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:16:42.360862 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.360826    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g72c8\" (UniqueName: \"kubernetes.io/projected/4c0749fd-050f-4f8e-825d-4b87cadc2d15-kube-api-access-g72c8\") pod \"volume-data-source-validator-78495597f6-lfhhc\" (UID: \"4c0749fd-050f-4f8e-825d-4b87cadc2d15\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lfhhc"
Jul 15 16:16:42.360862 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.360843    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15477e9c-792a-45bf-98c1-ff1bc1378da7-serving-cert\") pod \"insights-operator-68d9dd94cf-7cwq7\" (UID: \"15477e9c-792a-45bf-98c1-ff1bc1378da7\") " pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.360978 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.360890    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15477e9c-792a-45bf-98c1-ff1bc1378da7-tmp\") pod \"insights-operator-68d9dd94cf-7cwq7\" (UID: \"15477e9c-792a-45bf-98c1-ff1bc1378da7\") " pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.360978 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.360916    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jfkg2\" (UID: \"3d43b990-0b96-40f5-a957-94e8914b0f81\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"
Jul 15 16:16:42.360978 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.360936    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv5l2\" (UniqueName: \"kubernetes.io/projected/3d43b990-0b96-40f5-a957-94e8914b0f81-kube-api-access-nv5l2\") pod \"cluster-monitoring-operator-5f7f494dd4-jfkg2\" (UID: \"3d43b990-0b96-40f5-a957-94e8914b0f81\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"
Jul 15 16:16:42.360978 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.360959    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a65995fc-4690-4f8a-8cb6-222b26a0e514-serving-cert\") pod \"console-operator-7866497494-l9sbq\" (UID: \"a65995fc-4690-4f8a-8cb6-222b26a0e514\") " pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:16:42.361109 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.360980    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a65995fc-4690-4f8a-8cb6-222b26a0e514-config\") pod \"console-operator-7866497494-l9sbq\" (UID: \"a65995fc-4690-4f8a-8cb6-222b26a0e514\") " pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:16:42.361109 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.361013    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15477e9c-792a-45bf-98c1-ff1bc1378da7-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-7cwq7\" (UID: \"15477e9c-792a-45bf-98c1-ff1bc1378da7\") " pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.361109 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.361043    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftmzq\" (UniqueName: \"kubernetes.io/projected/e383ad65-70b7-4c08-9609-27d0e18f89af-kube-api-access-ftmzq\") pod \"cluster-samples-operator-65db858894-5zmpj\" (UID: \"e383ad65-70b7-4c08-9609-27d0e18f89af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj"
Jul 15 16:16:42.361109 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.361063    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/15477e9c-792a-45bf-98c1-ff1bc1378da7-snapshots\") pod \"insights-operator-68d9dd94cf-7cwq7\" (UID: \"15477e9c-792a-45bf-98c1-ff1bc1378da7\") " pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.361259 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.361200    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e383ad65-70b7-4c08-9609-27d0e18f89af-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5zmpj\" (UID: \"e383ad65-70b7-4c08-9609-27d0e18f89af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj"
Jul 15 16:16:42.361259 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.361219    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3d43b990-0b96-40f5-a957-94e8914b0f81-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-jfkg2\" (UID: \"3d43b990-0b96-40f5-a957-94e8914b0f81\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"
Jul 15 16:16:42.361596 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:42.361577    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 16:16:42.361661 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:42.361651    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e383ad65-70b7-4c08-9609-27d0e18f89af-samples-operator-tls podName:e383ad65-70b7-4c08-9609-27d0e18f89af nodeName:}" failed. No retries permitted until 2026-07-15 16:16:42.861626402 +0000 UTC m=+50.399452037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e383ad65-70b7-4c08-9609-27d0e18f89af-samples-operator-tls") pod "cluster-samples-operator-65db858894-5zmpj" (UID: "e383ad65-70b7-4c08-9609-27d0e18f89af") : secret "samples-operator-tls" not found
Jul 15 16:16:42.361723 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.361251    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a65995fc-4690-4f8a-8cb6-222b26a0e514-trusted-ca\") pod \"console-operator-7866497494-l9sbq\" (UID: \"a65995fc-4690-4f8a-8cb6-222b26a0e514\") " pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:16:42.361772 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.361733    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15477e9c-792a-45bf-98c1-ff1bc1378da7-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-7cwq7\" (UID: \"15477e9c-792a-45bf-98c1-ff1bc1378da7\") " pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.375508 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.375485    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-lgdvx"]
Jul 15 16:16:42.375605 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.375592    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:42.389662 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.389591    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 15 16:16:42.399674 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.399658    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92"]
Jul 15 16:16:42.399809 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.399768    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-lgdvx"
Jul 15 16:16:42.399954 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.399931    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rnbld\""
Jul 15 16:16:42.400267 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.400247    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 15 16:16:42.400402 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.400319    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 15 16:16:42.400402 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.400277    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 15 16:16:42.400402 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.400388    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 16:16:42.400631 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.400576    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 15 16:16:42.400631 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.400622    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 16:16:42.400857 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.400686    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 15 16:16:42.401057 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.401039    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 15 16:16:42.403886 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.403862    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g72c8\" (UniqueName: \"kubernetes.io/projected/4c0749fd-050f-4f8e-825d-4b87cadc2d15-kube-api-access-g72c8\") pod \"volume-data-source-validator-78495597f6-lfhhc\" (UID: \"4c0749fd-050f-4f8e-825d-4b87cadc2d15\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lfhhc"
Jul 15 16:16:42.404003 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.403985    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftmzq\" (UniqueName: \"kubernetes.io/projected/e383ad65-70b7-4c08-9609-27d0e18f89af-kube-api-access-ftmzq\") pod \"cluster-samples-operator-65db858894-5zmpj\" (UID: \"e383ad65-70b7-4c08-9609-27d0e18f89af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj"
Jul 15 16:16:42.405441 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.405424    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lpm7w\""
Jul 15 16:16:42.417733 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.417713    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5fd46db8-vfcwl"]
Jul 15 16:16:42.417829 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.417782    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92"
Jul 15 16:16:42.424755 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.424739    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 15 16:16:42.424859 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.424754    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 15 16:16:42.424859 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.424803    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-f6kbh\""
Jul 15 16:16:42.424962 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.424883    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 15 16:16:42.425016 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.424970    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 15 16:16:42.432489 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.432468    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92"]
Jul 15 16:16:42.433140 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.433124    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-lgdvx"]
Jul 15 16:16:42.443891 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.443872    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf"]
Jul 15 16:16:42.462331 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.462312    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-default-certificate\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:42.462445 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.462370    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h7rc\" (UniqueName: \"kubernetes.io/projected/f230065a-93e1-408e-9062-6fab8596a024-kube-api-access-6h7rc\") pod \"service-ca-operator-7695fc6c8c-b6p92\" (UID: \"f230065a-93e1-408e-9062-6fab8596a024\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92"
Jul 15 16:16:42.462445 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.462415    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f230065a-93e1-408e-9062-6fab8596a024-config\") pod \"service-ca-operator-7695fc6c8c-b6p92\" (UID: \"f230065a-93e1-408e-9062-6fab8596a024\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92"
Jul 15 16:16:42.462532 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.462444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8sn6\" (UniqueName: \"kubernetes.io/projected/5495bbba-699a-4fdf-a7f9-738dc92b0225-kube-api-access-b8sn6\") pod \"network-check-source-869dcfcdcd-lgdvx\" (UID: \"5495bbba-699a-4fdf-a7f9-738dc92b0225\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-lgdvx"
Jul 15 16:16:42.462532 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.462515    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3d43b990-0b96-40f5-a957-94e8914b0f81-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-jfkg2\" (UID: \"3d43b990-0b96-40f5-a957-94e8914b0f81\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"
Jul 15 16:16:42.462598 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.462539    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a65995fc-4690-4f8a-8cb6-222b26a0e514-trusted-ca\") pod \"console-operator-7866497494-l9sbq\" (UID: \"a65995fc-4690-4f8a-8cb6-222b26a0e514\") " pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:16:42.462598 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.462559    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15477e9c-792a-45bf-98c1-ff1bc1378da7-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-7cwq7\" (UID: \"15477e9c-792a-45bf-98c1-ff1bc1378da7\") " pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.462598 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.462577    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q9jb\" (UniqueName: \"kubernetes.io/projected/15477e9c-792a-45bf-98c1-ff1bc1378da7-kube-api-access-2q9jb\") pod \"insights-operator-68d9dd94cf-7cwq7\" (UID: \"15477e9c-792a-45bf-98c1-ff1bc1378da7\") " pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.462735 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.462604    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fhnq\" (UniqueName: \"kubernetes.io/projected/0043fb1f-b142-46de-9dee-9e7f1c5dc853-kube-api-access-7fhnq\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:42.462735 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.462633    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvmb5\" (UniqueName: \"kubernetes.io/projected/a65995fc-4690-4f8a-8cb6-222b26a0e514-kube-api-access-nvmb5\") pod \"console-operator-7866497494-l9sbq\" (UID: \"a65995fc-4690-4f8a-8cb6-222b26a0e514\") " pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:16:42.462934 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.462904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15477e9c-792a-45bf-98c1-ff1bc1378da7-serving-cert\") pod \"insights-operator-68d9dd94cf-7cwq7\" (UID: \"15477e9c-792a-45bf-98c1-ff1bc1378da7\") " pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.463045 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.462958    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15477e9c-792a-45bf-98c1-ff1bc1378da7-tmp\") pod \"insights-operator-68d9dd94cf-7cwq7\" (UID: \"15477e9c-792a-45bf-98c1-ff1bc1378da7\") " pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.463045 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.462993    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jfkg2\" (UID: \"3d43b990-0b96-40f5-a957-94e8914b0f81\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"
Jul 15 16:16:42.463045 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.463018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv5l2\" (UniqueName: \"kubernetes.io/projected/3d43b990-0b96-40f5-a957-94e8914b0f81-kube-api-access-nv5l2\") pod \"cluster-monitoring-operator-5f7f494dd4-jfkg2\" (UID: \"3d43b990-0b96-40f5-a957-94e8914b0f81\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"
Jul 15 16:16:42.463195 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.463052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a65995fc-4690-4f8a-8cb6-222b26a0e514-serving-cert\") pod \"console-operator-7866497494-l9sbq\" (UID: \"a65995fc-4690-4f8a-8cb6-222b26a0e514\") " pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:16:42.463195 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.463089    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f230065a-93e1-408e-9062-6fab8596a024-serving-cert\") pod \"service-ca-operator-7695fc6c8c-b6p92\" (UID: \"f230065a-93e1-408e-9062-6fab8596a024\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92"
Jul 15 16:16:42.463195 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.463123    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:42.463195 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.463155    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a65995fc-4690-4f8a-8cb6-222b26a0e514-config\") pod \"console-operator-7866497494-l9sbq\" (UID: \"a65995fc-4690-4f8a-8cb6-222b26a0e514\") " pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:16:42.463410 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.463216    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15477e9c-792a-45bf-98c1-ff1bc1378da7-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-7cwq7\" (UID: \"15477e9c-792a-45bf-98c1-ff1bc1378da7\") " pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.463410 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.463251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/15477e9c-792a-45bf-98c1-ff1bc1378da7-snapshots\") pod \"insights-operator-68d9dd94cf-7cwq7\" (UID: \"15477e9c-792a-45bf-98c1-ff1bc1378da7\") " pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.463410 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.463284    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:42.463410 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.463324    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-stats-auth\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:42.463410 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.463399    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15477e9c-792a-45bf-98c1-ff1bc1378da7-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-7cwq7\" (UID: \"15477e9c-792a-45bf-98c1-ff1bc1378da7\") " pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.463677 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:42.463420    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 16:16:42.463677 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.463475    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15477e9c-792a-45bf-98c1-ff1bc1378da7-tmp\") pod \"insights-operator-68d9dd94cf-7cwq7\" (UID: \"15477e9c-792a-45bf-98c1-ff1bc1378da7\") " pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.463677 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:42.463494    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls podName:3d43b990-0b96-40f5-a957-94e8914b0f81 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:42.963475682 +0000 UTC m=+50.501301333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jfkg2" (UID: "3d43b990-0b96-40f5-a957-94e8914b0f81") : secret "cluster-monitoring-operator-tls" not found
Jul 15 16:16:42.463677 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.463529    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3d43b990-0b96-40f5-a957-94e8914b0f81-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-jfkg2\" (UID: \"3d43b990-0b96-40f5-a957-94e8914b0f81\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"
Jul 15 16:16:42.464036 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.463967    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/15477e9c-792a-45bf-98c1-ff1bc1378da7-snapshots\") pod \"insights-operator-68d9dd94cf-7cwq7\" (UID: \"15477e9c-792a-45bf-98c1-ff1bc1378da7\") " pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.464200 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.464179    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a65995fc-4690-4f8a-8cb6-222b26a0e514-config\") pod \"console-operator-7866497494-l9sbq\" (UID: \"a65995fc-4690-4f8a-8cb6-222b26a0e514\") " pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:16:42.464269 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.464254    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a65995fc-4690-4f8a-8cb6-222b26a0e514-trusted-ca\") pod \"console-operator-7866497494-l9sbq\" (UID: \"a65995fc-4690-4f8a-8cb6-222b26a0e514\") " pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:16:42.464922 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.464864    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15477e9c-792a-45bf-98c1-ff1bc1378da7-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-7cwq7\" (UID: \"15477e9c-792a-45bf-98c1-ff1bc1378da7\") " pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.466209 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.466185    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a65995fc-4690-4f8a-8cb6-222b26a0e514-serving-cert\") pod \"console-operator-7866497494-l9sbq\" (UID: \"a65995fc-4690-4f8a-8cb6-222b26a0e514\") " pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:16:42.466282 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.466271    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15477e9c-792a-45bf-98c1-ff1bc1378da7-serving-cert\") pod \"insights-operator-68d9dd94cf-7cwq7\" (UID: \"15477e9c-792a-45bf-98c1-ff1bc1378da7\") " pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.467915 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.467894    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf"]
Jul 15 16:16:42.467989 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.467964    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf"
Jul 15 16:16:42.471300 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.471281    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 15 16:16:42.471432 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.471305    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 15 16:16:42.471432 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.471386    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2d7rm\""
Jul 15 16:16:42.475691 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.475677    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 15 16:16:42.483878 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.483861    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvmb5\" (UniqueName: \"kubernetes.io/projected/a65995fc-4690-4f8a-8cb6-222b26a0e514-kube-api-access-nvmb5\") pod \"console-operator-7866497494-l9sbq\" (UID: \"a65995fc-4690-4f8a-8cb6-222b26a0e514\") " pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:16:42.485175 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.485154    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 15 16:16:42.485862 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.485834    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv5l2\" (UniqueName: \"kubernetes.io/projected/3d43b990-0b96-40f5-a957-94e8914b0f81-kube-api-access-nv5l2\") pod \"cluster-monitoring-operator-5f7f494dd4-jfkg2\" (UID: \"3d43b990-0b96-40f5-a957-94e8914b0f81\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"
Jul 15 16:16:42.485944 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.485934    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q9jb\" (UniqueName: \"kubernetes.io/projected/15477e9c-792a-45bf-98c1-ff1bc1378da7-kube-api-access-2q9jb\") pod \"insights-operator-68d9dd94cf-7cwq7\" (UID: \"15477e9c-792a-45bf-98c1-ff1bc1378da7\") " pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.487660 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.487644    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lfhhc"
Jul 15 16:16:42.565056 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.564525    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f230065a-93e1-408e-9062-6fab8596a024-serving-cert\") pod \"service-ca-operator-7695fc6c8c-b6p92\" (UID: \"f230065a-93e1-408e-9062-6fab8596a024\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92"
Jul 15 16:16:42.565056 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.564565    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:42.565056 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.564627    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rklql\" (UniqueName: \"kubernetes.io/projected/58b7a5fa-4cb2-4ff8-a94f-07abb5198153-kube-api-access-rklql\") pod \"kube-storage-version-migrator-operator-799cb7f958-8g4mf\" (UID: \"58b7a5fa-4cb2-4ff8-a94f-07abb5198153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf"
Jul 15 16:16:42.565056 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.564658    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:42.565056 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.564687    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58b7a5fa-4cb2-4ff8-a94f-07abb5198153-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-8g4mf\" (UID: \"58b7a5fa-4cb2-4ff8-a94f-07abb5198153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf"
Jul 15 16:16:42.565056 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.564717    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-stats-auth\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:42.565056 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:42.564748    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 16:16:42.565056 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.564786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-default-certificate\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:42.565056 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:42.564811    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs podName:0043fb1f-b142-46de-9dee-9e7f1c5dc853 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:43.064790708 +0000 UTC m=+50.602616359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs") pod "router-default-5fd46db8-vfcwl" (UID: "0043fb1f-b142-46de-9dee-9e7f1c5dc853") : secret "router-metrics-certs-default" not found
Jul 15 16:16:42.565056 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:42.564850    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle podName:0043fb1f-b142-46de-9dee-9e7f1c5dc853 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:43.064830692 +0000 UTC m=+50.602656327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle") pod "router-default-5fd46db8-vfcwl" (UID: "0043fb1f-b142-46de-9dee-9e7f1c5dc853") : configmap references non-existent config key: service-ca.crt
Jul 15 16:16:42.565056 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.564887    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h7rc\" (UniqueName: \"kubernetes.io/projected/f230065a-93e1-408e-9062-6fab8596a024-kube-api-access-6h7rc\") pod \"service-ca-operator-7695fc6c8c-b6p92\" (UID: \"f230065a-93e1-408e-9062-6fab8596a024\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92"
Jul 15 16:16:42.565056 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.564939    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f230065a-93e1-408e-9062-6fab8596a024-config\") pod \"service-ca-operator-7695fc6c8c-b6p92\" (UID: \"f230065a-93e1-408e-9062-6fab8596a024\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92"
Jul 15 16:16:42.565056 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.564977    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8sn6\" (UniqueName: \"kubernetes.io/projected/5495bbba-699a-4fdf-a7f9-738dc92b0225-kube-api-access-b8sn6\") pod \"network-check-source-869dcfcdcd-lgdvx\" (UID: \"5495bbba-699a-4fdf-a7f9-738dc92b0225\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-lgdvx"
Jul 15 16:16:42.565056 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.565047    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fhnq\" (UniqueName: \"kubernetes.io/projected/0043fb1f-b142-46de-9dee-9e7f1c5dc853-kube-api-access-7fhnq\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:42.565855 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.565114    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58b7a5fa-4cb2-4ff8-a94f-07abb5198153-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-8g4mf\" (UID: \"58b7a5fa-4cb2-4ff8-a94f-07abb5198153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf"
Jul 15 16:16:42.565855 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.565788    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f230065a-93e1-408e-9062-6fab8596a024-config\") pod \"service-ca-operator-7695fc6c8c-b6p92\" (UID: \"f230065a-93e1-408e-9062-6fab8596a024\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92"
Jul 15 16:16:42.568140 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.568114    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f230065a-93e1-408e-9062-6fab8596a024-serving-cert\") pod \"service-ca-operator-7695fc6c8c-b6p92\" (UID: \"f230065a-93e1-408e-9062-6fab8596a024\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92"
Jul 15 16:16:42.568376 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.568332    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-stats-auth\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:42.568664 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.568641    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-default-certificate\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:42.587420 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.587374    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8sn6\" (UniqueName: \"kubernetes.io/projected/5495bbba-699a-4fdf-a7f9-738dc92b0225-kube-api-access-b8sn6\") pod \"network-check-source-869dcfcdcd-lgdvx\" (UID: \"5495bbba-699a-4fdf-a7f9-738dc92b0225\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-lgdvx"
Jul 15 16:16:42.593773 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.593750    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fhnq\" (UniqueName: \"kubernetes.io/projected/0043fb1f-b142-46de-9dee-9e7f1c5dc853-kube-api-access-7fhnq\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:42.594367 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.594326    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h7rc\" (UniqueName: \"kubernetes.io/projected/f230065a-93e1-408e-9062-6fab8596a024-kube-api-access-6h7rc\") pod \"service-ca-operator-7695fc6c8c-b6p92\" (UID: \"f230065a-93e1-408e-9062-6fab8596a024\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92"
Jul 15 16:16:42.622037 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.622012    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7"
Jul 15 16:16:42.642399 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.642332    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lfhhc"]
Jul 15 16:16:42.645936 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.645918    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:16:42.664591 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:16:42.664572    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c0749fd_050f_4f8e_825d_4b87cadc2d15.slice/crio-353ee068d7a1345050410f9d5539d8930c2f5e549f3f401a2d5d58377382499c WatchSource:0}: Error finding container 353ee068d7a1345050410f9d5539d8930c2f5e549f3f401a2d5d58377382499c: Status 404 returned error can't find the container with id 353ee068d7a1345050410f9d5539d8930c2f5e549f3f401a2d5d58377382499c
Jul 15 16:16:42.665589 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.665566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58b7a5fa-4cb2-4ff8-a94f-07abb5198153-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-8g4mf\" (UID: \"58b7a5fa-4cb2-4ff8-a94f-07abb5198153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf"
Jul 15 16:16:42.665668 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.665648    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rklql\" (UniqueName: \"kubernetes.io/projected/58b7a5fa-4cb2-4ff8-a94f-07abb5198153-kube-api-access-rklql\") pod \"kube-storage-version-migrator-operator-799cb7f958-8g4mf\" (UID: \"58b7a5fa-4cb2-4ff8-a94f-07abb5198153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf"
Jul 15 16:16:42.665724 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.665690    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58b7a5fa-4cb2-4ff8-a94f-07abb5198153-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-8g4mf\" (UID: \"58b7a5fa-4cb2-4ff8-a94f-07abb5198153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf"
Jul 15 16:16:42.666265 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.666243    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58b7a5fa-4cb2-4ff8-a94f-07abb5198153-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-8g4mf\" (UID: \"58b7a5fa-4cb2-4ff8-a94f-07abb5198153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf"
Jul 15 16:16:42.667692 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.667672    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58b7a5fa-4cb2-4ff8-a94f-07abb5198153-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-8g4mf\" (UID: \"58b7a5fa-4cb2-4ff8-a94f-07abb5198153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf"
Jul 15 16:16:42.680817 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.680798    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rklql\" (UniqueName: \"kubernetes.io/projected/58b7a5fa-4cb2-4ff8-a94f-07abb5198153-kube-api-access-rklql\") pod \"kube-storage-version-migrator-operator-799cb7f958-8g4mf\" (UID: \"58b7a5fa-4cb2-4ff8-a94f-07abb5198153\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf"
Jul 15 16:16:42.723414 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.715045    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-lgdvx"
Jul 15 16:16:42.728052 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.727878    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92"
Jul 15 16:16:42.781222 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.780612    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf"
Jul 15 16:16:42.838826 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.837518    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-7cwq7"]
Jul 15 16:16:42.845949 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:16:42.845891    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15477e9c_792a_45bf_98c1_ff1bc1378da7.slice/crio-55ddbf89e394a6007865a9e9b783794a8f5548bb4cd11d568d59c07f80aaa5f3 WatchSource:0}: Error finding container 55ddbf89e394a6007865a9e9b783794a8f5548bb4cd11d568d59c07f80aaa5f3: Status 404 returned error can't find the container with id 55ddbf89e394a6007865a9e9b783794a8f5548bb4cd11d568d59c07f80aaa5f3
Jul 15 16:16:42.864243 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.864221    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:42.867398 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.867370    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e383ad65-70b7-4c08-9609-27d0e18f89af-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5zmpj\" (UID: \"e383ad65-70b7-4c08-9609-27d0e18f89af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj"
Jul 15 16:16:42.867605 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:42.867569    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 16:16:42.867687 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:42.867675    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e383ad65-70b7-4c08-9609-27d0e18f89af-samples-operator-tls podName:e383ad65-70b7-4c08-9609-27d0e18f89af nodeName:}" failed. No retries permitted until 2026-07-15 16:16:43.867639829 +0000 UTC m=+51.405465482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e383ad65-70b7-4c08-9609-27d0e18f89af-samples-operator-tls") pod "cluster-samples-operator-65db858894-5zmpj" (UID: "e383ad65-70b7-4c08-9609-27d0e18f89af") : secret "samples-operator-tls" not found
Jul 15 16:16:42.894223 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.894154    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-l9sbq"]
Jul 15 16:16:42.897793 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:16:42.897768    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda65995fc_4690_4f8a_8cb6_222b26a0e514.slice/crio-00d5090712a73096499f55bcf0b4eea553ce721b6304a89083996205aad48357 WatchSource:0}: Error finding container 00d5090712a73096499f55bcf0b4eea553ce721b6304a89083996205aad48357: Status 404 returned error can't find the container with id 00d5090712a73096499f55bcf0b4eea553ce721b6304a89083996205aad48357
Jul 15 16:16:42.931277 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.931254    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92"]
Jul 15 16:16:42.933178 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:16:42.933151    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf230065a_93e1_408e_9062_6fab8596a024.slice/crio-f63328111b30335e1b6cfe91f181626a8d3dc7b6a458108560ca729497fd8c2c WatchSource:0}: Error finding container f63328111b30335e1b6cfe91f181626a8d3dc7b6a458108560ca729497fd8c2c: Status 404 returned error can't find the container with id f63328111b30335e1b6cfe91f181626a8d3dc7b6a458108560ca729497fd8c2c
Jul 15 16:16:42.934004 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.933981    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-lgdvx"]
Jul 15 16:16:42.951586 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:16:42.951562    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5495bbba_699a_4fdf_a7f9_738dc92b0225.slice/crio-dbdf27b1f363036ee10da8ea9c4b5a252b217ce7d286c11932b488dee5410896 WatchSource:0}: Error finding container dbdf27b1f363036ee10da8ea9c4b5a252b217ce7d286c11932b488dee5410896: Status 404 returned error can't find the container with id dbdf27b1f363036ee10da8ea9c4b5a252b217ce7d286c11932b488dee5410896
Jul 15 16:16:42.968771 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.968745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jfkg2\" (UID: \"3d43b990-0b96-40f5-a957-94e8914b0f81\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"
Jul 15 16:16:42.968853 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:42.968844    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 16:16:42.968897 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:42.968884    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls podName:3d43b990-0b96-40f5-a957-94e8914b0f81 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:43.968872551 +0000 UTC m=+51.506698185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jfkg2" (UID: "3d43b990-0b96-40f5-a957-94e8914b0f81") : secret "cluster-monitoring-operator-tls" not found
Jul 15 16:16:42.990890 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:42.990868    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf"]
Jul 15 16:16:42.992788 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:16:42.992767    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b7a5fa_4cb2_4ff8_a94f_07abb5198153.slice/crio-1712cf95c4bb339e33bebe0f2a155efe7bafae19855adcd2e594d36f3f25778c WatchSource:0}: Error finding container 1712cf95c4bb339e33bebe0f2a155efe7bafae19855adcd2e594d36f3f25778c: Status 404 returned error can't find the container with id 1712cf95c4bb339e33bebe0f2a155efe7bafae19855adcd2e594d36f3f25778c
Jul 15 16:16:43.068768 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:43.068735    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:43.069090 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:43.069074    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:43.069136 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:43.069116    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:43.069223 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:43.069211    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 16:16:43.069256 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:43.069251    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle podName:0043fb1f-b142-46de-9dee-9e7f1c5dc853 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:44.069237394 +0000 UTC m=+51.607063030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle") pod "router-default-5fd46db8-vfcwl" (UID: "0043fb1f-b142-46de-9dee-9e7f1c5dc853") : configmap references non-existent config key: service-ca.crt
Jul 15 16:16:43.069295 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:43.069265    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs podName:0043fb1f-b142-46de-9dee-9e7f1c5dc853 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:44.06925921 +0000 UTC m=+51.607084844 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs") pod "router-default-5fd46db8-vfcwl" (UID: "0043fb1f-b142-46de-9dee-9e7f1c5dc853") : secret "router-metrics-certs-default" not found
Jul 15 16:16:43.285941 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:43.285913    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92" event={"ID":"f230065a-93e1-408e-9062-6fab8596a024","Type":"ContainerStarted","Data":"f63328111b30335e1b6cfe91f181626a8d3dc7b6a458108560ca729497fd8c2c"}
Jul 15 16:16:43.287034 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:43.287011    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-lgdvx" event={"ID":"5495bbba-699a-4fdf-a7f9-738dc92b0225","Type":"ContainerStarted","Data":"dbdf27b1f363036ee10da8ea9c4b5a252b217ce7d286c11932b488dee5410896"}
Jul 15 16:16:43.288047 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:43.288016    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lfhhc" event={"ID":"4c0749fd-050f-4f8e-825d-4b87cadc2d15","Type":"ContainerStarted","Data":"353ee068d7a1345050410f9d5539d8930c2f5e549f3f401a2d5d58377382499c"}
Jul 15 16:16:43.288933 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:43.288912    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf" event={"ID":"58b7a5fa-4cb2-4ff8-a94f-07abb5198153","Type":"ContainerStarted","Data":"1712cf95c4bb339e33bebe0f2a155efe7bafae19855adcd2e594d36f3f25778c"}
Jul 15 16:16:43.289892 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:43.289872    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7" event={"ID":"15477e9c-792a-45bf-98c1-ff1bc1378da7","Type":"ContainerStarted","Data":"55ddbf89e394a6007865a9e9b783794a8f5548bb4cd11d568d59c07f80aaa5f3"}
Jul 15 16:16:43.290784 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:43.290764    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-l9sbq" event={"ID":"a65995fc-4690-4f8a-8cb6-222b26a0e514","Type":"ContainerStarted","Data":"00d5090712a73096499f55bcf0b4eea553ce721b6304a89083996205aad48357"}
Jul 15 16:16:43.573831 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:43.573755    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls\") pod \"dns-default-mn7f2\" (UID: \"ede18ab8-3e09-4aa9-ba0a-67fee4797267\") " pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:43.573831 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:43.573795    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:43.574052 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:43.573913    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:16:43.574052 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:43.573960    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:16:43.574052 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:43.573974    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f4dc4b479-gmdpl: secret "image-registry-tls" not found
Jul 15 16:16:43.574052 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:43.573979    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls podName:ede18ab8-3e09-4aa9-ba0a-67fee4797267 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:59.57396077 +0000 UTC m=+67.111786405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls") pod "dns-default-mn7f2" (UID: "ede18ab8-3e09-4aa9-ba0a-67fee4797267") : secret "dns-default-metrics-tls" not found
Jul 15 16:16:43.574052 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:43.574021    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls podName:d9072a46-a152-48d0-91bb-6625737e00bb nodeName:}" failed. No retries permitted until 2026-07-15 16:16:59.57400595 +0000 UTC m=+67.111831600 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls") pod "image-registry-7f4dc4b479-gmdpl" (UID: "d9072a46-a152-48d0-91bb-6625737e00bb") : secret "image-registry-tls" not found
Jul 15 16:16:43.876986 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:43.876891    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e383ad65-70b7-4c08-9609-27d0e18f89af-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5zmpj\" (UID: \"e383ad65-70b7-4c08-9609-27d0e18f89af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj"
Jul 15 16:16:43.877189 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:43.877142    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 16:16:43.877252 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:43.877208    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e383ad65-70b7-4c08-9609-27d0e18f89af-samples-operator-tls podName:e383ad65-70b7-4c08-9609-27d0e18f89af nodeName:}" failed. No retries permitted until 2026-07-15 16:16:45.877190457 +0000 UTC m=+53.415016116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e383ad65-70b7-4c08-9609-27d0e18f89af-samples-operator-tls") pod "cluster-samples-operator-65db858894-5zmpj" (UID: "e383ad65-70b7-4c08-9609-27d0e18f89af") : secret "samples-operator-tls" not found
Jul 15 16:16:43.977546 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:43.977517    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jfkg2\" (UID: \"3d43b990-0b96-40f5-a957-94e8914b0f81\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"
Jul 15 16:16:43.977748 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:43.977715    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 16:16:43.977823 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:43.977801    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls podName:3d43b990-0b96-40f5-a957-94e8914b0f81 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:45.977779452 +0000 UTC m=+53.515605109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jfkg2" (UID: "3d43b990-0b96-40f5-a957-94e8914b0f81") : secret "cluster-monitoring-operator-tls" not found
Jul 15 16:16:44.078292 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:44.078257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:44.078461 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:44.078437    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:44.078534 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:44.078455    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle podName:0043fb1f-b142-46de-9dee-9e7f1c5dc853 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:46.078432597 +0000 UTC m=+53.616258234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle") pod "router-default-5fd46db8-vfcwl" (UID: "0043fb1f-b142-46de-9dee-9e7f1c5dc853") : configmap references non-existent config key: service-ca.crt
Jul 15 16:16:44.078534 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:44.078518    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 16:16:44.078636 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:44.078567    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs podName:0043fb1f-b142-46de-9dee-9e7f1c5dc853 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:46.078551768 +0000 UTC m=+53.616377401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs") pod "router-default-5fd46db8-vfcwl" (UID: "0043fb1f-b142-46de-9dee-9e7f1c5dc853") : secret "router-metrics-certs-default" not found
Jul 15 16:16:45.298127 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:45.298075    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lfhhc" event={"ID":"4c0749fd-050f-4f8e-825d-4b87cadc2d15","Type":"ContainerStarted","Data":"f6ad165291fc535b310da0a15f4a65c25123d1c56f081e98d59d5cda2a50e6bb"}
Jul 15 16:16:45.323964 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:45.323853    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lfhhc" podStartSLOduration=1.631023195 podStartE2EDuration="3.323833821s" totalImagesPullingTime="1.692810626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:45.323643703 +0000 UTC m=+52.861469360" watchObservedRunningTime="2026-07-15 16:16:45.323833821 +0000 UTC m=+52.861659483"
Jul 15 16:16:45.532259 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:45.532223    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:45.684262 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:45.684156    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:45.893750 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:45.893717    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e383ad65-70b7-4c08-9609-27d0e18f89af-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5zmpj\" (UID: \"e383ad65-70b7-4c08-9609-27d0e18f89af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj"
Jul 15 16:16:45.893938 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:45.893888    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 16:16:45.894006 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:45.893963    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e383ad65-70b7-4c08-9609-27d0e18f89af-samples-operator-tls podName:e383ad65-70b7-4c08-9609-27d0e18f89af nodeName:}" failed. No retries permitted until 2026-07-15 16:16:49.893941305 +0000 UTC m=+57.431766956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e383ad65-70b7-4c08-9609-27d0e18f89af-samples-operator-tls") pod "cluster-samples-operator-65db858894-5zmpj" (UID: "e383ad65-70b7-4c08-9609-27d0e18f89af") : secret "samples-operator-tls" not found
Jul 15 16:16:45.995149 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:45.995121    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jfkg2\" (UID: \"3d43b990-0b96-40f5-a957-94e8914b0f81\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"
Jul 15 16:16:45.995324 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:45.995309    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 16:16:45.995406 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:45.995398    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls podName:3d43b990-0b96-40f5-a957-94e8914b0f81 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:49.995376954 +0000 UTC m=+57.533202598 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jfkg2" (UID: "3d43b990-0b96-40f5-a957-94e8914b0f81") : secret "cluster-monitoring-operator-tls" not found
Jul 15 16:16:46.096229 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:46.096186    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:46.096388 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:46.096245    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:46.096519 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:46.096494    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle podName:0043fb1f-b142-46de-9dee-9e7f1c5dc853 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:50.096475145 +0000 UTC m=+57.634300784 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle") pod "router-default-5fd46db8-vfcwl" (UID: "0043fb1f-b142-46de-9dee-9e7f1c5dc853") : configmap references non-existent config key: service-ca.crt
Jul 15 16:16:46.096646 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:46.096614    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 16:16:46.096713 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:46.096682    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs podName:0043fb1f-b142-46de-9dee-9e7f1c5dc853 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:50.096663596 +0000 UTC m=+57.634489232 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs") pod "router-default-5fd46db8-vfcwl" (UID: "0043fb1f-b142-46de-9dee-9e7f1c5dc853") : secret "router-metrics-certs-default" not found
Jul 15 16:16:49.312376 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.312291    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/0.log"
Jul 15 16:16:49.312376 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.312356    2582 generic.go:356] "Generic (PLEG): container finished" podID="a65995fc-4690-4f8a-8cb6-222b26a0e514" containerID="d40f1dd60d293a77435adb1c69bf2c350fa8329441a429073db44549532a23ae" exitCode=255
Jul 15 16:16:49.312865 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.312449    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-l9sbq" event={"ID":"a65995fc-4690-4f8a-8cb6-222b26a0e514","Type":"ContainerDied","Data":"d40f1dd60d293a77435adb1c69bf2c350fa8329441a429073db44549532a23ae"}
Jul 15 16:16:49.312865 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.312763    2582 scope.go:117] "RemoveContainer" containerID="d40f1dd60d293a77435adb1c69bf2c350fa8329441a429073db44549532a23ae"
Jul 15 16:16:49.315050 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.315022    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92" event={"ID":"f230065a-93e1-408e-9062-6fab8596a024","Type":"ContainerStarted","Data":"936762fd6e1730efaae818dad579e8825b7b33b39173ac61a1c839aac13a8534"}
Jul 15 16:16:49.317284 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.317262    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-lgdvx" event={"ID":"5495bbba-699a-4fdf-a7f9-738dc92b0225","Type":"ContainerStarted","Data":"a5e6df8dc537a1cbaec9fe2c37d86760bbe70ba5347ef0ebdd0f47bc5fa2e013"}
Jul 15 16:16:49.320689 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.320664    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf" event={"ID":"58b7a5fa-4cb2-4ff8-a94f-07abb5198153","Type":"ContainerStarted","Data":"79aa6918e853744c129fe4df81751285f8df9f6e887286992fe0a55b76114f6c"}
Jul 15 16:16:49.322169 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.322147    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7" event={"ID":"15477e9c-792a-45bf-98c1-ff1bc1378da7","Type":"ContainerStarted","Data":"1655b10c04c974ce26c4d985bd1031621a36a147124fd563adbf79b453d07aa9"}
Jul 15 16:16:49.382258 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.382210    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf" podStartSLOduration=1.99490912 podStartE2EDuration="7.382192515s" totalImagesPullingTime="5.387283395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:49.382088409 +0000 UTC m=+56.919914094" watchObservedRunningTime="2026-07-15 16:16:49.382192515 +0000 UTC m=+56.920018173"
Jul 15 16:16:49.498226 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.498174    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7" podStartSLOduration=1.272943355 podStartE2EDuration="7.498154382s" totalImagesPullingTime="6.225211027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:49.4453263 +0000 UTC m=+56.983151959" watchObservedRunningTime="2026-07-15 16:16:49.498154382 +0000 UTC m=+57.035980044"
Jul 15 16:16:49.498572 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.498545    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-lgdvx" podStartSLOduration=2.058923535 podStartE2EDuration="7.498536812s" totalImagesPullingTime="5.439613277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:49.497314081 +0000 UTC m=+57.035139759" watchObservedRunningTime="2026-07-15 16:16:49.498536812 +0000 UTC m=+57.036362469"
Jul 15 16:16:49.539277 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.539231    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92" podStartSLOduration=2.092648404 podStartE2EDuration="7.53921464s" totalImagesPullingTime="5.446566236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:49.538785978 +0000 UTC m=+57.076611625" watchObservedRunningTime="2026-07-15 16:16:49.53921464 +0000 UTC m=+57.077040295"
Jul 15 16:16:49.865281 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.865215    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:49.926525 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.926493    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8822c"]
Jul 15 16:16:49.935233 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.935192    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e383ad65-70b7-4c08-9609-27d0e18f89af-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5zmpj\" (UID: \"e383ad65-70b7-4c08-9609-27d0e18f89af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj"
Jul 15 16:16:49.935452 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.935354    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8822c"
Jul 15 16:16:49.935452 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:49.935364    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 16:16:49.935452 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:49.935428    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e383ad65-70b7-4c08-9609-27d0e18f89af-samples-operator-tls podName:e383ad65-70b7-4c08-9609-27d0e18f89af nodeName:}" failed. No retries permitted until 2026-07-15 16:16:57.935409987 +0000 UTC m=+65.473235631 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e383ad65-70b7-4c08-9609-27d0e18f89af-samples-operator-tls") pod "cluster-samples-operator-65db858894-5zmpj" (UID: "e383ad65-70b7-4c08-9609-27d0e18f89af") : secret "samples-operator-tls" not found
Jul 15 16:16:49.939016 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.938996    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 15 16:16:49.940054 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.940036    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7jc7l\""
Jul 15 16:16:49.940615 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.940575    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 15 16:16:49.948580 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:49.948562    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8822c"]
Jul 15 16:16:50.028499 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.028471    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:50.035581 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.035560    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jfkg2\" (UID: \"3d43b990-0b96-40f5-a957-94e8914b0f81\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"
Jul 15 16:16:50.035681 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.035626    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b2jr\" (UniqueName: \"kubernetes.io/projected/a6caa983-90b5-4dbc-aead-3ccdae0b2c91-kube-api-access-7b2jr\") pod \"migrator-7f59b54f6c-8822c\" (UID: \"a6caa983-90b5-4dbc-aead-3ccdae0b2c91\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8822c"
Jul 15 16:16:50.035738 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:50.035696    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 16:16:50.035790 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:50.035750    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls podName:3d43b990-0b96-40f5-a957-94e8914b0f81 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:58.035737372 +0000 UTC m=+65.573563007 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jfkg2" (UID: "3d43b990-0b96-40f5-a957-94e8914b0f81") : secret "cluster-monitoring-operator-tls" not found
Jul 15 16:16:50.136184 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.136131    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:50.136184 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.136178    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:50.136357 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.136204    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b2jr\" (UniqueName: \"kubernetes.io/projected/a6caa983-90b5-4dbc-aead-3ccdae0b2c91-kube-api-access-7b2jr\") pod \"migrator-7f59b54f6c-8822c\" (UID: \"a6caa983-90b5-4dbc-aead-3ccdae0b2c91\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8822c"
Jul 15 16:16:50.136357 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:50.136281    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 16:16:50.136357 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:50.136316    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle podName:0043fb1f-b142-46de-9dee-9e7f1c5dc853 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:58.136298909 +0000 UTC m=+65.674124566 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle") pod "router-default-5fd46db8-vfcwl" (UID: "0043fb1f-b142-46de-9dee-9e7f1c5dc853") : configmap references non-existent config key: service-ca.crt
Jul 15 16:16:50.136517 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:50.136387    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs podName:0043fb1f-b142-46de-9dee-9e7f1c5dc853 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:58.136370802 +0000 UTC m=+65.674196449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs") pod "router-default-5fd46db8-vfcwl" (UID: "0043fb1f-b142-46de-9dee-9e7f1c5dc853") : secret "router-metrics-certs-default" not found
Jul 15 16:16:50.160869 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.160836    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:50.162716 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.162698    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b2jr\" (UniqueName: \"kubernetes.io/projected/a6caa983-90b5-4dbc-aead-3ccdae0b2c91-kube-api-access-7b2jr\") pod \"migrator-7f59b54f6c-8822c\" (UID: \"a6caa983-90b5-4dbc-aead-3ccdae0b2c91\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8822c"
Jul 15 16:16:50.246142 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.246120    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8822c"
Jul 15 16:16:50.328287 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.328258    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/1.log"
Jul 15 16:16:50.328736 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.328717    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/0.log"
Jul 15 16:16:50.328787 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.328756    2582 generic.go:356] "Generic (PLEG): container finished" podID="a65995fc-4690-4f8a-8cb6-222b26a0e514" containerID="919c946d4e833497bfdb98105dc249912b93db7399c952ad8227b424a982eab7" exitCode=255
Jul 15 16:16:50.329894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.328937    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-l9sbq" event={"ID":"a65995fc-4690-4f8a-8cb6-222b26a0e514","Type":"ContainerDied","Data":"919c946d4e833497bfdb98105dc249912b93db7399c952ad8227b424a982eab7"}
Jul 15 16:16:50.329894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.329010    2582 scope.go:117] "RemoveContainer" containerID="d40f1dd60d293a77435adb1c69bf2c350fa8329441a429073db44549532a23ae"
Jul 15 16:16:50.329894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.329381    2582 scope.go:117] "RemoveContainer" containerID="919c946d4e833497bfdb98105dc249912b93db7399c952ad8227b424a982eab7"
Jul 15 16:16:50.329894 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:50.329545    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-l9sbq_openshift-console-operator(a65995fc-4690-4f8a-8cb6-222b26a0e514)\"" pod="openshift-console-operator/console-operator-7866497494-l9sbq" podUID="a65995fc-4690-4f8a-8cb6-222b26a0e514"
Jul 15 16:16:50.430038 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.430014    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8822c"]
Jul 15 16:16:50.432236 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:16:50.432192    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6caa983_90b5_4dbc_aead_3ccdae0b2c91.slice/crio-c1326c0d73dc0750b69cd92c8d0d2d940c191f6b670b9b6e17ece5734374056d WatchSource:0}: Error finding container c1326c0d73dc0750b69cd92c8d0d2d940c191f6b670b9b6e17ece5734374056d: Status 404 returned error can't find the container with id c1326c0d73dc0750b69cd92c8d0d2d940c191f6b670b9b6e17ece5734374056d
Jul 15 16:16:50.840238 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.840207    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m59sx"]
Jul 15 16:16:50.842205 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.842152    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:50.844830 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.844808    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:50.848881 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.848842    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 16:16:50.848881 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.848873    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tw9wx\""
Jul 15 16:16:50.853251 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.853234    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 16:16:50.869552 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.869530    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m59sx"]
Jul 15 16:16:50.945561 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.945532    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d7vt\" (UniqueName: \"kubernetes.io/projected/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-api-access-5d7vt\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:50.945674 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.945623    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:50.945674 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.945656    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:50.945746 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.945682    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-data-volume\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:50.945779 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.945760    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-crio-socket\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:50.982322 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:50.982292    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:51.046751 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:51.046709    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-data-volume\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:51.046751 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:51.046755    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-crio-socket\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:51.046931 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:51.046797    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d7vt\" (UniqueName: \"kubernetes.io/projected/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-api-access-5d7vt\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:51.046931 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:51.046890    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:51.047030 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:51.046936    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:51.047081 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:51.047023    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-crio-socket\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:51.047081 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:51.047031    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 16:16:51.047081 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:51.047036    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-data-volume\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:51.047227 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:51.047107    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-rbac-proxy-cm podName:fabfebcc-b85e-4f6e-a103-a27175aa1fd2 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:51.547085812 +0000 UTC m=+59.084911465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m59sx" (UID: "fabfebcc-b85e-4f6e-a103-a27175aa1fd2") : configmap "kube-rbac-proxy" not found
Jul 15 16:16:51.047227 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:51.047041    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 16:16:51.047227 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:51.047161    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-insights-runtime-extractor-tls podName:fabfebcc-b85e-4f6e-a103-a27175aa1fd2 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:51.547148255 +0000 UTC m=+59.084973889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m59sx" (UID: "fabfebcc-b85e-4f6e-a103-a27175aa1fd2") : secret "insights-runtime-extractor-tls" not found
Jul 15 16:16:51.060162 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:51.060133    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d7vt\" (UniqueName: \"kubernetes.io/projected/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-api-access-5d7vt\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:51.262596 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:51.262565    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:51.334815 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:51.334791    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/1.log"
Jul 15 16:16:51.335206 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:51.335124    2582 scope.go:117] "RemoveContainer" containerID="919c946d4e833497bfdb98105dc249912b93db7399c952ad8227b424a982eab7"
Jul 15 16:16:51.335309 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:51.335282    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-l9sbq_openshift-console-operator(a65995fc-4690-4f8a-8cb6-222b26a0e514)\"" pod="openshift-console-operator/console-operator-7866497494-l9sbq" podUID="a65995fc-4690-4f8a-8cb6-222b26a0e514"
Jul 15 16:16:51.336065 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:51.336041    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8822c" event={"ID":"a6caa983-90b5-4dbc-aead-3ccdae0b2c91","Type":"ContainerStarted","Data":"c1326c0d73dc0750b69cd92c8d0d2d940c191f6b670b9b6e17ece5734374056d"}
Jul 15 16:16:51.495452 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:51.495414    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:51.551976 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:51.551890    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:51.551976 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:51.551959    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:51.552148 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:51.552001    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 16:16:51.552148 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:51.552041    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 16:16:51.552148 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:51.552058    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-rbac-proxy-cm podName:fabfebcc-b85e-4f6e-a103-a27175aa1fd2 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:52.552042783 +0000 UTC m=+60.089868435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m59sx" (UID: "fabfebcc-b85e-4f6e-a103-a27175aa1fd2") : configmap "kube-rbac-proxy" not found
Jul 15 16:16:51.552148 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:51.552088    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-insights-runtime-extractor-tls podName:fabfebcc-b85e-4f6e-a103-a27175aa1fd2 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:52.552075139 +0000 UTC m=+60.089900773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m59sx" (UID: "fabfebcc-b85e-4f6e-a103-a27175aa1fd2") : secret "insights-runtime-extractor-tls" not found
Jul 15 16:16:51.641536 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:51.641505    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:52.549110 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:52.549085    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-746j8_725f8d4f-c7db-452b-a0b8-bb292c501156/dns-node-resolver/0.log"
Jul 15 16:16:52.560484 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:52.560450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:52.560622 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:52.560516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:52.560622 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:52.560590    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 16:16:52.560741 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:52.560652    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-rbac-proxy-cm podName:fabfebcc-b85e-4f6e-a103-a27175aa1fd2 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:54.560637374 +0000 UTC m=+62.098463007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m59sx" (UID: "fabfebcc-b85e-4f6e-a103-a27175aa1fd2") : configmap "kube-rbac-proxy" not found
Jul 15 16:16:52.560741 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:52.560718    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 16:16:52.560854 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:52.560769    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-insights-runtime-extractor-tls podName:fabfebcc-b85e-4f6e-a103-a27175aa1fd2 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:54.560745892 +0000 UTC m=+62.098571526 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m59sx" (UID: "fabfebcc-b85e-4f6e-a103-a27175aa1fd2") : secret "insights-runtime-extractor-tls" not found
Jul 15 16:16:52.646566 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:52.646524    2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:16:52.646731 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:52.646581    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:16:52.646966 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:52.646952    2582 scope.go:117] "RemoveContainer" containerID="919c946d4e833497bfdb98105dc249912b93db7399c952ad8227b424a982eab7"
Jul 15 16:16:52.647130 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:52.647110    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-l9sbq_openshift-console-operator(a65995fc-4690-4f8a-8cb6-222b26a0e514)\"" pod="openshift-console-operator/console-operator-7866497494-l9sbq" podUID="a65995fc-4690-4f8a-8cb6-222b26a0e514"
Jul 15 16:16:53.060741 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.060711    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-qcc2t"]
Jul 15 16:16:53.093895 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.093866    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-qcc2t"]
Jul 15 16:16:53.094069 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.093946    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-qcc2t"
Jul 15 16:16:53.098471 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.098443    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 15 16:16:53.099652 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.099626    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-t5wqn\""
Jul 15 16:16:53.099652 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.099644    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 15 16:16:53.099828 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.099696    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 15 16:16:53.105730 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.105704    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 15 16:16:53.110460 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.110433    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:53.140794 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.140771    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4hfqq"]
Jul 15 16:16:53.159041 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.159001    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4hfqq"]
Jul 15 16:16:53.159171 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.159113    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-4hfqq"
Jul 15 16:16:53.162879 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.162784    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 15 16:16:53.162879 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.162872    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 15 16:16:53.163040 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.162934    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cslb5\""
Jul 15 16:16:53.166209 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.166180    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/33240980-a5c4-465f-8654-350047125574-signing-key\") pod \"service-ca-79f68b9f4f-qcc2t\" (UID: \"33240980-a5c4-465f-8654-350047125574\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qcc2t"
Jul 15 16:16:53.166304 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.166238    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gj4t\" (UniqueName: \"kubernetes.io/projected/33240980-a5c4-465f-8654-350047125574-kube-api-access-6gj4t\") pod \"service-ca-79f68b9f4f-qcc2t\" (UID: \"33240980-a5c4-465f-8654-350047125574\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qcc2t"
Jul 15 16:16:53.166399 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.166381    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/33240980-a5c4-465f-8654-350047125574-signing-cabundle\") pod \"service-ca-79f68b9f4f-qcc2t\" (UID: \"33240980-a5c4-465f-8654-350047125574\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qcc2t"
Jul 15 16:16:53.198970 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.198938    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:53.240739 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.240717    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jcp65"
Jul 15 16:16:53.270361 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.268078    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gj4t\" (UniqueName: \"kubernetes.io/projected/33240980-a5c4-465f-8654-350047125574-kube-api-access-6gj4t\") pod \"service-ca-79f68b9f4f-qcc2t\" (UID: \"33240980-a5c4-465f-8654-350047125574\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qcc2t"
Jul 15 16:16:53.270361 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.268289    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/33240980-a5c4-465f-8654-350047125574-signing-cabundle\") pod \"service-ca-79f68b9f4f-qcc2t\" (UID: \"33240980-a5c4-465f-8654-350047125574\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qcc2t"
Jul 15 16:16:53.270361 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.268406    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4hfqq\" (UID: \"5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4hfqq"
Jul 15 16:16:53.270361 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.268553    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4hfqq\" (UID: \"5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4hfqq"
Jul 15 16:16:53.270361 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.268607    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/33240980-a5c4-465f-8654-350047125574-signing-key\") pod \"service-ca-79f68b9f4f-qcc2t\" (UID: \"33240980-a5c4-465f-8654-350047125574\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qcc2t"
Jul 15 16:16:53.270361 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.269102    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/33240980-a5c4-465f-8654-350047125574-signing-cabundle\") pod \"service-ca-79f68b9f4f-qcc2t\" (UID: \"33240980-a5c4-465f-8654-350047125574\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qcc2t"
Jul 15 16:16:53.272327 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.272301    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/33240980-a5c4-465f-8654-350047125574-signing-key\") pod \"service-ca-79f68b9f4f-qcc2t\" (UID: \"33240980-a5c4-465f-8654-350047125574\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qcc2t"
Jul 15 16:16:53.287074 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.287043    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gj4t\" (UniqueName: \"kubernetes.io/projected/33240980-a5c4-465f-8654-350047125574-kube-api-access-6gj4t\") pod \"service-ca-79f68b9f4f-qcc2t\" (UID: \"33240980-a5c4-465f-8654-350047125574\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qcc2t"
Jul 15 16:16:53.352694 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.352628    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:53.369760 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.369733    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4hfqq\" (UID: \"5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4hfqq"
Jul 15 16:16:53.369860 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.369847    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4hfqq\" (UID: \"5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4hfqq"
Jul 15 16:16:53.369936 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:53.369917    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 16:16:53.369995 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:53.369979    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-networking-console-plugin-cert podName:5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac nodeName:}" failed. No retries permitted until 2026-07-15 16:16:53.86995981 +0000 UTC m=+61.407785444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4hfqq" (UID: "5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac") : secret "networking-console-plugin-cert" not found
Jul 15 16:16:53.370465 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.370447    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4hfqq\" (UID: \"5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4hfqq"
Jul 15 16:16:53.404122 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.404097    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-qcc2t"
Jul 15 16:16:53.464302 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.464274    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:53.621896 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.621874    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-qcc2t"]
Jul 15 16:16:53.624097 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:16:53.624076    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33240980_a5c4_465f_8654_350047125574.slice/crio-7f231865b37b7ef4445e0658426de4b025ac31996f44602b5ddd5d376a26befd WatchSource:0}: Error finding container 7f231865b37b7ef4445e0658426de4b025ac31996f44602b5ddd5d376a26befd: Status 404 returned error can't find the container with id 7f231865b37b7ef4445e0658426de4b025ac31996f44602b5ddd5d376a26befd
Jul 15 16:16:53.650372 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.650319    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:53.793731 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.793696    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:53.873947 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.873890    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4hfqq\" (UID: \"5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4hfqq"
Jul 15 16:16:53.874048 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:53.873995    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 16:16:53.874048 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:53.874039    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-networking-console-plugin-cert podName:5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac nodeName:}" failed. No retries permitted until 2026-07-15 16:16:54.874026645 +0000 UTC m=+62.411852280 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4hfqq" (UID: "5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac") : secret "networking-console-plugin-cert" not found
Jul 15 16:16:53.945910 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.945888    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f9v7g_f99fdc7b-743b-4fae-b826-c2bd4c75aadc/node-ca/0.log"
Jul 15 16:16:53.976617 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:53.976593    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:54.342460 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:54.342421    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b2p8p_1817aeb5-1f49-4a69-ba0d-75ca3f98fc07/serve-healthcheck-canary/0.log"
Jul 15 16:16:54.350315 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:54.350286    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8822c" event={"ID":"a6caa983-90b5-4dbc-aead-3ccdae0b2c91","Type":"ContainerStarted","Data":"ab1a37178bd6ced6ce897cae50c3a1df76f1dc93d717d26d7304f88b2701f1cc"}
Jul 15 16:16:54.350458 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:54.350358    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8822c" event={"ID":"a6caa983-90b5-4dbc-aead-3ccdae0b2c91","Type":"ContainerStarted","Data":"69b308591a2e52622d04691d477961287328625668906f9991d5736c82eb1ad4"}
Jul 15 16:16:54.351786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:54.351758    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-qcc2t" event={"ID":"33240980-a5c4-465f-8654-350047125574","Type":"ContainerStarted","Data":"8a754e483148f29169483742fcdb8c21e8f65de52bfabe385f5f49e12782951b"}
Jul 15 16:16:54.351891 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:54.351806    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-qcc2t" event={"ID":"33240980-a5c4-465f-8654-350047125574","Type":"ContainerStarted","Data":"7f231865b37b7ef4445e0658426de4b025ac31996f44602b5ddd5d376a26befd"}
Jul 15 16:16:54.376058 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:54.376005    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-8822c" podStartSLOduration=2.345263346 podStartE2EDuration="5.375987167s" totalImagesPullingTime="3.030723821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:16:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:54.374946922 +0000 UTC m=+61.912772605" watchObservedRunningTime="2026-07-15 16:16:54.375987167 +0000 UTC m=+61.913812824"
Jul 15 16:16:54.535918 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:54.535890    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-8822c_a6caa983-90b5-4dbc-aead-3ccdae0b2c91/migrator/0.log"
Jul 15 16:16:54.581523 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:54.581491    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:54.581662 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:54.581549    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:54.581662 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:54.581603    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 16:16:54.581775 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:54.581678    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-rbac-proxy-cm podName:fabfebcc-b85e-4f6e-a103-a27175aa1fd2 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:58.581660192 +0000 UTC m=+66.119485832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m59sx" (UID: "fabfebcc-b85e-4f6e-a103-a27175aa1fd2") : configmap "kube-rbac-proxy" not found
Jul 15 16:16:54.581775 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:54.581694    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 16:16:54.581775 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:54.581743    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-insights-runtime-extractor-tls podName:fabfebcc-b85e-4f6e-a103-a27175aa1fd2 nodeName:}" failed. No retries permitted until 2026-07-15 16:16:58.581728264 +0000 UTC m=+66.119553920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m59sx" (UID: "fabfebcc-b85e-4f6e-a103-a27175aa1fd2") : secret "insights-runtime-extractor-tls" not found
Jul 15 16:16:54.741129 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:54.741107    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-8822c_a6caa983-90b5-4dbc-aead-3ccdae0b2c91/graceful-termination/0.log"
Jul 15 16:16:54.884327 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:54.884296    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4hfqq\" (UID: \"5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4hfqq"
Jul 15 16:16:54.884488 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:54.884433    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 16:16:54.884488 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:54.884485    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-networking-console-plugin-cert podName:5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac nodeName:}" failed. No retries permitted until 2026-07-15 16:16:56.884471815 +0000 UTC m=+64.422297449 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4hfqq" (UID: "5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac") : secret "networking-console-plugin-cert" not found
Jul 15 16:16:54.946113 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:54.946087    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-8g4mf_58b7a5fa-4cb2-4ff8-a94f-07abb5198153/kube-storage-version-migrator-operator/0.log"
Jul 15 16:16:55.422605 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:55.422554    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:55.703302 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:55.703271    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:55.815528 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:55.815482    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:56.049743 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:56.049669    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:56.213317 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:56.213287    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:56.886495 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:56.886464    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:56.901699 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:56.901669    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4hfqq\" (UID: \"5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4hfqq"
Jul 15 16:16:56.901833 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:56.901816    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 16:16:56.901899 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:56.901880    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-networking-console-plugin-cert podName:5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac nodeName:}" failed. No retries permitted until 2026-07-15 16:17:00.901860926 +0000 UTC m=+68.439686570 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4hfqq" (UID: "5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac") : secret "networking-console-plugin-cert" not found
Jul 15 16:16:57.260222 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:57.260186    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:57.692518 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:57.692423    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:57.808534 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:57.808507    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptwnx\" (UniqueName: \"kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx\") pod \"network-check-target-9h4t6\" (UID: \"bc941219-34a4-4e54-aae8-6feb420ddac5\") " pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:57.808666 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:57.808539    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret\") pod \"global-pull-secret-syncer-z7zbh\" (UID: \"d0d24e92-1685-4d42-b291-4ceebc12c881\") " pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:57.808666 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:57.808578    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs\") pod \"network-metrics-daemon-ht28p\" (UID: \"e68bcad1-c436-4799-89f3-72d611f5716d\") " pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:16:57.811022 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:57.810989    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptwnx\" (UniqueName: \"kubernetes.io/projected/bc941219-34a4-4e54-aae8-6feb420ddac5-kube-api-access-ptwnx\") pod \"network-check-target-9h4t6\" (UID: \"bc941219-34a4-4e54-aae8-6feb420ddac5\") " pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:57.815208 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:57.815188    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 16:16:57.815306 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:57.815193    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 16:16:57.818941 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:57.818921    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 16:16:57.819021 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:57.818991    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs podName:e68bcad1-c436-4799-89f3-72d611f5716d nodeName:}" failed. No retries permitted until 2026-07-15 16:18:01.818974657 +0000 UTC m=+129.356800294 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs") pod "network-metrics-daemon-ht28p" (UID: "e68bcad1-c436-4799-89f3-72d611f5716d") : secret "metrics-daemon-secret" not found
Jul 15 16:16:57.820850 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:57.820826    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0d24e92-1685-4d42-b291-4ceebc12c881-original-pull-secret\") pod \"global-pull-secret-syncer-z7zbh\" (UID: \"d0d24e92-1685-4d42-b291-4ceebc12c881\") " pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:57.877788 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:57.877762    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:58.009865 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.009837    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e383ad65-70b7-4c08-9609-27d0e18f89af-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5zmpj\" (UID: \"e383ad65-70b7-4c08-9609-27d0e18f89af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj"
Jul 15 16:16:58.012038 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.012016    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e383ad65-70b7-4c08-9609-27d0e18f89af-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5zmpj\" (UID: \"e383ad65-70b7-4c08-9609-27d0e18f89af\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj"
Jul 15 16:16:58.097817 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.097795    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dmv8w\""
Jul 15 16:16:58.099900 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.099886    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z7zbh"
Jul 15 16:16:58.104642 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.104624    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:58.110973 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.110950    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jfkg2\" (UID: \"3d43b990-0b96-40f5-a957-94e8914b0f81\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"
Jul 15 16:16:58.111123 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:58.111105    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 16:16:58.111178 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:58.111171    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls podName:3d43b990-0b96-40f5-a957-94e8914b0f81 nodeName:}" failed. No retries permitted until 2026-07-15 16:17:14.111151898 +0000 UTC m=+81.648977552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jfkg2" (UID: "3d43b990-0b96-40f5-a957-94e8914b0f81") : secret "cluster-monitoring-operator-tls" not found
Jul 15 16:16:58.122909 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.122891    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6tgtc\""
Jul 15 16:16:58.126369 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.126326    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj"
Jul 15 16:16:58.177280 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.177102    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:58.212170 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.211982    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:58.212170 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.212051    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:16:58.212600 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:58.212383    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle podName:0043fb1f-b142-46de-9dee-9e7f1c5dc853 nodeName:}" failed. No retries permitted until 2026-07-15 16:17:14.212322601 +0000 UTC m=+81.750148254 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle") pod "router-default-5fd46db8-vfcwl" (UID: "0043fb1f-b142-46de-9dee-9e7f1c5dc853") : configmap references non-existent config key: service-ca.crt
Jul 15 16:16:58.213368 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:58.212831    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 16:16:58.213368 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:58.212882    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs podName:0043fb1f-b142-46de-9dee-9e7f1c5dc853 nodeName:}" failed. No retries permitted until 2026-07-15 16:17:14.212866533 +0000 UTC m=+81.750692181 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs") pod "router-default-5fd46db8-vfcwl" (UID: "0043fb1f-b142-46de-9dee-9e7f1c5dc853") : secret "router-metrics-certs-default" not found
Jul 15 16:16:58.255454 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.255402    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-qcc2t" podStartSLOduration=5.255313366 podStartE2EDuration="5.255313366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:16:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:54.421636739 +0000 UTC m=+61.959462395" watchObservedRunningTime="2026-07-15 16:16:58.255313366 +0000 UTC m=+65.793139023"
Jul 15 16:16:58.256440 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.256416    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z7zbh"]
Jul 15 16:16:58.258661 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:16:58.258625    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0d24e92_1685_4d42_b291_4ceebc12c881.slice/crio-607c4525189fb03ec8ef511b02cc6a97d23fbd24925166af5d81cee4b0a9b3cf WatchSource:0}: Error finding container 607c4525189fb03ec8ef511b02cc6a97d23fbd24925166af5d81cee4b0a9b3cf: Status 404 returned error can't find the container with id 607c4525189fb03ec8ef511b02cc6a97d23fbd24925166af5d81cee4b0a9b3cf
Jul 15 16:16:58.285604 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.285578    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9h4t6"]
Jul 15 16:16:58.291864 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:16:58.291843    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc941219_34a4_4e54_aae8_6feb420ddac5.slice/crio-59463149422cb50afe25de639785356154e72dc18f032083a92053f67dfe339d WatchSource:0}: Error finding container 59463149422cb50afe25de639785356154e72dc18f032083a92053f67dfe339d: Status 404 returned error can't find the container with id 59463149422cb50afe25de639785356154e72dc18f032083a92053f67dfe339d
Jul 15 16:16:58.304835 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.304815    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj"]
Jul 15 16:16:58.329372 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.329324    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:58.369551 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.369525    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z7zbh" event={"ID":"d0d24e92-1685-4d42-b291-4ceebc12c881","Type":"ContainerStarted","Data":"607c4525189fb03ec8ef511b02cc6a97d23fbd24925166af5d81cee4b0a9b3cf"}
Jul 15 16:16:58.370579 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.370556    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj" event={"ID":"e383ad65-70b7-4c08-9609-27d0e18f89af","Type":"ContainerStarted","Data":"cc37e91d619d47edaa54b8565b6b6fd8c92d444cc6892ac810f1665ab30bc3d4"}
Jul 15 16:16:58.371870 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.371846    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9h4t6" event={"ID":"bc941219-34a4-4e54-aae8-6feb420ddac5","Type":"ContainerStarted","Data":"d1961ba18938509bfdf31751674103228a18f9b6dbd5d6e91f9b2d45945cfd3e"}
Jul 15 16:16:58.371954 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.371885    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9h4t6" event={"ID":"bc941219-34a4-4e54-aae8-6feb420ddac5","Type":"ContainerStarted","Data":"59463149422cb50afe25de639785356154e72dc18f032083a92053f67dfe339d"}
Jul 15 16:16:58.372010 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.371975    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:16:58.401810 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.401773    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9h4t6" podStartSLOduration=65.401761411 podStartE2EDuration="1m5.401761411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:15:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:16:58.400941802 +0000 UTC m=+65.938767458" watchObservedRunningTime="2026-07-15 16:16:58.401761411 +0000 UTC m=+65.939587067"
Jul 15 16:16:58.506811 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.506772    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:16:58.615636 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.615575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:58.615636 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:58.615617    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:16:58.615774 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:58.615682    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 16:16:58.615774 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:58.615741    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-rbac-proxy-cm podName:fabfebcc-b85e-4f6e-a103-a27175aa1fd2 nodeName:}" failed. No retries permitted until 2026-07-15 16:17:06.615727483 +0000 UTC m=+74.153553122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m59sx" (UID: "fabfebcc-b85e-4f6e-a103-a27175aa1fd2") : configmap "kube-rbac-proxy" not found
Jul 15 16:16:58.615855 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:58.615767    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 16:16:58.615855 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:16:58.615829    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-insights-runtime-extractor-tls podName:fabfebcc-b85e-4f6e-a103-a27175aa1fd2 nodeName:}" failed. No retries permitted until 2026-07-15 16:17:06.615812216 +0000 UTC m=+74.153637859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m59sx" (UID: "fabfebcc-b85e-4f6e-a103-a27175aa1fd2") : secret "insights-runtime-extractor-tls" not found
Jul 15 16:16:59.631903 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:59.624642    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls\") pod \"dns-default-mn7f2\" (UID: \"ede18ab8-3e09-4aa9-ba0a-67fee4797267\") " pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:59.631903 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:59.624693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:59.631903 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:59.628172    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls\") pod \"image-registry-7f4dc4b479-gmdpl\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") " pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:59.631903 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:59.630698    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ede18ab8-3e09-4aa9-ba0a-67fee4797267-metrics-tls\") pod \"dns-default-mn7f2\" (UID: \"ede18ab8-3e09-4aa9-ba0a-67fee4797267\") " pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:16:59.847759 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:59.847729    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h68pr\""
Jul 15 16:16:59.853943 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:59.853920    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:16:59.879230 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:59.879213    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vkb7c\""
Jul 15 16:16:59.885906 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:16:59.885883    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:17:00.060674 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:00.060645    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f4dc4b479-gmdpl"]
Jul 15 16:17:00.063780 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:17:00.063754    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9072a46_a152_48d0_91bb_6625737e00bb.slice/crio-6f775cdcd4be178cdb4ea0d3e1c16320162cb444176f706e65d9049ee7986b0f WatchSource:0}: Error finding container 6f775cdcd4be178cdb4ea0d3e1c16320162cb444176f706e65d9049ee7986b0f: Status 404 returned error can't find the container with id 6f775cdcd4be178cdb4ea0d3e1c16320162cb444176f706e65d9049ee7986b0f
Jul 15 16:17:00.083293 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:00.083269    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mn7f2"]
Jul 15 16:17:00.085559 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:17:00.085531    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede18ab8_3e09_4aa9_ba0a_67fee4797267.slice/crio-ada3965ebebb879bc29d2d95c12a9bd177d3f21b885d0b25901e0b3afbdd5b8f WatchSource:0}: Error finding container ada3965ebebb879bc29d2d95c12a9bd177d3f21b885d0b25901e0b3afbdd5b8f: Status 404 returned error can't find the container with id ada3965ebebb879bc29d2d95c12a9bd177d3f21b885d0b25901e0b3afbdd5b8f
Jul 15 16:17:00.376035 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:00.375993    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:17:00.381849 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:00.381815    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mn7f2" event={"ID":"ede18ab8-3e09-4aa9-ba0a-67fee4797267","Type":"ContainerStarted","Data":"ada3965ebebb879bc29d2d95c12a9bd177d3f21b885d0b25901e0b3afbdd5b8f"}
Jul 15 16:17:00.383513 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:00.383474    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl" event={"ID":"d9072a46-a152-48d0-91bb-6625737e00bb","Type":"ContainerStarted","Data":"c71c5b6c1dc065b168128991d68be2ee5aebe94de1788adb10bac91710c66c76"}
Jul 15 16:17:00.383656 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:00.383535    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl" event={"ID":"d9072a46-a152-48d0-91bb-6625737e00bb","Type":"ContainerStarted","Data":"6f775cdcd4be178cdb4ea0d3e1c16320162cb444176f706e65d9049ee7986b0f"}
Jul 15 16:17:00.383656 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:00.383575    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:17:00.589505 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:00.589412    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log" limit=1024
Jul 15 16:17:00.940025 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:00.939939    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4hfqq\" (UID: \"5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4hfqq"
Jul 15 16:17:00.940498 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:17:00.940120    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 16:17:00.940498 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:17:00.940200    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-networking-console-plugin-cert podName:5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac nodeName:}" failed. No retries permitted until 2026-07-15 16:17:08.940177614 +0000 UTC m=+76.478003251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4hfqq" (UID: "5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac") : secret "networking-console-plugin-cert" not found
Jul 15 16:17:02.394886 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:02.394847    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj" event={"ID":"e383ad65-70b7-4c08-9609-27d0e18f89af","Type":"ContainerStarted","Data":"7a4bc6b56c1c28955b82212b3d31d90f61f3aa88aea039b8e694ed6d8ac77a0b"}
Jul 15 16:17:02.395260 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:02.394952    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj" event={"ID":"e383ad65-70b7-4c08-9609-27d0e18f89af","Type":"ContainerStarted","Data":"df801432d0ef3801e35922c5c757bb039feef4ed934635e9f1f20943a93c71bd"}
Jul 15 16:17:02.444762 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:02.444701    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl" podStartSLOduration=69.44467726 podStartE2EDuration="1m9.44467726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:15:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:17:00.427089295 +0000 UTC m=+67.964914953" watchObservedRunningTime="2026-07-15 16:17:02.44467726 +0000 UTC m=+69.982502917"
Jul 15 16:17:02.445723 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:02.445677    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5zmpj" podStartSLOduration=17.39754117 podStartE2EDuration="20.445666193s" totalImagesPullingTime="3.048125023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:17:02.443290722 +0000 UTC m=+69.981116381" watchObservedRunningTime="2026-07-15 16:17:02.445666193 +0000 UTC m=+69.983491849"
Jul 15 16:17:03.400141 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:03.400098    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mn7f2" event={"ID":"ede18ab8-3e09-4aa9-ba0a-67fee4797267","Type":"ContainerStarted","Data":"a32332dc4fc6e24f8c834a1496b627a386680587ebd0474d823793dccca1298f"}
Jul 15 16:17:05.409580 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:05.409546    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mn7f2" event={"ID":"ede18ab8-3e09-4aa9-ba0a-67fee4797267","Type":"ContainerStarted","Data":"750c56ccd5c554a226a7a959d02bdc5a3478658cc8ef2355ea5cf37185b1dac1"}
Jul 15 16:17:05.410121 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:05.409653    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:17:05.411117 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:05.411097    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z7zbh" event={"ID":"d0d24e92-1685-4d42-b291-4ceebc12c881","Type":"ContainerStarted","Data":"5b25ac55e23f973841024c04e0d6774cec0cffa9fbb4b60f1f13aab1a0b8f990"}
Jul 15 16:17:05.438843 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:05.438796    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mn7f2" podStartSLOduration=35.588348066 podStartE2EDuration="38.438780771s" totalImagesPullingTime="2.850432705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:17:05.436129799 +0000 UTC m=+72.973955456" watchObservedRunningTime="2026-07-15 16:17:05.438780771 +0000 UTC m=+72.976606427"
Jul 15 16:17:05.465894 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:05.465841    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-z7zbh" podStartSLOduration=66.24992051 podStartE2EDuration="1m12.465824834s" totalImagesPullingTime="6.215904324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:17:05.465116374 +0000 UTC m=+73.002942055" watchObservedRunningTime="2026-07-15 16:17:05.465824834 +0000 UTC m=+73.003650523"
Jul 15 16:17:06.695154 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:06.695118    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:17:06.695154 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:06.695159    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:17:06.695675 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:06.695656    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:17:06.697509 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:06.697487    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fabfebcc-b85e-4f6e-a103-a27175aa1fd2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m59sx\" (UID: \"fabfebcc-b85e-4f6e-a103-a27175aa1fd2\") " pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:17:06.759650 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:06.759618    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tw9wx\""
Jul 15 16:17:06.766150 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:06.766132    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m59sx"
Jul 15 16:17:06.906245 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:06.906061    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m59sx"]
Jul 15 16:17:06.908818 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:17:06.908791    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfabfebcc_b85e_4f6e_a103_a27175aa1fd2.slice/crio-e968381a8975ca936a127d243e94c4e98ee0328367c955e9f9c109a935c6711c WatchSource:0}: Error finding container e968381a8975ca936a127d243e94c4e98ee0328367c955e9f9c109a935c6711c: Status 404 returned error can't find the container with id e968381a8975ca936a127d243e94c4e98ee0328367c955e9f9c109a935c6711c
Jul 15 16:17:06.971574 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:06.971544    2582 scope.go:117] "RemoveContainer" containerID="919c946d4e833497bfdb98105dc249912b93db7399c952ad8227b424a982eab7"
Jul 15 16:17:07.419966 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:07.419892    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:17:07.420287 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:07.420273    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/1.log"
Jul 15 16:17:07.420360 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:07.420306    2582 generic.go:356] "Generic (PLEG): container finished" podID="a65995fc-4690-4f8a-8cb6-222b26a0e514" containerID="eaf1e9385443b1b1ef844ff474fa0231ed6a3686194605ef67601ef4b442b5a0" exitCode=255
Jul 15 16:17:07.420400 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:07.420386    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-l9sbq" event={"ID":"a65995fc-4690-4f8a-8cb6-222b26a0e514","Type":"ContainerDied","Data":"eaf1e9385443b1b1ef844ff474fa0231ed6a3686194605ef67601ef4b442b5a0"}
Jul 15 16:17:07.420449 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:07.420436    2582 scope.go:117] "RemoveContainer" containerID="919c946d4e833497bfdb98105dc249912b93db7399c952ad8227b424a982eab7"
Jul 15 16:17:07.420748 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:07.420730    2582 scope.go:117] "RemoveContainer" containerID="eaf1e9385443b1b1ef844ff474fa0231ed6a3686194605ef67601ef4b442b5a0"
Jul 15 16:17:07.420961 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:17:07.420941    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-l9sbq_openshift-console-operator(a65995fc-4690-4f8a-8cb6-222b26a0e514)\"" pod="openshift-console-operator/console-operator-7866497494-l9sbq" podUID="a65995fc-4690-4f8a-8cb6-222b26a0e514"
Jul 15 16:17:07.421641 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:07.421607    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m59sx" event={"ID":"fabfebcc-b85e-4f6e-a103-a27175aa1fd2","Type":"ContainerStarted","Data":"e968381a8975ca936a127d243e94c4e98ee0328367c955e9f9c109a935c6711c"}
Jul 15 16:17:08.427592 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:08.427558    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:17:09.016929 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:09.016895    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4hfqq\" (UID: \"5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4hfqq"
Jul 15 16:17:09.019815 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:09.019791    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4hfqq\" (UID: \"5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4hfqq"
Jul 15 16:17:09.070898 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:09.070858    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-4hfqq"
Jul 15 16:17:09.238548 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:17:09.238514    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd5bfcf_80f9_42d9_8e6a_62b518bbdaac.slice/crio-3ae5ba460743149fbbaf0d7ce2a8a7b98a09ca2fd06b54491695078bef40f273 WatchSource:0}: Error finding container 3ae5ba460743149fbbaf0d7ce2a8a7b98a09ca2fd06b54491695078bef40f273: Status 404 returned error can't find the container with id 3ae5ba460743149fbbaf0d7ce2a8a7b98a09ca2fd06b54491695078bef40f273
Jul 15 16:17:09.239744 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:09.239721    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4hfqq"]
Jul 15 16:17:09.433473 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:09.433380    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-4hfqq" event={"ID":"5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac","Type":"ContainerStarted","Data":"3ae5ba460743149fbbaf0d7ce2a8a7b98a09ca2fd06b54491695078bef40f273"}
Jul 15 16:17:12.646261 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:12.646233    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:17:12.646683 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:12.646287    2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:17:12.646683 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:12.646581    2582 scope.go:117] "RemoveContainer" containerID="eaf1e9385443b1b1ef844ff474fa0231ed6a3686194605ef67601ef4b442b5a0"
Jul 15 16:17:12.646769 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:17:12.646734    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-l9sbq_openshift-console-operator(a65995fc-4690-4f8a-8cb6-222b26a0e514)\"" pod="openshift-console-operator/console-operator-7866497494-l9sbq" podUID="a65995fc-4690-4f8a-8cb6-222b26a0e514"
Jul 15 16:17:13.452960 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:13.452919    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m59sx" event={"ID":"fabfebcc-b85e-4f6e-a103-a27175aa1fd2","Type":"ContainerStarted","Data":"29e1f2cecb65798353afbb6d38eaa32513772dec04ce3165d6d789040305fb29"}
Jul 15 16:17:13.455610 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:13.455575    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-4hfqq" event={"ID":"5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac","Type":"ContainerStarted","Data":"5d914fd6cc5a72d733074955fe945cc4defe85b89afdc9a5270194a7835aa5d5"}
Jul 15 16:17:13.480569 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:13.478421    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-4hfqq" podStartSLOduration=17.248456704 podStartE2EDuration="20.478400708s" totalImagesPullingTime="3.229944004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:17:13.478155846 +0000 UTC m=+81.015981502" watchObservedRunningTime="2026-07-15 16:17:13.478400708 +0000 UTC m=+81.016226365"
Jul 15 16:17:14.166594 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:14.166551    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jfkg2\" (UID: \"3d43b990-0b96-40f5-a957-94e8914b0f81\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"
Jul 15 16:17:14.169433 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:14.169397    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d43b990-0b96-40f5-a957-94e8914b0f81-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jfkg2\" (UID: \"3d43b990-0b96-40f5-a957-94e8914b0f81\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"
Jul 15 16:17:14.267055 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:14.267017    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:17:14.267232 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:14.267074    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:17:14.267858 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:14.267802    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0043fb1f-b142-46de-9dee-9e7f1c5dc853-service-ca-bundle\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:17:14.269677 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:14.269642    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0043fb1f-b142-46de-9dee-9e7f1c5dc853-metrics-certs\") pod \"router-default-5fd46db8-vfcwl\" (UID: \"0043fb1f-b142-46de-9dee-9e7f1c5dc853\") " pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:17:14.406246 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:14.406214    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fbhtp\""
Jul 15 16:17:14.413955 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:14.413921    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"
Jul 15 16:17:14.486648 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:14.486618    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rnbld\""
Jul 15 16:17:14.494201 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:14.494174    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:17:15.417429 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:15.417295    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mn7f2"
Jul 15 16:17:16.327927 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:16.327903    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5fd46db8-vfcwl"]
Jul 15 16:17:16.329817 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:17:16.329789    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0043fb1f_b142_46de_9dee_9e7f1c5dc853.slice/crio-b362391042e7ecf04f30eff12167e8b78432cbf91e33cfd75d6d00394a2015fe WatchSource:0}: Error finding container b362391042e7ecf04f30eff12167e8b78432cbf91e33cfd75d6d00394a2015fe: Status 404 returned error can't find the container with id b362391042e7ecf04f30eff12167e8b78432cbf91e33cfd75d6d00394a2015fe
Jul 15 16:17:16.341815 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:16.341791    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2"]
Jul 15 16:17:16.343803 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:17:16.343774    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d43b990_0b96_40f5_a957_94e8914b0f81.slice/crio-0e98ba3caec70e6846e8316b4e4c29fa0c84f72eab6e3b011adbec58d05bcd13 WatchSource:0}: Error finding container 0e98ba3caec70e6846e8316b4e4c29fa0c84f72eab6e3b011adbec58d05bcd13: Status 404 returned error can't find the container with id 0e98ba3caec70e6846e8316b4e4c29fa0c84f72eab6e3b011adbec58d05bcd13
Jul 15 16:17:16.469582 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:16.469552    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5fd46db8-vfcwl" event={"ID":"0043fb1f-b142-46de-9dee-9e7f1c5dc853","Type":"ContainerStarted","Data":"a6a781813df5484434b0ce3bec0d3286807782ebb30e60afcafe0baa530868d4"}
Jul 15 16:17:16.469986 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:16.469603    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5fd46db8-vfcwl" event={"ID":"0043fb1f-b142-46de-9dee-9e7f1c5dc853","Type":"ContainerStarted","Data":"b362391042e7ecf04f30eff12167e8b78432cbf91e33cfd75d6d00394a2015fe"}
Jul 15 16:17:16.471422 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:16.471390    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m59sx" event={"ID":"fabfebcc-b85e-4f6e-a103-a27175aa1fd2","Type":"ContainerStarted","Data":"58e1e4470cd1285bedae414497ec1348f805d8f568c31b6b6a3624c123e6b8f5"}
Jul 15 16:17:16.472426 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:16.472408    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2" event={"ID":"3d43b990-0b96-40f5-a957-94e8914b0f81","Type":"ContainerStarted","Data":"0e98ba3caec70e6846e8316b4e4c29fa0c84f72eab6e3b011adbec58d05bcd13"}
Jul 15 16:17:16.492603 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:16.492564    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5fd46db8-vfcwl" podStartSLOduration=34.492549951 podStartE2EDuration="34.492549951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:16:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:17:16.491971428 +0000 UTC m=+84.029797103" watchObservedRunningTime="2026-07-15 16:17:16.492549951 +0000 UTC m=+84.030375606"
Jul 15 16:17:16.495079 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:16.495063    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:17:16.497511 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:16.497488    2582 patch_prober.go:28] interesting pod/router-default-5fd46db8-vfcwl container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld
Jul 15 16:17:16.497511 ip-10-0-141-253 kubenswrapper[2582]: [-]has-synced failed: reason withheld
Jul 15 16:17:16.497511 ip-10-0-141-253 kubenswrapper[2582]: [+]process-running ok
Jul 15 16:17:16.497511 ip-10-0-141-253 kubenswrapper[2582]: healthz check failed
Jul 15 16:17:16.497719 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:16.497534    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5fd46db8-vfcwl" podUID="0043fb1f-b142-46de-9dee-9e7f1c5dc853" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 15 16:17:17.496290 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:17.496259    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:17:18.482422 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:18.482392    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:17:18.483542 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:18.483509    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5fd46db8-vfcwl"
Jul 15 16:17:19.489739 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:19.489663    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2" event={"ID":"3d43b990-0b96-40f5-a957-94e8914b0f81","Type":"ContainerStarted","Data":"26e5803e775e63d857b09126ffe9d94f1577ccbe24f37a41f4def283e1e71135"}
Jul 15 16:17:19.533257 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:19.533198    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jfkg2" podStartSLOduration=34.987136087 podStartE2EDuration="37.533179623s" totalImagesPullingTime="2.546043536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:17:19.522809937 +0000 UTC m=+87.060635594" watchObservedRunningTime="2026-07-15 16:17:19.533179623 +0000 UTC m=+87.071005280"
Jul 15 16:17:19.858909 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:19.858827    2582 patch_prober.go:28] interesting pod/image-registry-7f4dc4b479-gmdpl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:17:19.859065 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:19.858901    2582 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl" podUID="d9072a46-a152-48d0-91bb-6625737e00bb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:17:21.393547 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:21.393517    2582 patch_prober.go:28] interesting pod/image-registry-7f4dc4b479-gmdpl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:17:21.393981 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:21.393565    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl" podUID="d9072a46-a152-48d0-91bb-6625737e00bb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:17:22.281551 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.281518    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd"]
Jul 15 16:17:22.306710 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.306684    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"]
Jul 15 16:17:22.306855 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.306828    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd"
Jul 15 16:17:22.315736 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.315702    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 16:17:22.317021 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.316991    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8p8sc\""
Jul 15 16:17:22.317021 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.316995    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 15 16:17:22.317259 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.317053    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 16:17:22.317259 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.317086    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 16:17:22.322824 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.322794    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t"]
Jul 15 16:17:22.322914 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.322871    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.327545 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.327512    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 15 16:17:22.327704 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.327690    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 15 16:17:22.328025 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.328002    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 15 16:17:22.331676 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.331660    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 15 16:17:22.331848 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.331830    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7b51f1df-7742-4436-a75c-ada501f21600-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-867cdd8747-t5nb9\" (UID: \"7b51f1df-7742-4436-a75c-ada501f21600\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.331916 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.331858    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b51f1df-7742-4436-a75c-ada501f21600-additional-service-ca\") pod \"cluster-proxy-proxy-agent-867cdd8747-t5nb9\" (UID: \"7b51f1df-7742-4436-a75c-ada501f21600\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.331916 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.331876    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9f2g\" (UniqueName: \"kubernetes.io/projected/7b51f1df-7742-4436-a75c-ada501f21600-kube-api-access-g9f2g\") pod \"cluster-proxy-proxy-agent-867cdd8747-t5nb9\" (UID: \"7b51f1df-7742-4436-a75c-ada501f21600\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.331916 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.331895    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b51f1df-7742-4436-a75c-ada501f21600-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-867cdd8747-t5nb9\" (UID: \"7b51f1df-7742-4436-a75c-ada501f21600\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.332061 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.331984    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/14268f46-eab2-4460-b91c-6514fbe178e9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd\" (UID: \"14268f46-eab2-4460-b91c-6514fbe178e9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd"
Jul 15 16:17:22.332096 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.332068    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qshxw\" (UniqueName: \"kubernetes.io/projected/14268f46-eab2-4460-b91c-6514fbe178e9-kube-api-access-qshxw\") pod \"managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd\" (UID: \"14268f46-eab2-4460-b91c-6514fbe178e9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd"
Jul 15 16:17:22.332141 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.332096    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7b51f1df-7742-4436-a75c-ada501f21600-ca\") pod \"cluster-proxy-proxy-agent-867cdd8747-t5nb9\" (UID: \"7b51f1df-7742-4436-a75c-ada501f21600\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.332141 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.332121    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7b51f1df-7742-4436-a75c-ada501f21600-hub\") pod \"cluster-proxy-proxy-agent-867cdd8747-t5nb9\" (UID: \"7b51f1df-7742-4436-a75c-ada501f21600\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.344911 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.344892    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd"]
Jul 15 16:17:22.344982 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.344915    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"]
Jul 15 16:17:22.344982 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.344981    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t"
Jul 15 16:17:22.347815 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.347801    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 15 16:17:22.353404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.353384    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t"]
Jul 15 16:17:22.380789 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.380763    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2mcwd"]
Jul 15 16:17:22.397386 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.397046    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2mcwd"]
Jul 15 16:17:22.397386 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.397240    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2mcwd"
Jul 15 16:17:22.407203 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.407185    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xgnlm\""
Jul 15 16:17:22.407303 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.407185    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 15 16:17:22.433211 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.433188    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7b51f1df-7742-4436-a75c-ada501f21600-ca\") pod \"cluster-proxy-proxy-agent-867cdd8747-t5nb9\" (UID: \"7b51f1df-7742-4436-a75c-ada501f21600\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.433299 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.433214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7b51f1df-7742-4436-a75c-ada501f21600-hub\") pod \"cluster-proxy-proxy-agent-867cdd8747-t5nb9\" (UID: \"7b51f1df-7742-4436-a75c-ada501f21600\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.433299 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.433236    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7b51f1df-7742-4436-a75c-ada501f21600-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-867cdd8747-t5nb9\" (UID: \"7b51f1df-7742-4436-a75c-ada501f21600\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.433299 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.433254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b51f1df-7742-4436-a75c-ada501f21600-additional-service-ca\") pod \"cluster-proxy-proxy-agent-867cdd8747-t5nb9\" (UID: \"7b51f1df-7742-4436-a75c-ada501f21600\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.433299 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.433272    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9f2g\" (UniqueName: \"kubernetes.io/projected/7b51f1df-7742-4436-a75c-ada501f21600-kube-api-access-g9f2g\") pod \"cluster-proxy-proxy-agent-867cdd8747-t5nb9\" (UID: \"7b51f1df-7742-4436-a75c-ada501f21600\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.433542 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.433304    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rblk\" (UniqueName: \"kubernetes.io/projected/59094f94-b4f2-483b-adb1-b0bfb2b0f61f-kube-api-access-5rblk\") pod \"klusterlet-addon-workmgr-64b785d979-ld78t\" (UID: \"59094f94-b4f2-483b-adb1-b0bfb2b0f61f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t"
Jul 15 16:17:22.433542 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.433436    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b51f1df-7742-4436-a75c-ada501f21600-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-867cdd8747-t5nb9\" (UID: \"7b51f1df-7742-4436-a75c-ada501f21600\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.433542 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.433484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/14268f46-eab2-4460-b91c-6514fbe178e9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd\" (UID: \"14268f46-eab2-4460-b91c-6514fbe178e9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd"
Jul 15 16:17:22.433542 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.433527    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59094f94-b4f2-483b-adb1-b0bfb2b0f61f-tmp\") pod \"klusterlet-addon-workmgr-64b785d979-ld78t\" (UID: \"59094f94-b4f2-483b-adb1-b0bfb2b0f61f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t"
Jul 15 16:17:22.433726 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.433569    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6ed872cc-9c6b-45da-a3c9-0aae770f3972-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-2mcwd\" (UID: \"6ed872cc-9c6b-45da-a3c9-0aae770f3972\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2mcwd"
Jul 15 16:17:22.433726 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.433640    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/59094f94-b4f2-483b-adb1-b0bfb2b0f61f-klusterlet-config\") pod \"klusterlet-addon-workmgr-64b785d979-ld78t\" (UID: \"59094f94-b4f2-483b-adb1-b0bfb2b0f61f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t"
Jul 15 16:17:22.433726 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.433681    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qshxw\" (UniqueName: \"kubernetes.io/projected/14268f46-eab2-4460-b91c-6514fbe178e9-kube-api-access-qshxw\") pod \"managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd\" (UID: \"14268f46-eab2-4460-b91c-6514fbe178e9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd"
Jul 15 16:17:22.434130 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.434105    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b51f1df-7742-4436-a75c-ada501f21600-additional-service-ca\") pod \"cluster-proxy-proxy-agent-867cdd8747-t5nb9\" (UID: \"7b51f1df-7742-4436-a75c-ada501f21600\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.435802 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.435768    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7b51f1df-7742-4436-a75c-ada501f21600-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-867cdd8747-t5nb9\" (UID: \"7b51f1df-7742-4436-a75c-ada501f21600\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.435937 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.435917    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7b51f1df-7742-4436-a75c-ada501f21600-hub\") pod \"cluster-proxy-proxy-agent-867cdd8747-t5nb9\" (UID: \"7b51f1df-7742-4436-a75c-ada501f21600\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.435979 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.435952    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7b51f1df-7742-4436-a75c-ada501f21600-ca\") pod \"cluster-proxy-proxy-agent-867cdd8747-t5nb9\" (UID: \"7b51f1df-7742-4436-a75c-ada501f21600\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.436218 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.436198    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/14268f46-eab2-4460-b91c-6514fbe178e9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd\" (UID: \"14268f46-eab2-4460-b91c-6514fbe178e9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd"
Jul 15 16:17:22.436319 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.436299    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b51f1df-7742-4436-a75c-ada501f21600-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-867cdd8747-t5nb9\" (UID: \"7b51f1df-7742-4436-a75c-ada501f21600\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.454827 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.454805    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qshxw\" (UniqueName: \"kubernetes.io/projected/14268f46-eab2-4460-b91c-6514fbe178e9-kube-api-access-qshxw\") pod \"managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd\" (UID: \"14268f46-eab2-4460-b91c-6514fbe178e9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd"
Jul 15 16:17:22.455833 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.455817    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9f2g\" (UniqueName: \"kubernetes.io/projected/7b51f1df-7742-4436-a75c-ada501f21600-kube-api-access-g9f2g\") pod \"cluster-proxy-proxy-agent-867cdd8747-t5nb9\" (UID: \"7b51f1df-7742-4436-a75c-ada501f21600\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.502652 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.502632    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m59sx" event={"ID":"fabfebcc-b85e-4f6e-a103-a27175aa1fd2","Type":"ContainerStarted","Data":"26bdf2742b34cba0721225d30f2fae1edb986ceb761b9b821fded32969bdfa31"}
Jul 15 16:17:22.534205 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.534151    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rblk\" (UniqueName: \"kubernetes.io/projected/59094f94-b4f2-483b-adb1-b0bfb2b0f61f-kube-api-access-5rblk\") pod \"klusterlet-addon-workmgr-64b785d979-ld78t\" (UID: \"59094f94-b4f2-483b-adb1-b0bfb2b0f61f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t"
Jul 15 16:17:22.534205 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.534190    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59094f94-b4f2-483b-adb1-b0bfb2b0f61f-tmp\") pod \"klusterlet-addon-workmgr-64b785d979-ld78t\" (UID: \"59094f94-b4f2-483b-adb1-b0bfb2b0f61f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t"
Jul 15 16:17:22.534316 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.534231    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6ed872cc-9c6b-45da-a3c9-0aae770f3972-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-2mcwd\" (UID: \"6ed872cc-9c6b-45da-a3c9-0aae770f3972\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2mcwd"
Jul 15 16:17:22.534400 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.534312    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/59094f94-b4f2-483b-adb1-b0bfb2b0f61f-klusterlet-config\") pod \"klusterlet-addon-workmgr-64b785d979-ld78t\" (UID: \"59094f94-b4f2-483b-adb1-b0bfb2b0f61f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t"
Jul 15 16:17:22.534629 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.534601    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59094f94-b4f2-483b-adb1-b0bfb2b0f61f-tmp\") pod \"klusterlet-addon-workmgr-64b785d979-ld78t\" (UID: \"59094f94-b4f2-483b-adb1-b0bfb2b0f61f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t"
Jul 15 16:17:22.536597 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.536571    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/59094f94-b4f2-483b-adb1-b0bfb2b0f61f-klusterlet-config\") pod \"klusterlet-addon-workmgr-64b785d979-ld78t\" (UID: \"59094f94-b4f2-483b-adb1-b0bfb2b0f61f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t"
Jul 15 16:17:22.536702 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.536643    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6ed872cc-9c6b-45da-a3c9-0aae770f3972-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-2mcwd\" (UID: \"6ed872cc-9c6b-45da-a3c9-0aae770f3972\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2mcwd"
Jul 15 16:17:22.555214 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.555192    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rblk\" (UniqueName: \"kubernetes.io/projected/59094f94-b4f2-483b-adb1-b0bfb2b0f61f-kube-api-access-5rblk\") pod \"klusterlet-addon-workmgr-64b785d979-ld78t\" (UID: \"59094f94-b4f2-483b-adb1-b0bfb2b0f61f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t"
Jul 15 16:17:22.624213 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.624192    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd"
Jul 15 16:17:22.631479 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.631458    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"
Jul 15 16:17:22.660235 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.660218    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t"
Jul 15 16:17:22.709234 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.709195    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2mcwd"
Jul 15 16:17:22.799234 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.798437    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m59sx" podStartSLOduration=18.454594913 podStartE2EDuration="32.798410623s" totalImagesPullingTime="14.34381571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:16:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:17:22.530913104 +0000 UTC m=+90.068738761" watchObservedRunningTime="2026-07-15 16:17:22.798410623 +0000 UTC m=+90.336236282"
Jul 15 16:17:22.800217 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.799539    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd"]
Jul 15 16:17:22.803006 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:17:22.802975    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14268f46_eab2_4460_b91c_6514fbe178e9.slice/crio-5bfc2b9091be509d9bf46df05d44763245d8f6638f0736d518f5e19cc51c67fa WatchSource:0}: Error finding container 5bfc2b9091be509d9bf46df05d44763245d8f6638f0736d518f5e19cc51c67fa: Status 404 returned error can't find the container with id 5bfc2b9091be509d9bf46df05d44763245d8f6638f0736d518f5e19cc51c67fa
Jul 15 16:17:22.836468 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.836441    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9"]
Jul 15 16:17:22.838955 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:17:22.838928    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b51f1df_7742_4436_a75c_ada501f21600.slice/crio-0fdd3027f0f833991d963b06844e20b4c7e8421ae0dcedc0d83bb41a35c9f987 WatchSource:0}: Error finding container 0fdd3027f0f833991d963b06844e20b4c7e8421ae0dcedc0d83bb41a35c9f987: Status 404 returned error can't find the container with id 0fdd3027f0f833991d963b06844e20b4c7e8421ae0dcedc0d83bb41a35c9f987
Jul 15 16:17:22.866240 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.866222    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t"]
Jul 15 16:17:22.867832 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:17:22.867808    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59094f94_b4f2_483b_adb1_b0bfb2b0f61f.slice/crio-1158d3c8edd0040e14c8fe5ffe63df220860e3a936cddb282e7395cc72304565 WatchSource:0}: Error finding container 1158d3c8edd0040e14c8fe5ffe63df220860e3a936cddb282e7395cc72304565: Status 404 returned error can't find the container with id 1158d3c8edd0040e14c8fe5ffe63df220860e3a936cddb282e7395cc72304565
Jul 15 16:17:22.887071 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:22.887052    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2mcwd"]
Jul 15 16:17:22.887807 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:17:22.887785    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed872cc_9c6b_45da_a3c9_0aae770f3972.slice/crio-51567e93a59569027c4fec241ff95a4cf9d44833f996476bdf3b141574792a4f WatchSource:0}: Error finding container 51567e93a59569027c4fec241ff95a4cf9d44833f996476bdf3b141574792a4f: Status 404 returned error can't find the container with id 51567e93a59569027c4fec241ff95a4cf9d44833f996476bdf3b141574792a4f
Jul 15 16:17:23.507414 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:23.507316    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd" event={"ID":"14268f46-eab2-4460-b91c-6514fbe178e9","Type":"ContainerStarted","Data":"5bfc2b9091be509d9bf46df05d44763245d8f6638f0736d518f5e19cc51c67fa"}
Jul 15 16:17:23.508803 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:23.508775    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2mcwd" event={"ID":"6ed872cc-9c6b-45da-a3c9-0aae770f3972","Type":"ContainerStarted","Data":"51567e93a59569027c4fec241ff95a4cf9d44833f996476bdf3b141574792a4f"}
Jul 15 16:17:23.510213 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:23.510189    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9" event={"ID":"7b51f1df-7742-4436-a75c-ada501f21600","Type":"ContainerStarted","Data":"0fdd3027f0f833991d963b06844e20b4c7e8421ae0dcedc0d83bb41a35c9f987"}
Jul 15 16:17:23.511394 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:23.511367    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t" event={"ID":"59094f94-b4f2-483b-adb1-b0bfb2b0f61f","Type":"ContainerStarted","Data":"1158d3c8edd0040e14c8fe5ffe63df220860e3a936cddb282e7395cc72304565"}
Jul 15 16:17:24.973386 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:24.972772    2582 scope.go:117] "RemoveContainer" containerID="eaf1e9385443b1b1ef844ff474fa0231ed6a3686194605ef67601ef4b442b5a0"
Jul 15 16:17:24.973386 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:17:24.972973    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-l9sbq_openshift-console-operator(a65995fc-4690-4f8a-8cb6-222b26a0e514)\"" pod="openshift-console-operator/console-operator-7866497494-l9sbq" podUID="a65995fc-4690-4f8a-8cb6-222b26a0e514"
Jul 15 16:17:29.379569 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:29.379529    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9h4t6"
Jul 15 16:17:29.541600 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:29.541559    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd" event={"ID":"14268f46-eab2-4460-b91c-6514fbe178e9","Type":"ContainerStarted","Data":"9201a8f62df6404914ad8fedf539de90baf5799033436a78d1c95e3d3fe67001"}
Jul 15 16:17:29.543085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:29.543056    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2mcwd" event={"ID":"6ed872cc-9c6b-45da-a3c9-0aae770f3972","Type":"ContainerStarted","Data":"b8230457c2236eed797d83c92e646aff187597487b81714aa270af0ed2f97718"}
Jul 15 16:17:29.543233 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:29.543142    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2mcwd"
Jul 15 16:17:29.545241 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:29.545213    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9" event={"ID":"7b51f1df-7742-4436-a75c-ada501f21600","Type":"ContainerStarted","Data":"2c2fea615fae6cc1b7650c0d24053945da20698b8bedb9ca74eaf315a5ad034f"}
Jul 15 16:17:29.545388 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:29.545254    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9" event={"ID":"7b51f1df-7742-4436-a75c-ada501f21600","Type":"ContainerStarted","Data":"b89f9507914985c93366bf96b6fcc1d87bd6584467fc1d3bd63cdcbf59be883e"}
Jul 15 16:17:29.545388 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:29.545272    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9" event={"ID":"7b51f1df-7742-4436-a75c-ada501f21600","Type":"ContainerStarted","Data":"438c38a780eb76e71c24c6fd1252ab90e2a30e933b11bf617e1b53df75933bc7"}
Jul 15 16:17:29.546861 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:29.546837    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t" event={"ID":"59094f94-b4f2-483b-adb1-b0bfb2b0f61f","Type":"ContainerStarted","Data":"42a242a981607dbc6be4a186010c704f8843cdb689f6109e87c7f230c4f80738"}
Jul 15 16:17:29.546977 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:29.546940    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t"
Jul 15 16:17:29.548475 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:29.548460    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t"
Jul 15 16:17:29.548650 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:29.548636    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2mcwd"
Jul 15 16:17:29.561286 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:29.561241    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7474fcd4bd-kjhgd" podStartSLOduration=1.697346085 podStartE2EDuration="7.561231074s" totalImagesPullingTime="5.863884989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:17:29.560691739 +0000 UTC m=+97.098517395" watchObservedRunningTime="2026-07-15 16:17:29.561231074 +0000 UTC m=+97.099056729"
Jul 15 16:17:29.582649 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:29.582613    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-867cdd8747-t5nb9" podStartSLOduration=1.735753664 podStartE2EDuration="7.582601028s" totalImagesPullingTime="5.846847364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:17:29.580729736 +0000 UTC m=+97.118555391" watchObservedRunningTime="2026-07-15 16:17:29.582601028 +0000 UTC m=+97.120426727"
Jul 15 16:17:29.601595 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:29.601550    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2mcwd" podStartSLOduration=1.825092573 podStartE2EDuration="7.601538448s" totalImagesPullingTime="5.776445875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:17:29.600907744 +0000 UTC m=+97.138733401" watchObservedRunningTime="2026-07-15 16:17:29.601538448 +0000 UTC m=+97.139364105"
Jul 15 16:17:29.618553 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:29.618509    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b785d979-ld78t" podStartSLOduration=1.801021065 podStartE2EDuration="7.618495978s" totalImagesPullingTime="5.817474913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:17:29.617645381 +0000 UTC m=+97.155471038" watchObservedRunningTime="2026-07-15 16:17:29.618495978 +0000 UTC m=+97.156321613"
Jul 15 16:17:29.857979 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:29.857943    2582 patch_prober.go:28] interesting pod/image-registry-7f4dc4b479-gmdpl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:17:29.858160 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:29.858003    2582 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl" podUID="d9072a46-a152-48d0-91bb-6625737e00bb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:17:31.393405 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:31.393378    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:17:38.971735 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:38.971709    2582 scope.go:117] "RemoveContainer" containerID="eaf1e9385443b1b1ef844ff474fa0231ed6a3686194605ef67601ef4b442b5a0"
Jul 15 16:17:39.587439 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:39.587410    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:17:39.587599 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:39.587475    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-l9sbq" event={"ID":"a65995fc-4690-4f8a-8cb6-222b26a0e514","Type":"ContainerStarted","Data":"66b7ee5f21bd33ac9b1aff94a3ac793eb1717495a666c4316339639d0111024a"}
Jul 15 16:17:39.587903 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:39.587872    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:17:39.616544 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:39.616496    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-l9sbq" podStartSLOduration=52.12798708 podStartE2EDuration="57.616482306s" totalImagesPullingTime="5.488495226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:16:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:17:39.614632564 +0000 UTC m=+107.152458254" watchObservedRunningTime="2026-07-15 16:17:39.616482306 +0000 UTC m=+107.154307969"
Jul 15 16:17:39.898839 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:39.898746    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-l9sbq"
Jul 15 16:17:40.289257 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.289220    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5fkr5"]
Jul 15 16:17:40.292999 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.292975    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.298851 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.298825    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 16:17:40.299451 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.299431    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6pvz6\""
Jul 15 16:17:40.299574 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.299432    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 16:17:40.300058 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.299980    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 16:17:40.300570 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.300552    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 16:17:40.385079 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.385051    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-accelerators-collector-config\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.385203 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.385083    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.385203 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.385108    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-textfile\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.385295 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.385198    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-wtmp\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.385295 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.385240    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-tls\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.385295 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.385258    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx5sw\" (UniqueName: \"kubernetes.io/projected/57dbb7d5-b0b6-4753-9279-7fb0402e4393-kube-api-access-nx5sw\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.385295 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.385275    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57dbb7d5-b0b6-4753-9279-7fb0402e4393-sys\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.385462 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.385316    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57dbb7d5-b0b6-4753-9279-7fb0402e4393-metrics-client-ca\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.385462 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.385370    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57dbb7d5-b0b6-4753-9279-7fb0402e4393-root\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.486595 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.486568    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-wtmp\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.486719 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.486603    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-tls\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.486719 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.486622    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx5sw\" (UniqueName: \"kubernetes.io/projected/57dbb7d5-b0b6-4753-9279-7fb0402e4393-kube-api-access-nx5sw\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.486719 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.486649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57dbb7d5-b0b6-4753-9279-7fb0402e4393-sys\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.486719 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.486673    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57dbb7d5-b0b6-4753-9279-7fb0402e4393-metrics-client-ca\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.486719 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.486690    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57dbb7d5-b0b6-4753-9279-7fb0402e4393-root\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.486974 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.486734    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57dbb7d5-b0b6-4753-9279-7fb0402e4393-sys\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.486974 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.486752    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-wtmp\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.486974 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:17:40.486736    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 15 16:17:40.486974 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.486771    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57dbb7d5-b0b6-4753-9279-7fb0402e4393-root\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.486974 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.486734    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-accelerators-collector-config\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.486974 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:17:40.486832    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-tls podName:57dbb7d5-b0b6-4753-9279-7fb0402e4393 nodeName:}" failed. No retries permitted until 2026-07-15 16:17:40.986805175 +0000 UTC m=+108.524630826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-tls") pod "node-exporter-5fkr5" (UID: "57dbb7d5-b0b6-4753-9279-7fb0402e4393") : secret "node-exporter-tls" not found
Jul 15 16:17:40.486974 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.486862    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.486974 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.486902    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-textfile\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.487285 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.487201    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57dbb7d5-b0b6-4753-9279-7fb0402e4393-metrics-client-ca\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.487325 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.487285    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-textfile\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.487378 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.487362    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-accelerators-collector-config\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.489157 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.489136    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.499510 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.499489    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx5sw\" (UniqueName: \"kubernetes.io/projected/57dbb7d5-b0b6-4753-9279-7fb0402e4393-kube-api-access-nx5sw\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.990801 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:40.990771    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-tls\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:40.990997 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:17:40.990891    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 15 16:17:40.990997 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:17:40.990943    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-tls podName:57dbb7d5-b0b6-4753-9279-7fb0402e4393 nodeName:}" failed. No retries permitted until 2026-07-15 16:17:41.990929046 +0000 UTC m=+109.528754681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-tls") pod "node-exporter-5fkr5" (UID: "57dbb7d5-b0b6-4753-9279-7fb0402e4393") : secret "node-exporter-tls" not found
Jul 15 16:17:42.001023 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:42.000990    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-tls\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:42.003264 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:42.003240    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57dbb7d5-b0b6-4753-9279-7fb0402e4393-node-exporter-tls\") pod \"node-exporter-5fkr5\" (UID: \"57dbb7d5-b0b6-4753-9279-7fb0402e4393\") " pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:42.103067 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:42.103038    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5fkr5"
Jul 15 16:17:42.114843 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:17:42.114819    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57dbb7d5_b0b6_4753_9279_7fb0402e4393.slice/crio-d486d99c38a721fd5525b3748f77164ed7cbab59fcf8ab608f4d0f7e78d75cfa WatchSource:0}: Error finding container d486d99c38a721fd5525b3748f77164ed7cbab59fcf8ab608f4d0f7e78d75cfa: Status 404 returned error can't find the container with id d486d99c38a721fd5525b3748f77164ed7cbab59fcf8ab608f4d0f7e78d75cfa
Jul 15 16:17:42.599016 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:42.598980    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5fkr5" event={"ID":"57dbb7d5-b0b6-4753-9279-7fb0402e4393","Type":"ContainerStarted","Data":"d486d99c38a721fd5525b3748f77164ed7cbab59fcf8ab608f4d0f7e78d75cfa"}
Jul 15 16:17:43.603920 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:43.603888    2582 generic.go:356] "Generic (PLEG): container finished" podID="57dbb7d5-b0b6-4753-9279-7fb0402e4393" containerID="72949d72d1d0ab2d2c4db3b818407d607be8c7c52b2ec9938b3ae368a7b1569a" exitCode=0
Jul 15 16:17:43.604248 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:43.603950    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5fkr5" event={"ID":"57dbb7d5-b0b6-4753-9279-7fb0402e4393","Type":"ContainerDied","Data":"72949d72d1d0ab2d2c4db3b818407d607be8c7c52b2ec9938b3ae368a7b1569a"}
Jul 15 16:17:44.610559 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:44.610524    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5fkr5" event={"ID":"57dbb7d5-b0b6-4753-9279-7fb0402e4393","Type":"ContainerStarted","Data":"8cda2698d704193082fddcdaf743eb12264c428b05175028816eddafa37757bd"}
Jul 15 16:17:44.610960 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:44.610575    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5fkr5" event={"ID":"57dbb7d5-b0b6-4753-9279-7fb0402e4393","Type":"ContainerStarted","Data":"d6b777b0da18d1a2fb7cf34d333d3ffc1a7cb219a9f9b6f23e4a846622f0b464"}
Jul 15 16:17:44.633286 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:44.633234    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5fkr5" podStartSLOduration=3.317628642 podStartE2EDuration="4.633218107s" totalImagesPullingTime="1.250893317s" totalInitContainerRuntime="64.696148ms" isStatefulPod=true podCreationTimestamp="2026-07-15 16:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:17:44.632326342 +0000 UTC m=+112.170152009" watchObservedRunningTime="2026-07-15 16:17:44.633218107 +0000 UTC m=+112.171043759"
Jul 15 16:17:51.165874 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:51.165835    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f4dc4b479-gmdpl"]
Jul 15 16:17:54.652244 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:54.652210    2582 generic.go:356] "Generic (PLEG): container finished" podID="58b7a5fa-4cb2-4ff8-a94f-07abb5198153" containerID="79aa6918e853744c129fe4df81751285f8df9f6e887286992fe0a55b76114f6c" exitCode=0
Jul 15 16:17:54.652645 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:54.652282    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf" event={"ID":"58b7a5fa-4cb2-4ff8-a94f-07abb5198153","Type":"ContainerDied","Data":"79aa6918e853744c129fe4df81751285f8df9f6e887286992fe0a55b76114f6c"}
Jul 15 16:17:54.652645 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:54.652620    2582 scope.go:117] "RemoveContainer" containerID="79aa6918e853744c129fe4df81751285f8df9f6e887286992fe0a55b76114f6c"
Jul 15 16:17:55.657940 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:55.657900    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8g4mf" event={"ID":"58b7a5fa-4cb2-4ff8-a94f-07abb5198153","Type":"ContainerStarted","Data":"f1706364c5db18458bfcd7c392fcaed6a53284831011a7d78eb66204aeffdca7"}
Jul 15 16:17:55.659437 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:55.659411    2582 generic.go:356] "Generic (PLEG): container finished" podID="15477e9c-792a-45bf-98c1-ff1bc1378da7" containerID="1655b10c04c974ce26c4d985bd1031621a36a147124fd563adbf79b453d07aa9" exitCode=0
Jul 15 16:17:55.659546 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:55.659474    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7" event={"ID":"15477e9c-792a-45bf-98c1-ff1bc1378da7","Type":"ContainerDied","Data":"1655b10c04c974ce26c4d985bd1031621a36a147124fd563adbf79b453d07aa9"}
Jul 15 16:17:55.659775 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:55.659762    2582 scope.go:117] "RemoveContainer" containerID="1655b10c04c974ce26c4d985bd1031621a36a147124fd563adbf79b453d07aa9"
Jul 15 16:17:56.669584 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:56.669549    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7cwq7" event={"ID":"15477e9c-792a-45bf-98c1-ff1bc1378da7","Type":"ContainerStarted","Data":"296a2644511aa464d0121efeab22cd3e9b31ff8155a9bcb3a55c4a88d2067665"}
Jul 15 16:17:59.685247 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:59.685162    2582 generic.go:356] "Generic (PLEG): container finished" podID="f230065a-93e1-408e-9062-6fab8596a024" containerID="936762fd6e1730efaae818dad579e8825b7b33b39173ac61a1c839aac13a8534" exitCode=0
Jul 15 16:17:59.685247 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:59.685235    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92" event={"ID":"f230065a-93e1-408e-9062-6fab8596a024","Type":"ContainerDied","Data":"936762fd6e1730efaae818dad579e8825b7b33b39173ac61a1c839aac13a8534"}
Jul 15 16:17:59.685646 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:17:59.685590    2582 scope.go:117] "RemoveContainer" containerID="936762fd6e1730efaae818dad579e8825b7b33b39173ac61a1c839aac13a8534"
Jul 15 16:18:00.690310 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:00.690273    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b6p92" event={"ID":"f230065a-93e1-408e-9062-6fab8596a024","Type":"ContainerStarted","Data":"f03669b6abcfd0ef5be6f77a33f976b1c85e6488756fcbf1a539a7569a7e6e54"}
Jul 15 16:18:01.880359 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:01.880299    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs\") pod \"network-metrics-daemon-ht28p\" (UID: \"e68bcad1-c436-4799-89f3-72d611f5716d\") " pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:18:01.882719 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:01.882696    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e68bcad1-c436-4799-89f3-72d611f5716d-metrics-certs\") pod \"network-metrics-daemon-ht28p\" (UID: \"e68bcad1-c436-4799-89f3-72d611f5716d\") " pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:18:01.990054 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:01.990020    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wsr6k\""
Jul 15 16:18:01.997316 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:01.997298    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht28p"
Jul 15 16:18:02.164377 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:02.164331    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ht28p"]
Jul 15 16:18:02.166364 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:18:02.166320    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68bcad1_c436_4799_89f3_72d611f5716d.slice/crio-f99ee6388a181092bd90c9d9a5ce1a174f3c5c00cb5e142487c1a5be6e1b3998 WatchSource:0}: Error finding container f99ee6388a181092bd90c9d9a5ce1a174f3c5c00cb5e142487c1a5be6e1b3998: Status 404 returned error can't find the container with id f99ee6388a181092bd90c9d9a5ce1a174f3c5c00cb5e142487c1a5be6e1b3998
Jul 15 16:18:02.699645 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:02.699606    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ht28p" event={"ID":"e68bcad1-c436-4799-89f3-72d611f5716d","Type":"ContainerStarted","Data":"f99ee6388a181092bd90c9d9a5ce1a174f3c5c00cb5e142487c1a5be6e1b3998"}
Jul 15 16:18:04.708715 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:04.708678    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ht28p" event={"ID":"e68bcad1-c436-4799-89f3-72d611f5716d","Type":"ContainerStarted","Data":"ed67181b4ff69f21bfa4ccb5bb7537b9f0066044fb83b25f3d9f4926823b5a73"}
Jul 15 16:18:04.709074 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:04.708737    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ht28p" event={"ID":"e68bcad1-c436-4799-89f3-72d611f5716d","Type":"ContainerStarted","Data":"11497ce3ccf216216328bd9590155599baf421016e217eedb03c5977421039d1"}
Jul 15 16:18:04.726742 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:04.726696    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ht28p" podStartSLOduration=129.559372995 podStartE2EDuration="2m11.726682016s" totalImagesPullingTime="2.167309021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:18:04.72515929 +0000 UTC m=+132.262984945" watchObservedRunningTime="2026-07-15 16:18:04.726682016 +0000 UTC m=+132.264507671"
Jul 15 16:18:16.186250 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.186207    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl" podUID="d9072a46-a152-48d0-91bb-6625737e00bb" containerName="registry" containerID="cri-o://c71c5b6c1dc065b168128991d68be2ee5aebe94de1788adb10bac91710c66c76" gracePeriod=30
Jul 15 16:18:16.434594 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.434569    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:18:16.496837 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.496811    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d9072a46-a152-48d0-91bb-6625737e00bb-image-registry-private-configuration\") pod \"d9072a46-a152-48d0-91bb-6625737e00bb\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") "
Jul 15 16:18:16.496955 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.496889    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d9072a46-a152-48d0-91bb-6625737e00bb-ca-trust-extracted\") pod \"d9072a46-a152-48d0-91bb-6625737e00bb\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") "
Jul 15 16:18:16.496955 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.496920    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls\") pod \"d9072a46-a152-48d0-91bb-6625737e00bb\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") "
Jul 15 16:18:16.496955 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.496951    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d9072a46-a152-48d0-91bb-6625737e00bb-installation-pull-secrets\") pod \"d9072a46-a152-48d0-91bb-6625737e00bb\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") "
Jul 15 16:18:16.497072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.496986    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d9072a46-a152-48d0-91bb-6625737e00bb-registry-certificates\") pod \"d9072a46-a152-48d0-91bb-6625737e00bb\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") "
Jul 15 16:18:16.497072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.497014    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9072a46-a152-48d0-91bb-6625737e00bb-trusted-ca\") pod \"d9072a46-a152-48d0-91bb-6625737e00bb\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") "
Jul 15 16:18:16.497072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.497041    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ls6c\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-kube-api-access-7ls6c\") pod \"d9072a46-a152-48d0-91bb-6625737e00bb\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") "
Jul 15 16:18:16.497637 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.497285    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-bound-sa-token\") pod \"d9072a46-a152-48d0-91bb-6625737e00bb\" (UID: \"d9072a46-a152-48d0-91bb-6625737e00bb\") "
Jul 15 16:18:16.497637 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.497455    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9072a46-a152-48d0-91bb-6625737e00bb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d9072a46-a152-48d0-91bb-6625737e00bb" (UID: "d9072a46-a152-48d0-91bb-6625737e00bb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:18:16.497637 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.497594    2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d9072a46-a152-48d0-91bb-6625737e00bb-registry-certificates\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:18:16.497817 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.497706    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9072a46-a152-48d0-91bb-6625737e00bb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d9072a46-a152-48d0-91bb-6625737e00bb" (UID: "d9072a46-a152-48d0-91bb-6625737e00bb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:18:16.499729 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.499700    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9072a46-a152-48d0-91bb-6625737e00bb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d9072a46-a152-48d0-91bb-6625737e00bb" (UID: "d9072a46-a152-48d0-91bb-6625737e00bb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:18:16.499819 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.499779    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9072a46-a152-48d0-91bb-6625737e00bb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d9072a46-a152-48d0-91bb-6625737e00bb" (UID: "d9072a46-a152-48d0-91bb-6625737e00bb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:18:16.499819 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.499790    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d9072a46-a152-48d0-91bb-6625737e00bb" (UID: "d9072a46-a152-48d0-91bb-6625737e00bb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:18:16.499907 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.499828    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-kube-api-access-7ls6c" (OuterVolumeSpecName: "kube-api-access-7ls6c") pod "d9072a46-a152-48d0-91bb-6625737e00bb" (UID: "d9072a46-a152-48d0-91bb-6625737e00bb"). InnerVolumeSpecName "kube-api-access-7ls6c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:18:16.499954 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.499928    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d9072a46-a152-48d0-91bb-6625737e00bb" (UID: "d9072a46-a152-48d0-91bb-6625737e00bb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:18:16.505505 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.505485    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9072a46-a152-48d0-91bb-6625737e00bb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d9072a46-a152-48d0-91bb-6625737e00bb" (UID: "d9072a46-a152-48d0-91bb-6625737e00bb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:18:16.597915 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.597892    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-registry-tls\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:18:16.597915 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.597912    2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d9072a46-a152-48d0-91bb-6625737e00bb-installation-pull-secrets\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:18:16.598032 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.597921    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9072a46-a152-48d0-91bb-6625737e00bb-trusted-ca\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:18:16.598032 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.597930    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ls6c\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-kube-api-access-7ls6c\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:18:16.598032 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.597939    2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9072a46-a152-48d0-91bb-6625737e00bb-bound-sa-token\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:18:16.598032 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.597948    2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d9072a46-a152-48d0-91bb-6625737e00bb-image-registry-private-configuration\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:18:16.598032 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.597958    2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d9072a46-a152-48d0-91bb-6625737e00bb-ca-trust-extracted\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:18:16.762384 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.762292    2582 generic.go:356] "Generic (PLEG): container finished" podID="d9072a46-a152-48d0-91bb-6625737e00bb" containerID="c71c5b6c1dc065b168128991d68be2ee5aebe94de1788adb10bac91710c66c76" exitCode=0
Jul 15 16:18:16.762384 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.762365    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl"
Jul 15 16:18:16.762502 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.762376    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl" event={"ID":"d9072a46-a152-48d0-91bb-6625737e00bb","Type":"ContainerDied","Data":"c71c5b6c1dc065b168128991d68be2ee5aebe94de1788adb10bac91710c66c76"}
Jul 15 16:18:16.762502 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.762456    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f4dc4b479-gmdpl" event={"ID":"d9072a46-a152-48d0-91bb-6625737e00bb","Type":"ContainerDied","Data":"6f775cdcd4be178cdb4ea0d3e1c16320162cb444176f706e65d9049ee7986b0f"}
Jul 15 16:18:16.762502 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.762478    2582 scope.go:117] "RemoveContainer" containerID="c71c5b6c1dc065b168128991d68be2ee5aebe94de1788adb10bac91710c66c76"
Jul 15 16:18:16.771206 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.771189    2582 scope.go:117] "RemoveContainer" containerID="c71c5b6c1dc065b168128991d68be2ee5aebe94de1788adb10bac91710c66c76"
Jul 15 16:18:16.771512 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:18:16.771479    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c71c5b6c1dc065b168128991d68be2ee5aebe94de1788adb10bac91710c66c76\": container with ID starting with c71c5b6c1dc065b168128991d68be2ee5aebe94de1788adb10bac91710c66c76 not found: ID does not exist" containerID="c71c5b6c1dc065b168128991d68be2ee5aebe94de1788adb10bac91710c66c76"
Jul 15 16:18:16.771600 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.771518    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c71c5b6c1dc065b168128991d68be2ee5aebe94de1788adb10bac91710c66c76"} err="failed to get container status \"c71c5b6c1dc065b168128991d68be2ee5aebe94de1788adb10bac91710c66c76\": rpc error: code = NotFound desc = could not find container \"c71c5b6c1dc065b168128991d68be2ee5aebe94de1788adb10bac91710c66c76\": container with ID starting with c71c5b6c1dc065b168128991d68be2ee5aebe94de1788adb10bac91710c66c76 not found: ID does not exist"
Jul 15 16:18:16.785088 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.785063    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f4dc4b479-gmdpl"]
Jul 15 16:18:16.787778 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.787757    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f4dc4b479-gmdpl"]
Jul 15 16:18:16.976483 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:18:16.976450    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9072a46-a152-48d0-91bb-6625737e00bb" path="/var/lib/kubelet/pods/d9072a46-a152-48d0-91bb-6625737e00bb/volumes"
Jul 15 16:20:52.881846 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:20:52.881813    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:20:52.889444 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:20:52.889402    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:20:52.889621 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:20:52.889584    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:20:52.893129 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:20:52.893106    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 16:20:52.897184 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:20:52.897161    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:23:07.426407 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.426372    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"]
Jul 15 16:23:07.426881 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.426676    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9072a46-a152-48d0-91bb-6625737e00bb" containerName="registry"
Jul 15 16:23:07.426881 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.426686    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9072a46-a152-48d0-91bb-6625737e00bb" containerName="registry"
Jul 15 16:23:07.426881 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.426734    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9072a46-a152-48d0-91bb-6625737e00bb" containerName="registry"
Jul 15 16:23:07.429638 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.429621    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:07.433701 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.433669    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 16:23:07.434046 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.434031    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 16:23:07.434317 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.434302    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tc9mh\""
Jul 15 16:23:07.434515 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.434502    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 16:23:07.436737 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.436713    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 16:23:07.459280 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.459257    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"]
Jul 15 16:23:07.475996 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.475973    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/53e5d08e-a974-475d-99c3-92e5a59e9197-webhook-cert\") pod \"opendatahub-operator-controller-manager-599cdff4cb-qv2vn\" (UID: \"53e5d08e-a974-475d-99c3-92e5a59e9197\") " pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:07.476109 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.476009    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/53e5d08e-a974-475d-99c3-92e5a59e9197-manifests\") pod \"opendatahub-operator-controller-manager-599cdff4cb-qv2vn\" (UID: \"53e5d08e-a974-475d-99c3-92e5a59e9197\") " pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:07.476109 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.476032    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n7ps\" (UniqueName: \"kubernetes.io/projected/53e5d08e-a974-475d-99c3-92e5a59e9197-kube-api-access-8n7ps\") pod \"opendatahub-operator-controller-manager-599cdff4cb-qv2vn\" (UID: \"53e5d08e-a974-475d-99c3-92e5a59e9197\") " pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:07.476222 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.476175    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/53e5d08e-a974-475d-99c3-92e5a59e9197-apiservice-cert\") pod \"opendatahub-operator-controller-manager-599cdff4cb-qv2vn\" (UID: \"53e5d08e-a974-475d-99c3-92e5a59e9197\") " pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:07.476273 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.476228    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53e5d08e-a974-475d-99c3-92e5a59e9197-tmp\") pod \"opendatahub-operator-controller-manager-599cdff4cb-qv2vn\" (UID: \"53e5d08e-a974-475d-99c3-92e5a59e9197\") " pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:07.577548 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.577526    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/53e5d08e-a974-475d-99c3-92e5a59e9197-manifests\") pod \"opendatahub-operator-controller-manager-599cdff4cb-qv2vn\" (UID: \"53e5d08e-a974-475d-99c3-92e5a59e9197\") " pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:07.577654 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.577554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n7ps\" (UniqueName: \"kubernetes.io/projected/53e5d08e-a974-475d-99c3-92e5a59e9197-kube-api-access-8n7ps\") pod \"opendatahub-operator-controller-manager-599cdff4cb-qv2vn\" (UID: \"53e5d08e-a974-475d-99c3-92e5a59e9197\") " pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:07.577703 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.577683    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/53e5d08e-a974-475d-99c3-92e5a59e9197-apiservice-cert\") pod \"opendatahub-operator-controller-manager-599cdff4cb-qv2vn\" (UID: \"53e5d08e-a974-475d-99c3-92e5a59e9197\") " pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:07.577742 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.577733    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53e5d08e-a974-475d-99c3-92e5a59e9197-tmp\") pod \"opendatahub-operator-controller-manager-599cdff4cb-qv2vn\" (UID: \"53e5d08e-a974-475d-99c3-92e5a59e9197\") " pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:07.577785 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.577762    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/53e5d08e-a974-475d-99c3-92e5a59e9197-webhook-cert\") pod \"opendatahub-operator-controller-manager-599cdff4cb-qv2vn\" (UID: \"53e5d08e-a974-475d-99c3-92e5a59e9197\") " pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:07.577941 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.577919    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/53e5d08e-a974-475d-99c3-92e5a59e9197-manifests\") pod \"opendatahub-operator-controller-manager-599cdff4cb-qv2vn\" (UID: \"53e5d08e-a974-475d-99c3-92e5a59e9197\") " pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:07.580037 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.580009    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53e5d08e-a974-475d-99c3-92e5a59e9197-tmp\") pod \"opendatahub-operator-controller-manager-599cdff4cb-qv2vn\" (UID: \"53e5d08e-a974-475d-99c3-92e5a59e9197\") " pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:07.580259 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.580237    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/53e5d08e-a974-475d-99c3-92e5a59e9197-webhook-cert\") pod \"opendatahub-operator-controller-manager-599cdff4cb-qv2vn\" (UID: \"53e5d08e-a974-475d-99c3-92e5a59e9197\") " pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:07.580303 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.580237    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/53e5d08e-a974-475d-99c3-92e5a59e9197-apiservice-cert\") pod \"opendatahub-operator-controller-manager-599cdff4cb-qv2vn\" (UID: \"53e5d08e-a974-475d-99c3-92e5a59e9197\") " pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:07.587736 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.587712    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n7ps\" (UniqueName: \"kubernetes.io/projected/53e5d08e-a974-475d-99c3-92e5a59e9197-kube-api-access-8n7ps\") pod \"opendatahub-operator-controller-manager-599cdff4cb-qv2vn\" (UID: \"53e5d08e-a974-475d-99c3-92e5a59e9197\") " pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:07.740072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.740045    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:07.888666 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.888643    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"]
Jul 15 16:23:07.890041 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:23:07.890017    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e5d08e_a974_475d_99c3_92e5a59e9197.slice/crio-4383583032cb572286fff7b6e88ca602ab52535efe264b35928cf36c5a47dc8e WatchSource:0}: Error finding container 4383583032cb572286fff7b6e88ca602ab52535efe264b35928cf36c5a47dc8e: Status 404 returned error can't find the container with id 4383583032cb572286fff7b6e88ca602ab52535efe264b35928cf36c5a47dc8e
Jul 15 16:23:07.891800 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:07.891782    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 16:23:08.885189 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:08.885152    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn" event={"ID":"53e5d08e-a974-475d-99c3-92e5a59e9197","Type":"ContainerStarted","Data":"4383583032cb572286fff7b6e88ca602ab52535efe264b35928cf36c5a47dc8e"}
Jul 15 16:23:11.901134 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:11.901096    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn" event={"ID":"53e5d08e-a974-475d-99c3-92e5a59e9197","Type":"ContainerStarted","Data":"c5f4060abd10cdbd124886d12cae80413a6522dcf479e11fd4d9ed3d1c1316d2"}
Jul 15 16:23:12.907175 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:12.907090    2582 generic.go:356] "Generic (PLEG): container finished" podID="53e5d08e-a974-475d-99c3-92e5a59e9197" containerID="c5f4060abd10cdbd124886d12cae80413a6522dcf479e11fd4d9ed3d1c1316d2" exitCode=0
Jul 15 16:23:12.907175 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:12.907130    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn" event={"ID":"53e5d08e-a974-475d-99c3-92e5a59e9197","Type":"ContainerDied","Data":"c5f4060abd10cdbd124886d12cae80413a6522dcf479e11fd4d9ed3d1c1316d2"}
Jul 15 16:23:13.913621 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:13.913585    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn" event={"ID":"53e5d08e-a974-475d-99c3-92e5a59e9197","Type":"ContainerStarted","Data":"b55d5fad10f137ff8da0abfe6d028f2946898ec81b4472e8a06d9f6b674f0790"}
Jul 15 16:23:13.914035 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:13.913694    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:13.948391 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:13.948321    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn" podStartSLOduration=2.046197717 podStartE2EDuration="6.948307704s" totalImagesPullingTime="3.841013672s" totalInitContainerRuntime="1.061096315s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:23:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:23:13.946059833 +0000 UTC m=+441.483885489" watchObservedRunningTime="2026-07-15 16:23:13.948307704 +0000 UTC m=+441.486133360"
Jul 15 16:23:24.920289 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:24.920212    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-599cdff4cb-qv2vn"
Jul 15 16:23:36.224191 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.224153    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"]
Jul 15 16:23:36.235931 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.235904    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"
Jul 15 16:23:36.239710 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.239687    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 16:23:36.240208 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.240120    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 16:23:36.240433 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.240418    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 16:23:36.240642 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.240619    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 16:23:36.240779 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.240677    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4frs9\""
Jul 15 16:23:36.241409 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.241393    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 16:23:36.241486 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.241398    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"]
Jul 15 16:23:36.406932 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.406892    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/480ea93e-822f-4796-bdde-fd5bd11d86be-manager-config\") pod \"lws-controller-manager-5f875d5cd5-qbqll\" (UID: \"480ea93e-822f-4796-bdde-fd5bd11d86be\") " pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"
Jul 15 16:23:36.407100 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.406977    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/480ea93e-822f-4796-bdde-fd5bd11d86be-metrics-cert\") pod \"lws-controller-manager-5f875d5cd5-qbqll\" (UID: \"480ea93e-822f-4796-bdde-fd5bd11d86be\") " pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"
Jul 15 16:23:36.407100 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.407030    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/480ea93e-822f-4796-bdde-fd5bd11d86be-cert\") pod \"lws-controller-manager-5f875d5cd5-qbqll\" (UID: \"480ea93e-822f-4796-bdde-fd5bd11d86be\") " pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"
Jul 15 16:23:36.407100 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.407084    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txbms\" (UniqueName: \"kubernetes.io/projected/480ea93e-822f-4796-bdde-fd5bd11d86be-kube-api-access-txbms\") pod \"lws-controller-manager-5f875d5cd5-qbqll\" (UID: \"480ea93e-822f-4796-bdde-fd5bd11d86be\") " pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"
Jul 15 16:23:36.507964 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.507893    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/480ea93e-822f-4796-bdde-fd5bd11d86be-manager-config\") pod \"lws-controller-manager-5f875d5cd5-qbqll\" (UID: \"480ea93e-822f-4796-bdde-fd5bd11d86be\") " pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"
Jul 15 16:23:36.507964 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.507943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/480ea93e-822f-4796-bdde-fd5bd11d86be-metrics-cert\") pod \"lws-controller-manager-5f875d5cd5-qbqll\" (UID: \"480ea93e-822f-4796-bdde-fd5bd11d86be\") " pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"
Jul 15 16:23:36.508138 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.507980    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/480ea93e-822f-4796-bdde-fd5bd11d86be-cert\") pod \"lws-controller-manager-5f875d5cd5-qbqll\" (UID: \"480ea93e-822f-4796-bdde-fd5bd11d86be\") " pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"
Jul 15 16:23:36.508138 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.508003    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txbms\" (UniqueName: \"kubernetes.io/projected/480ea93e-822f-4796-bdde-fd5bd11d86be-kube-api-access-txbms\") pod \"lws-controller-manager-5f875d5cd5-qbqll\" (UID: \"480ea93e-822f-4796-bdde-fd5bd11d86be\") " pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"
Jul 15 16:23:36.508697 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.508668    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/480ea93e-822f-4796-bdde-fd5bd11d86be-manager-config\") pod \"lws-controller-manager-5f875d5cd5-qbqll\" (UID: \"480ea93e-822f-4796-bdde-fd5bd11d86be\") " pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"
Jul 15 16:23:36.510451 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.510421    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/480ea93e-822f-4796-bdde-fd5bd11d86be-metrics-cert\") pod \"lws-controller-manager-5f875d5cd5-qbqll\" (UID: \"480ea93e-822f-4796-bdde-fd5bd11d86be\") " pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"
Jul 15 16:23:36.510598 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.510577    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/480ea93e-822f-4796-bdde-fd5bd11d86be-cert\") pod \"lws-controller-manager-5f875d5cd5-qbqll\" (UID: \"480ea93e-822f-4796-bdde-fd5bd11d86be\") " pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"
Jul 15 16:23:36.519207 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.519184    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txbms\" (UniqueName: \"kubernetes.io/projected/480ea93e-822f-4796-bdde-fd5bd11d86be-kube-api-access-txbms\") pod \"lws-controller-manager-5f875d5cd5-qbqll\" (UID: \"480ea93e-822f-4796-bdde-fd5bd11d86be\") " pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"
Jul 15 16:23:36.546046 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.546024    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"
Jul 15 16:23:36.691244 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:36.691212    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"]
Jul 15 16:23:36.694820 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:23:36.694792    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod480ea93e_822f_4796_bdde_fd5bd11d86be.slice/crio-25000bb11b45979a64cf16136f16b47bb76c0a68798d7b371dd0af53c0a1bb75 WatchSource:0}: Error finding container 25000bb11b45979a64cf16136f16b47bb76c0a68798d7b371dd0af53c0a1bb75: Status 404 returned error can't find the container with id 25000bb11b45979a64cf16136f16b47bb76c0a68798d7b371dd0af53c0a1bb75
Jul 15 16:23:37.012326 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:37.012293    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll" event={"ID":"480ea93e-822f-4796-bdde-fd5bd11d86be","Type":"ContainerStarted","Data":"25000bb11b45979a64cf16136f16b47bb76c0a68798d7b371dd0af53c0a1bb75"}
Jul 15 16:23:39.649914 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.649875    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dv5mc"]
Jul 15 16:23:39.653187 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.653170    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-59ng9"]
Jul 15 16:23:39.653357 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.653316    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dv5mc"
Jul 15 16:23:39.656494 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.656472    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-59ng9"
Jul 15 16:23:39.657939 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.657920    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 15 16:23:39.658060 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.658018    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qx9jz\""
Jul 15 16:23:39.659026 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.659011    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 15 16:23:39.659117 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.659044    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-mrdjr\""
Jul 15 16:23:39.669515 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.669452    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dv5mc"]
Jul 15 16:23:39.671559 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.671539    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-59ng9"]
Jul 15 16:23:39.839985 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.839946    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad418358-b34a-4f07-aa3d-76eeebdf1e0e-cert\") pod \"kserve-controller-manager-d6f4b65b8-dv5mc\" (UID: \"ad418358-b34a-4f07-aa3d-76eeebdf1e0e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dv5mc"
Jul 15 16:23:39.840178 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.839982    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbb94\" (UniqueName: \"kubernetes.io/projected/ad418358-b34a-4f07-aa3d-76eeebdf1e0e-kube-api-access-kbb94\") pod \"kserve-controller-manager-d6f4b65b8-dv5mc\" (UID: \"ad418358-b34a-4f07-aa3d-76eeebdf1e0e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dv5mc"
Jul 15 16:23:39.840178 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.840051    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzvq8\" (UniqueName: \"kubernetes.io/projected/2b96215f-59cb-4980-a61d-c082e3d457dc-kube-api-access-wzvq8\") pod \"llmisvc-controller-manager-777c6bd7d5-59ng9\" (UID: \"2b96215f-59cb-4980-a61d-c082e3d457dc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-59ng9"
Jul 15 16:23:39.840178 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.840097    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b96215f-59cb-4980-a61d-c082e3d457dc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-59ng9\" (UID: \"2b96215f-59cb-4980-a61d-c082e3d457dc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-59ng9"
Jul 15 16:23:39.940478 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.940446    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbb94\" (UniqueName: \"kubernetes.io/projected/ad418358-b34a-4f07-aa3d-76eeebdf1e0e-kube-api-access-kbb94\") pod \"kserve-controller-manager-d6f4b65b8-dv5mc\" (UID: \"ad418358-b34a-4f07-aa3d-76eeebdf1e0e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dv5mc"
Jul 15 16:23:39.940637 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.940490    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzvq8\" (UniqueName: \"kubernetes.io/projected/2b96215f-59cb-4980-a61d-c082e3d457dc-kube-api-access-wzvq8\") pod \"llmisvc-controller-manager-777c6bd7d5-59ng9\" (UID: \"2b96215f-59cb-4980-a61d-c082e3d457dc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-59ng9"
Jul 15 16:23:39.940637 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.940526    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b96215f-59cb-4980-a61d-c082e3d457dc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-59ng9\" (UID: \"2b96215f-59cb-4980-a61d-c082e3d457dc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-59ng9"
Jul 15 16:23:39.940637 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.940566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad418358-b34a-4f07-aa3d-76eeebdf1e0e-cert\") pod \"kserve-controller-manager-d6f4b65b8-dv5mc\" (UID: \"ad418358-b34a-4f07-aa3d-76eeebdf1e0e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dv5mc"
Jul 15 16:23:39.940754 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:23:39.940728    2582 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 15 16:23:39.940819 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:23:39.940806    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b96215f-59cb-4980-a61d-c082e3d457dc-cert podName:2b96215f-59cb-4980-a61d-c082e3d457dc nodeName:}" failed. No retries permitted until 2026-07-15 16:23:40.440776238 +0000 UTC m=+467.978601883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2b96215f-59cb-4980-a61d-c082e3d457dc-cert") pod "llmisvc-controller-manager-777c6bd7d5-59ng9" (UID: "2b96215f-59cb-4980-a61d-c082e3d457dc") : secret "llmisvc-webhook-server-cert" not found
Jul 15 16:23:39.942991 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.942957    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad418358-b34a-4f07-aa3d-76eeebdf1e0e-cert\") pod \"kserve-controller-manager-d6f4b65b8-dv5mc\" (UID: \"ad418358-b34a-4f07-aa3d-76eeebdf1e0e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dv5mc"
Jul 15 16:23:39.954947 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.954917    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbb94\" (UniqueName: \"kubernetes.io/projected/ad418358-b34a-4f07-aa3d-76eeebdf1e0e-kube-api-access-kbb94\") pod \"kserve-controller-manager-d6f4b65b8-dv5mc\" (UID: \"ad418358-b34a-4f07-aa3d-76eeebdf1e0e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dv5mc"
Jul 15 16:23:39.955410 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.955379    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzvq8\" (UniqueName: \"kubernetes.io/projected/2b96215f-59cb-4980-a61d-c082e3d457dc-kube-api-access-wzvq8\") pod \"llmisvc-controller-manager-777c6bd7d5-59ng9\" (UID: \"2b96215f-59cb-4980-a61d-c082e3d457dc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-59ng9"
Jul 15 16:23:39.968179 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:39.968159    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dv5mc"
Jul 15 16:23:40.030842 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:40.030807    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll" event={"ID":"480ea93e-822f-4796-bdde-fd5bd11d86be","Type":"ContainerStarted","Data":"81409eca3bd0efe2aea2a325e90964d6e3fc7c47cf9a2e7c140fc1adc69477f3"}
Jul 15 16:23:40.031680 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:40.031624    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"
Jul 15 16:23:40.076554 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:40.076496    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll" podStartSLOduration=1.346737537 podStartE2EDuration="4.076475516s" totalImagesPullingTime="2.729737979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:23:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:23:40.07627634 +0000 UTC m=+467.614102008" watchObservedRunningTime="2026-07-15 16:23:40.076475516 +0000 UTC m=+467.614301172"
Jul 15 16:23:40.320369 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:40.320332    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dv5mc"]
Jul 15 16:23:40.321631 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:23:40.321611    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad418358_b34a_4f07_aa3d_76eeebdf1e0e.slice/crio-86a6a0765283b65992a4ffab48228f27da44c308e582b667d92ceebaca14ed02 WatchSource:0}: Error finding container 86a6a0765283b65992a4ffab48228f27da44c308e582b667d92ceebaca14ed02: Status 404 returned error can't find the container with id 86a6a0765283b65992a4ffab48228f27da44c308e582b667d92ceebaca14ed02
Jul 15 16:23:40.444616 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:40.444584    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b96215f-59cb-4980-a61d-c082e3d457dc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-59ng9\" (UID: \"2b96215f-59cb-4980-a61d-c082e3d457dc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-59ng9"
Jul 15 16:23:40.446892 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:40.446874    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b96215f-59cb-4980-a61d-c082e3d457dc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-59ng9\" (UID: \"2b96215f-59cb-4980-a61d-c082e3d457dc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-59ng9"
Jul 15 16:23:40.577801 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:40.577733    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-59ng9"
Jul 15 16:23:40.707556 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:40.707531    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-59ng9"]
Jul 15 16:23:40.708583 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:23:40.708559    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2b96215f_59cb_4980_a61d_c082e3d457dc.slice/crio-204a15a612f256cf5b78d88b9ae92d3ecd5137e215696bf5b568825a7a04cb2d WatchSource:0}: Error finding container 204a15a612f256cf5b78d88b9ae92d3ecd5137e215696bf5b568825a7a04cb2d: Status 404 returned error can't find the container with id 204a15a612f256cf5b78d88b9ae92d3ecd5137e215696bf5b568825a7a04cb2d
Jul 15 16:23:41.035415 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:41.035369    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-59ng9" event={"ID":"2b96215f-59cb-4980-a61d-c082e3d457dc","Type":"ContainerStarted","Data":"204a15a612f256cf5b78d88b9ae92d3ecd5137e215696bf5b568825a7a04cb2d"}
Jul 15 16:23:41.036396 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:41.036368    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dv5mc" event={"ID":"ad418358-b34a-4f07-aa3d-76eeebdf1e0e","Type":"ContainerStarted","Data":"86a6a0765283b65992a4ffab48228f27da44c308e582b667d92ceebaca14ed02"}
Jul 15 16:23:45.055939 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:45.055902    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-59ng9" event={"ID":"2b96215f-59cb-4980-a61d-c082e3d457dc","Type":"ContainerStarted","Data":"7db4645e6a0bab3a1b61b34dc3b787b24cfc751d132f7feb777fb5ea40cdcf8f"}
Jul 15 16:23:45.056433 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:45.055966    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-59ng9"
Jul 15 16:23:45.057425 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:45.057392    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dv5mc" event={"ID":"ad418358-b34a-4f07-aa3d-76eeebdf1e0e","Type":"ContainerStarted","Data":"fe444b4b7c3d603ce91b3e6f05e2ccb37b01d0f2716ab508c670e27985d1d2b3"}
Jul 15 16:23:45.057552 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:45.057482    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dv5mc"
Jul 15 16:23:45.076451 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:45.076411    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-59ng9" podStartSLOduration=2.373110296 podStartE2EDuration="6.076397472s" totalImagesPullingTime="3.703287176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:23:45.075794451 +0000 UTC m=+472.613620108" watchObservedRunningTime="2026-07-15 16:23:45.076397472 +0000 UTC m=+472.614223176"
Jul 15 16:23:45.096588 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:45.096549    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dv5mc" podStartSLOduration=2.010712944 podStartE2EDuration="6.096536815s" totalImagesPullingTime="4.085823871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:23:45.094234994 +0000 UTC m=+472.632060652" watchObservedRunningTime="2026-07-15 16:23:45.096536815 +0000 UTC m=+472.634362471"
Jul 15 16:23:52.044125 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:23:52.044092    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5f875d5cd5-qbqll"
Jul 15 16:24:16.064019 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:24:16.063987    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-59ng9"
Jul 15 16:24:16.067178 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:24:16.067160    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dv5mc"
Jul 15 16:25:37.312512 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:37.312478    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"]
Jul 15 16:25:37.315731 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:37.315713    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"
Jul 15 16:25:37.319495 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:37.319473    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 16:25:37.319907 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:37.319884    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 16:25:37.327328 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:37.327310    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lbnzn\""
Jul 15 16:25:37.346664 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:37.346636    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"]
Jul 15 16:25:37.368795 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:37.368764    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c99bebd0-a013-42ca-ace8-a6a00a052a47-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ksxcp\" (UID: \"c99bebd0-a013-42ca-ace8-a6a00a052a47\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"
Jul 15 16:25:37.368909 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:37.368815    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxcwp\" (UniqueName: \"kubernetes.io/projected/c99bebd0-a013-42ca-ace8-a6a00a052a47-kube-api-access-hxcwp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ksxcp\" (UID: \"c99bebd0-a013-42ca-ace8-a6a00a052a47\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"
Jul 15 16:25:37.469708 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:37.469672    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxcwp\" (UniqueName: \"kubernetes.io/projected/c99bebd0-a013-42ca-ace8-a6a00a052a47-kube-api-access-hxcwp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ksxcp\" (UID: \"c99bebd0-a013-42ca-ace8-a6a00a052a47\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"
Jul 15 16:25:37.469885 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:37.469746    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c99bebd0-a013-42ca-ace8-a6a00a052a47-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ksxcp\" (UID: \"c99bebd0-a013-42ca-ace8-a6a00a052a47\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"
Jul 15 16:25:37.470101 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:37.470083    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c99bebd0-a013-42ca-ace8-a6a00a052a47-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ksxcp\" (UID: \"c99bebd0-a013-42ca-ace8-a6a00a052a47\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"
Jul 15 16:25:37.482054 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:37.482026    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxcwp\" (UniqueName: \"kubernetes.io/projected/c99bebd0-a013-42ca-ace8-a6a00a052a47-kube-api-access-hxcwp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ksxcp\" (UID: \"c99bebd0-a013-42ca-ace8-a6a00a052a47\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"
Jul 15 16:25:37.547456 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:37.547425    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"]
Jul 15 16:25:37.547707 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:37.547694    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"
Jul 15 16:25:37.688761 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:37.688721    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"]
Jul 15 16:25:37.691205 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:25:37.691175    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99bebd0_a013_42ca_ace8_a6a00a052a47.slice/crio-751bb1a4b8d73aee77dd17bfa5b67c30b1e34fb49eb6a5875c26bc36965ef28d WatchSource:0}: Error finding container 751bb1a4b8d73aee77dd17bfa5b67c30b1e34fb49eb6a5875c26bc36965ef28d: Status 404 returned error can't find the container with id 751bb1a4b8d73aee77dd17bfa5b67c30b1e34fb49eb6a5875c26bc36965ef28d
Jul 15 16:25:37.941048 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:37.940966    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"]
Jul 15 16:25:37.958799 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:37.958766    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"]
Jul 15 16:25:38.014954 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:38.014923    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk"]
Jul 15 16:25:38.019278 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:38.019256    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk"
Jul 15 16:25:38.036906 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:38.036877    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk"]
Jul 15 16:25:38.075377 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:38.075345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aef6f874-1d2c-45bc-86b9-556f053f4801-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ldzsk\" (UID: \"aef6f874-1d2c-45bc-86b9-556f053f4801\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk"
Jul 15 16:25:38.075538 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:38.075422    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9266q\" (UniqueName: \"kubernetes.io/projected/aef6f874-1d2c-45bc-86b9-556f053f4801-kube-api-access-9266q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ldzsk\" (UID: \"aef6f874-1d2c-45bc-86b9-556f053f4801\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk"
Jul 15 16:25:38.176670 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:38.176573    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aef6f874-1d2c-45bc-86b9-556f053f4801-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ldzsk\" (UID: \"aef6f874-1d2c-45bc-86b9-556f053f4801\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk"
Jul 15 16:25:38.176851 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:38.176740    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9266q\" (UniqueName: \"kubernetes.io/projected/aef6f874-1d2c-45bc-86b9-556f053f4801-kube-api-access-9266q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ldzsk\" (UID: \"aef6f874-1d2c-45bc-86b9-556f053f4801\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk"
Jul 15 16:25:38.176932 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:38.176905    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aef6f874-1d2c-45bc-86b9-556f053f4801-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ldzsk\" (UID: \"aef6f874-1d2c-45bc-86b9-556f053f4801\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk"
Jul 15 16:25:38.193758 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:38.193696    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9266q\" (UniqueName: \"kubernetes.io/projected/aef6f874-1d2c-45bc-86b9-556f053f4801-kube-api-access-9266q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ldzsk\" (UID: \"aef6f874-1d2c-45bc-86b9-556f053f4801\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk"
Jul 15 16:25:38.330924 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:38.330889    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk"
Jul 15 16:25:38.819433 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:38.819363    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk"]
Jul 15 16:25:38.945440 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:25:38.945358    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaef6f874_1d2c_45bc_86b9_556f053f4801.slice/crio-e179e68253feec03c1db2ca62cfc49e6a019d46365bfa1eaf0b4505361d8cfd4 WatchSource:0}: Error finding container e179e68253feec03c1db2ca62cfc49e6a019d46365bfa1eaf0b4505361d8cfd4: Status 404 returned error can't find the container with id e179e68253feec03c1db2ca62cfc49e6a019d46365bfa1eaf0b4505361d8cfd4
Jul 15 16:25:39.559529 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:39.559477    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk" event={"ID":"aef6f874-1d2c-45bc-86b9-556f053f4801","Type":"ContainerStarted","Data":"e179e68253feec03c1db2ca62cfc49e6a019d46365bfa1eaf0b4505361d8cfd4"}
Jul 15 16:25:42.577764 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:42.577679    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp" podUID="c99bebd0-a013-42ca-ace8-a6a00a052a47" containerName="manager" containerID="cri-o://c27ea8521808fe04260ff5118ac456749e094575a925d57522740954eb9ee630" gracePeriod=2
Jul 15 16:25:42.579473 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:42.579445    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk" event={"ID":"aef6f874-1d2c-45bc-86b9-556f053f4801","Type":"ContainerStarted","Data":"5c6a18b211ebd64f2f994263797512846bb579db6bbea29e045cdd17a0cb81e7"}
Jul 15 16:25:42.579614 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:42.579517    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk"
Jul 15 16:25:42.607553 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:42.607505    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk" podStartSLOduration=2.342593568 podStartE2EDuration="5.607487829s" totalImagesPullingTime="3.264894261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:25:42.605043334 +0000 UTC m=+590.142868990" watchObservedRunningTime="2026-07-15 16:25:42.607487829 +0000 UTC m=+590.145313484"
Jul 15 16:25:42.823523 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:42.823499    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"
Jul 15 16:25:42.825933 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:25:42.825905    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ksxcp\" is forbidden: User \"system:node:ip-10-0-141-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-253.ec2.internal' and this object" podUID="c99bebd0-a013-42ca-ace8-a6a00a052a47" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"
Jul 15 16:25:42.921448 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:42.921324    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxcwp\" (UniqueName: \"kubernetes.io/projected/c99bebd0-a013-42ca-ace8-a6a00a052a47-kube-api-access-hxcwp\") pod \"c99bebd0-a013-42ca-ace8-a6a00a052a47\" (UID: \"c99bebd0-a013-42ca-ace8-a6a00a052a47\") "
Jul 15 16:25:42.921448 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:42.921446    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c99bebd0-a013-42ca-ace8-a6a00a052a47-extensions-socket-volume\") pod \"c99bebd0-a013-42ca-ace8-a6a00a052a47\" (UID: \"c99bebd0-a013-42ca-ace8-a6a00a052a47\") "
Jul 15 16:25:42.921699 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:42.921669    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c99bebd0-a013-42ca-ace8-a6a00a052a47-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c99bebd0-a013-42ca-ace8-a6a00a052a47" (UID: "c99bebd0-a013-42ca-ace8-a6a00a052a47"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:25:42.923522 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:42.923501    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c99bebd0-a013-42ca-ace8-a6a00a052a47-kube-api-access-hxcwp" (OuterVolumeSpecName: "kube-api-access-hxcwp") pod "c99bebd0-a013-42ca-ace8-a6a00a052a47" (UID: "c99bebd0-a013-42ca-ace8-a6a00a052a47"). InnerVolumeSpecName "kube-api-access-hxcwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:25:42.977302 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:25:42.977262    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ksxcp\" is forbidden: User \"system:node:ip-10-0-141-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-253.ec2.internal' and this object" podUID="c99bebd0-a013-42ca-ace8-a6a00a052a47" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"
Jul 15 16:25:42.978790 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:42.978762    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c99bebd0-a013-42ca-ace8-a6a00a052a47" path="/var/lib/kubelet/pods/c99bebd0-a013-42ca-ace8-a6a00a052a47/volumes"
Jul 15 16:25:43.022248 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:43.022213    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c99bebd0-a013-42ca-ace8-a6a00a052a47-extensions-socket-volume\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:25:43.022248 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:43.022246    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxcwp\" (UniqueName: \"kubernetes.io/projected/c99bebd0-a013-42ca-ace8-a6a00a052a47-kube-api-access-hxcwp\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:25:43.585180 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:43.585089    2582 generic.go:356] "Generic (PLEG): container finished" podID="c99bebd0-a013-42ca-ace8-a6a00a052a47" containerID="c27ea8521808fe04260ff5118ac456749e094575a925d57522740954eb9ee630" exitCode=2
Jul 15 16:25:43.585180 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:43.585131    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"
Jul 15 16:25:43.585714 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:43.585186    2582 scope.go:117] "RemoveContainer" containerID="c27ea8521808fe04260ff5118ac456749e094575a925d57522740954eb9ee630"
Jul 15 16:25:43.589970 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:25:43.589942    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ksxcp\" is forbidden: User \"system:node:ip-10-0-141-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-253.ec2.internal' and this object" podUID="c99bebd0-a013-42ca-ace8-a6a00a052a47" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ksxcp"
Jul 15 16:25:43.593704 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:43.593684    2582 scope.go:117] "RemoveContainer" containerID="c27ea8521808fe04260ff5118ac456749e094575a925d57522740954eb9ee630"
Jul 15 16:25:43.593960 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:25:43.593942    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c27ea8521808fe04260ff5118ac456749e094575a925d57522740954eb9ee630\": container with ID starting with c27ea8521808fe04260ff5118ac456749e094575a925d57522740954eb9ee630 not found: ID does not exist" containerID="c27ea8521808fe04260ff5118ac456749e094575a925d57522740954eb9ee630"
Jul 15 16:25:43.594005 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:43.593970    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c27ea8521808fe04260ff5118ac456749e094575a925d57522740954eb9ee630"} err="failed to get container status \"c27ea8521808fe04260ff5118ac456749e094575a925d57522740954eb9ee630\": rpc error: code = NotFound desc = could not find container \"c27ea8521808fe04260ff5118ac456749e094575a925d57522740954eb9ee630\": container with ID starting with c27ea8521808fe04260ff5118ac456749e094575a925d57522740954eb9ee630 not found: ID does not exist"
Jul 15 16:25:50.111281 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.111243    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk"]
Jul 15 16:25:50.111773 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.111446    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk" podUID="aef6f874-1d2c-45bc-86b9-556f053f4801" containerName="manager" containerID="cri-o://5c6a18b211ebd64f2f994263797512846bb579db6bbea29e045cdd17a0cb81e7" gracePeriod=10
Jul 15 16:25:50.113451 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.113427    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk"
Jul 15 16:25:50.361127 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.361099    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk"
Jul 15 16:25:50.486929 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.486899    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aef6f874-1d2c-45bc-86b9-556f053f4801-extensions-socket-volume\") pod \"aef6f874-1d2c-45bc-86b9-556f053f4801\" (UID: \"aef6f874-1d2c-45bc-86b9-556f053f4801\") "
Jul 15 16:25:50.487117 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.487015    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9266q\" (UniqueName: \"kubernetes.io/projected/aef6f874-1d2c-45bc-86b9-556f053f4801-kube-api-access-9266q\") pod \"aef6f874-1d2c-45bc-86b9-556f053f4801\" (UID: \"aef6f874-1d2c-45bc-86b9-556f053f4801\") "
Jul 15 16:25:50.487487 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.487464    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aef6f874-1d2c-45bc-86b9-556f053f4801-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aef6f874-1d2c-45bc-86b9-556f053f4801" (UID: "aef6f874-1d2c-45bc-86b9-556f053f4801"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:25:50.489191 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.489162    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aef6f874-1d2c-45bc-86b9-556f053f4801-kube-api-access-9266q" (OuterVolumeSpecName: "kube-api-access-9266q") pod "aef6f874-1d2c-45bc-86b9-556f053f4801" (UID: "aef6f874-1d2c-45bc-86b9-556f053f4801"). InnerVolumeSpecName "kube-api-access-9266q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:25:50.587723 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.587687    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9266q\" (UniqueName: \"kubernetes.io/projected/aef6f874-1d2c-45bc-86b9-556f053f4801-kube-api-access-9266q\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:25:50.587723 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.587720    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aef6f874-1d2c-45bc-86b9-556f053f4801-extensions-socket-volume\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:25:50.623308 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.623264    2582 generic.go:356] "Generic (PLEG): container finished" podID="aef6f874-1d2c-45bc-86b9-556f053f4801" containerID="5c6a18b211ebd64f2f994263797512846bb579db6bbea29e045cdd17a0cb81e7" exitCode=0
Jul 15 16:25:50.623308 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.623310    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk" event={"ID":"aef6f874-1d2c-45bc-86b9-556f053f4801","Type":"ContainerDied","Data":"5c6a18b211ebd64f2f994263797512846bb579db6bbea29e045cdd17a0cb81e7"}
Jul 15 16:25:50.623308 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.623319    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk"
Jul 15 16:25:50.623626 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.623412    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk" event={"ID":"aef6f874-1d2c-45bc-86b9-556f053f4801","Type":"ContainerDied","Data":"e179e68253feec03c1db2ca62cfc49e6a019d46365bfa1eaf0b4505361d8cfd4"}
Jul 15 16:25:50.623626 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.623435    2582 scope.go:117] "RemoveContainer" containerID="5c6a18b211ebd64f2f994263797512846bb579db6bbea29e045cdd17a0cb81e7"
Jul 15 16:25:50.636676 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.636655    2582 scope.go:117] "RemoveContainer" containerID="5c6a18b211ebd64f2f994263797512846bb579db6bbea29e045cdd17a0cb81e7"
Jul 15 16:25:50.636990 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:25:50.636969    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c6a18b211ebd64f2f994263797512846bb579db6bbea29e045cdd17a0cb81e7\": container with ID starting with 5c6a18b211ebd64f2f994263797512846bb579db6bbea29e045cdd17a0cb81e7 not found: ID does not exist" containerID="5c6a18b211ebd64f2f994263797512846bb579db6bbea29e045cdd17a0cb81e7"
Jul 15 16:25:50.637059 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.637003    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c6a18b211ebd64f2f994263797512846bb579db6bbea29e045cdd17a0cb81e7"} err="failed to get container status \"5c6a18b211ebd64f2f994263797512846bb579db6bbea29e045cdd17a0cb81e7\": rpc error: code = NotFound desc = could not find container \"5c6a18b211ebd64f2f994263797512846bb579db6bbea29e045cdd17a0cb81e7\": container with ID starting with 5c6a18b211ebd64f2f994263797512846bb579db6bbea29e045cdd17a0cb81e7 not found: ID does not exist"
Jul 15 16:25:50.648681 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.648653    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk"]
Jul 15 16:25:50.659307 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.659280    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldzsk"]
Jul 15 16:25:50.977867 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:50.977834    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aef6f874-1d2c-45bc-86b9-556f053f4801" path="/var/lib/kubelet/pods/aef6f874-1d2c-45bc-86b9-556f053f4801/volumes"
Jul 15 16:25:52.911076 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:52.911048    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:25:52.916850 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:52.916826    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:25:52.918150 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:52.918127    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:25:52.923400 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:25:52.923378    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:26:06.653978 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.653940    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"]
Jul 15 16:26:06.654566 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.654268    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aef6f874-1d2c-45bc-86b9-556f053f4801" containerName="manager"
Jul 15 16:26:06.654566 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.654279    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aef6f874-1d2c-45bc-86b9-556f053f4801" containerName="manager"
Jul 15 16:26:06.654566 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.654293    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c99bebd0-a013-42ca-ace8-a6a00a052a47" containerName="manager"
Jul 15 16:26:06.654566 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.654299    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c99bebd0-a013-42ca-ace8-a6a00a052a47" containerName="manager"
Jul 15 16:26:06.654566 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.654363    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aef6f874-1d2c-45bc-86b9-556f053f4801" containerName="manager"
Jul 15 16:26:06.654566 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.654375    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c99bebd0-a013-42ca-ace8-a6a00a052a47" containerName="manager"
Jul 15 16:26:06.658813 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.658793    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.663370 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.663322    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hrtpp\""
Jul 15 16:26:06.663592 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.663575    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 16:26:06.698301 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.698269    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"]
Jul 15 16:26:06.721614 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.721585    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c067a8e3-b716-429b-bb35-796f8ef55d08-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.721766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.721627    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c067a8e3-b716-429b-bb35-796f8ef55d08-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.721766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.721650    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c067a8e3-b716-429b-bb35-796f8ef55d08-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.721766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.721717    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c067a8e3-b716-429b-bb35-796f8ef55d08-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.721766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.721742    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpblw\" (UniqueName: \"kubernetes.io/projected/c067a8e3-b716-429b-bb35-796f8ef55d08-kube-api-access-mpblw\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.721899 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.721778    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c067a8e3-b716-429b-bb35-796f8ef55d08-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.721899 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.721814    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c067a8e3-b716-429b-bb35-796f8ef55d08-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.721899 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.721870    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c067a8e3-b716-429b-bb35-796f8ef55d08-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.721988 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.721908    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c067a8e3-b716-429b-bb35-796f8ef55d08-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.822505 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.822468    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c067a8e3-b716-429b-bb35-796f8ef55d08-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.822505 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.822512    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpblw\" (UniqueName: \"kubernetes.io/projected/c067a8e3-b716-429b-bb35-796f8ef55d08-kube-api-access-mpblw\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.822766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.822542    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c067a8e3-b716-429b-bb35-796f8ef55d08-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.822766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.822575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c067a8e3-b716-429b-bb35-796f8ef55d08-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.822766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.822621    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c067a8e3-b716-429b-bb35-796f8ef55d08-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.822766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.822645    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c067a8e3-b716-429b-bb35-796f8ef55d08-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.822766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.822682    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c067a8e3-b716-429b-bb35-796f8ef55d08-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.822766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.822723    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c067a8e3-b716-429b-bb35-796f8ef55d08-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.822766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.822750    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c067a8e3-b716-429b-bb35-796f8ef55d08-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.823174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.823148    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c067a8e3-b716-429b-bb35-796f8ef55d08-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.823241 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.823168    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c067a8e3-b716-429b-bb35-796f8ef55d08-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.823241 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.823193    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c067a8e3-b716-429b-bb35-796f8ef55d08-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.823373 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.823244    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c067a8e3-b716-429b-bb35-796f8ef55d08-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.823711 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.823692    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c067a8e3-b716-429b-bb35-796f8ef55d08-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.824937 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.824914    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c067a8e3-b716-429b-bb35-796f8ef55d08-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.825139 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.825123    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c067a8e3-b716-429b-bb35-796f8ef55d08-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.832644 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.832620    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c067a8e3-b716-429b-bb35-796f8ef55d08-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.832745 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.832685    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpblw\" (UniqueName: \"kubernetes.io/projected/c067a8e3-b716-429b-bb35-796f8ef55d08-kube-api-access-mpblw\") pod \"maas-default-gateway-openshift-default-56654dcf7-sh5pv\" (UID: \"c067a8e3-b716-429b-bb35-796f8ef55d08\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:06.970074 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:06.970038    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:07.108297 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:07.108273    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"]
Jul 15 16:26:07.112246 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:26:07.112214    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc067a8e3_b716_429b_bb35_796f8ef55d08.slice/crio-3030c49b69ea1e306a2f9d094353d181a13d895944f1831ed51f0f1940ed1af9 WatchSource:0}: Error finding container 3030c49b69ea1e306a2f9d094353d181a13d895944f1831ed51f0f1940ed1af9: Status 404 returned error can't find the container with id 3030c49b69ea1e306a2f9d094353d181a13d895944f1831ed51f0f1940ed1af9
Jul 15 16:26:07.702432 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:07.702390    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv" event={"ID":"c067a8e3-b716-429b-bb35-796f8ef55d08","Type":"ContainerStarted","Data":"3030c49b69ea1e306a2f9d094353d181a13d895944f1831ed51f0f1940ed1af9"}
Jul 15 16:26:09.659237 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:09.659183    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:26:09.659602 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:09.659287    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:26:09.659602 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:09.659325    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:26:10.716651 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:10.716615    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv" event={"ID":"c067a8e3-b716-429b-bb35-796f8ef55d08","Type":"ContainerStarted","Data":"7cfef16eb2c0ef76ede074b50753ef601ee88cd136866c1abc5bea9fe9101fd7"}
Jul 15 16:26:10.739090 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:10.739027    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv" podStartSLOduration=2.195421611 podStartE2EDuration="4.739008764s" totalImagesPullingTime="2.543587153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:26:10.738707878 +0000 UTC m=+618.276533566" watchObservedRunningTime="2026-07-15 16:26:10.739008764 +0000 UTC m=+618.276834421"
Jul 15 16:26:10.977554 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:10.977485    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:10.977690 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:10.977570    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:11.722278 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:11.722238    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:11.723481 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:11.723461    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:26:20.942929 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:20.942849    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"]
Jul 15 16:26:20.946194 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:20.946175    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"
Jul 15 16:26:20.948922 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:20.948899    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 16:26:20.949030 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:20.948947    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 16:26:20.949030 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:20.948953    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5shnt\""
Jul 15 16:26:20.949935 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:20.949920    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 16:26:20.956359 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:20.956322    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"]
Jul 15 16:26:21.040087 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:21.040057    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"]
Jul 15 16:26:21.047604 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:21.047575    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6t7x\" (UniqueName: \"kubernetes.io/projected/1f117516-1d28-4dc7-b6f2-736c11aee906-kube-api-access-r6t7x\") pod \"limitador-limitador-64c94fd64f-4nk9n\" (UID: \"1f117516-1d28-4dc7-b6f2-736c11aee906\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"
Jul 15 16:26:21.047765 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:21.047626    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f117516-1d28-4dc7-b6f2-736c11aee906-config-file\") pod \"limitador-limitador-64c94fd64f-4nk9n\" (UID: \"1f117516-1d28-4dc7-b6f2-736c11aee906\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"
Jul 15 16:26:21.148572 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:21.148540    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f117516-1d28-4dc7-b6f2-736c11aee906-config-file\") pod \"limitador-limitador-64c94fd64f-4nk9n\" (UID: \"1f117516-1d28-4dc7-b6f2-736c11aee906\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"
Jul 15 16:26:21.148721 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:21.148639    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6t7x\" (UniqueName: \"kubernetes.io/projected/1f117516-1d28-4dc7-b6f2-736c11aee906-kube-api-access-r6t7x\") pod \"limitador-limitador-64c94fd64f-4nk9n\" (UID: \"1f117516-1d28-4dc7-b6f2-736c11aee906\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"
Jul 15 16:26:21.149245 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:21.149226    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f117516-1d28-4dc7-b6f2-736c11aee906-config-file\") pod \"limitador-limitador-64c94fd64f-4nk9n\" (UID: \"1f117516-1d28-4dc7-b6f2-736c11aee906\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"
Jul 15 16:26:21.156970 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:21.156944    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6t7x\" (UniqueName: \"kubernetes.io/projected/1f117516-1d28-4dc7-b6f2-736c11aee906-kube-api-access-r6t7x\") pod \"limitador-limitador-64c94fd64f-4nk9n\" (UID: \"1f117516-1d28-4dc7-b6f2-736c11aee906\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"
Jul 15 16:26:21.256945 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:21.256901    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"
Jul 15 16:26:21.386783 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:21.386752    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"]
Jul 15 16:26:21.389458 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:26:21.389417    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f117516_1d28_4dc7_b6f2_736c11aee906.slice/crio-17f296cf3d57da26c65a97afccc043cef7a2c42fc213239d40ca0f3b144d1211 WatchSource:0}: Error finding container 17f296cf3d57da26c65a97afccc043cef7a2c42fc213239d40ca0f3b144d1211: Status 404 returned error can't find the container with id 17f296cf3d57da26c65a97afccc043cef7a2c42fc213239d40ca0f3b144d1211
Jul 15 16:26:21.767892 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:21.767856    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4nk9n" event={"ID":"1f117516-1d28-4dc7-b6f2-736c11aee906","Type":"ContainerStarted","Data":"17f296cf3d57da26c65a97afccc043cef7a2c42fc213239d40ca0f3b144d1211"}
Jul 15 16:26:24.783513 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:24.783474    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4nk9n" event={"ID":"1f117516-1d28-4dc7-b6f2-736c11aee906","Type":"ContainerStarted","Data":"2459449e3767deb709312e612682df2c9decc051503112dcde2c597cec1d70ea"}
Jul 15 16:26:24.783889 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:24.783606    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"
Jul 15 16:26:24.802470 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:24.802424    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-4nk9n" podStartSLOduration=1.943959636 podStartE2EDuration="4.802409393s" totalImagesPullingTime="2.858449757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:26:24.801304762 +0000 UTC m=+632.339130420" watchObservedRunningTime="2026-07-15 16:26:24.802409393 +0000 UTC m=+632.340235049"
Jul 15 16:26:35.789019 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:35.788987    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"
Jul 15 16:26:38.288745 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:38.288707    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"]
Jul 15 16:26:38.289204 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:38.288909    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-4nk9n" podUID="1f117516-1d28-4dc7-b6f2-736c11aee906" containerName="limitador" containerID="cri-o://2459449e3767deb709312e612682df2c9decc051503112dcde2c597cec1d70ea" gracePeriod=30
Jul 15 16:26:38.845251 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:38.845227    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"
Jul 15 16:26:38.847082 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:38.847057    2582 generic.go:356] "Generic (PLEG): container finished" podID="1f117516-1d28-4dc7-b6f2-736c11aee906" containerID="2459449e3767deb709312e612682df2c9decc051503112dcde2c597cec1d70ea" exitCode=0
Jul 15 16:26:38.847159 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:38.847092    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"
Jul 15 16:26:38.847159 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:38.847095    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4nk9n" event={"ID":"1f117516-1d28-4dc7-b6f2-736c11aee906","Type":"ContainerDied","Data":"2459449e3767deb709312e612682df2c9decc051503112dcde2c597cec1d70ea"}
Jul 15 16:26:38.847159 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:38.847145    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4nk9n" event={"ID":"1f117516-1d28-4dc7-b6f2-736c11aee906","Type":"ContainerDied","Data":"17f296cf3d57da26c65a97afccc043cef7a2c42fc213239d40ca0f3b144d1211"}
Jul 15 16:26:38.847260 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:38.847175    2582 scope.go:117] "RemoveContainer" containerID="2459449e3767deb709312e612682df2c9decc051503112dcde2c597cec1d70ea"
Jul 15 16:26:38.855107 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:38.855089    2582 scope.go:117] "RemoveContainer" containerID="2459449e3767deb709312e612682df2c9decc051503112dcde2c597cec1d70ea"
Jul 15 16:26:38.855414 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:26:38.855332    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2459449e3767deb709312e612682df2c9decc051503112dcde2c597cec1d70ea\": container with ID starting with 2459449e3767deb709312e612682df2c9decc051503112dcde2c597cec1d70ea not found: ID does not exist" containerID="2459449e3767deb709312e612682df2c9decc051503112dcde2c597cec1d70ea"
Jul 15 16:26:38.855414 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:38.855381    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2459449e3767deb709312e612682df2c9decc051503112dcde2c597cec1d70ea"} err="failed to get container status \"2459449e3767deb709312e612682df2c9decc051503112dcde2c597cec1d70ea\": rpc error: code = NotFound desc = could not find container \"2459449e3767deb709312e612682df2c9decc051503112dcde2c597cec1d70ea\": container with ID starting with 2459449e3767deb709312e612682df2c9decc051503112dcde2c597cec1d70ea not found: ID does not exist"
Jul 15 16:26:39.004755 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:39.004721    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6t7x\" (UniqueName: \"kubernetes.io/projected/1f117516-1d28-4dc7-b6f2-736c11aee906-kube-api-access-r6t7x\") pod \"1f117516-1d28-4dc7-b6f2-736c11aee906\" (UID: \"1f117516-1d28-4dc7-b6f2-736c11aee906\") "
Jul 15 16:26:39.004755 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:39.004753    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f117516-1d28-4dc7-b6f2-736c11aee906-config-file\") pod \"1f117516-1d28-4dc7-b6f2-736c11aee906\" (UID: \"1f117516-1d28-4dc7-b6f2-736c11aee906\") "
Jul 15 16:26:39.005132 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:39.005107    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f117516-1d28-4dc7-b6f2-736c11aee906-config-file" (OuterVolumeSpecName: "config-file") pod "1f117516-1d28-4dc7-b6f2-736c11aee906" (UID: "1f117516-1d28-4dc7-b6f2-736c11aee906"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:26:39.006761 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:39.006735    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f117516-1d28-4dc7-b6f2-736c11aee906-kube-api-access-r6t7x" (OuterVolumeSpecName: "kube-api-access-r6t7x") pod "1f117516-1d28-4dc7-b6f2-736c11aee906" (UID: "1f117516-1d28-4dc7-b6f2-736c11aee906"). InnerVolumeSpecName "kube-api-access-r6t7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:26:39.106369 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:39.106251    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6t7x\" (UniqueName: \"kubernetes.io/projected/1f117516-1d28-4dc7-b6f2-736c11aee906-kube-api-access-r6t7x\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:26:39.106369 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:39.106283    2582 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f117516-1d28-4dc7-b6f2-736c11aee906-config-file\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:26:39.169750 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:39.169724    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"]
Jul 15 16:26:39.173773 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:39.173751    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4nk9n"]
Jul 15 16:26:40.977211 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:40.977175    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f117516-1d28-4dc7-b6f2-736c11aee906" path="/var/lib/kubelet/pods/1f117516-1d28-4dc7-b6f2-736c11aee906/volumes"
Jul 15 16:26:44.232097 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.232057    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-c4v28"]
Jul 15 16:26:44.233136 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.233107    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f117516-1d28-4dc7-b6f2-736c11aee906" containerName="limitador"
Jul 15 16:26:44.233136 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.233139    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f117516-1d28-4dc7-b6f2-736c11aee906" containerName="limitador"
Jul 15 16:26:44.233274 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.233248    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f117516-1d28-4dc7-b6f2-736c11aee906" containerName="limitador"
Jul 15 16:26:44.243209 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.243187    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c4v28"
Jul 15 16:26:44.244103 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.244081    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-c4v28"]
Jul 15 16:26:44.246201 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.246179    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 16:26:44.246317 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.246181    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 16:26:44.246317 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.246187    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 16:26:44.247124 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.247102    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-m4xzv\""
Jul 15 16:26:44.352453 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.352423    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jnc7\" (UniqueName: \"kubernetes.io/projected/8638902f-4521-46c2-b127-bb4819939999-kube-api-access-7jnc7\") pod \"postgres-69fb4594cf-c4v28\" (UID: \"8638902f-4521-46c2-b127-bb4819939999\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c4v28"
Jul 15 16:26:44.352610 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.352482    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8638902f-4521-46c2-b127-bb4819939999-data\") pod \"postgres-69fb4594cf-c4v28\" (UID: \"8638902f-4521-46c2-b127-bb4819939999\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c4v28"
Jul 15 16:26:44.453549 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.453501    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jnc7\" (UniqueName: \"kubernetes.io/projected/8638902f-4521-46c2-b127-bb4819939999-kube-api-access-7jnc7\") pod \"postgres-69fb4594cf-c4v28\" (UID: \"8638902f-4521-46c2-b127-bb4819939999\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c4v28"
Jul 15 16:26:44.453720 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.453574    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8638902f-4521-46c2-b127-bb4819939999-data\") pod \"postgres-69fb4594cf-c4v28\" (UID: \"8638902f-4521-46c2-b127-bb4819939999\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c4v28"
Jul 15 16:26:44.453900 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.453885    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8638902f-4521-46c2-b127-bb4819939999-data\") pod \"postgres-69fb4594cf-c4v28\" (UID: \"8638902f-4521-46c2-b127-bb4819939999\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c4v28"
Jul 15 16:26:44.464516 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.464491    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jnc7\" (UniqueName: \"kubernetes.io/projected/8638902f-4521-46c2-b127-bb4819939999-kube-api-access-7jnc7\") pod \"postgres-69fb4594cf-c4v28\" (UID: \"8638902f-4521-46c2-b127-bb4819939999\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c4v28"
Jul 15 16:26:44.554540 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.554443    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c4v28"
Jul 15 16:26:44.684596 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.684565    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-c4v28"]
Jul 15 16:26:44.687185 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:26:44.687156    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8638902f_4521_46c2_b127_bb4819939999.slice/crio-9342bfbc19526b5ad162cded481903337b4a022b32ee88624c4defdfe9c52a67 WatchSource:0}: Error finding container 9342bfbc19526b5ad162cded481903337b4a022b32ee88624c4defdfe9c52a67: Status 404 returned error can't find the container with id 9342bfbc19526b5ad162cded481903337b4a022b32ee88624c4defdfe9c52a67
Jul 15 16:26:44.877998 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:44.877914    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c4v28" event={"ID":"8638902f-4521-46c2-b127-bb4819939999","Type":"ContainerStarted","Data":"9342bfbc19526b5ad162cded481903337b4a022b32ee88624c4defdfe9c52a67"}
Jul 15 16:26:49.908525 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:49.908426    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c4v28" event={"ID":"8638902f-4521-46c2-b127-bb4819939999","Type":"ContainerStarted","Data":"bb86d2aa627579b57dfc59bff1aa5ec68371130a30f41abe35ee850ac832f7fb"}
Jul 15 16:26:49.908915 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:49.908592    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c4v28"
Jul 15 16:26:49.926643 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:49.926595    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c4v28" podStartSLOduration=1.091245243 podStartE2EDuration="5.92658162s" totalImagesPullingTime="4.835336377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:26:49.925724382 +0000 UTC m=+657.463550050" watchObservedRunningTime="2026-07-15 16:26:49.92658162 +0000 UTC m=+657.464407275"
Jul 15 16:26:55.941494 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:55.941465    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c4v28"
Jul 15 16:26:56.910704 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:56.910672    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c678885d-jt4n6"]
Jul 15 16:26:56.918291 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:56.918265    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c678885d-jt4n6"
Jul 15 16:26:56.920870 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:56.920848    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 16:26:56.921289 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:56.921271    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c678885d-jt4n6"]
Jul 15 16:26:56.921906 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:56.921885    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9xd8j\""
Jul 15 16:26:56.922006 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:56.921926    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 16:26:56.961098 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:56.961073    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqq2h\" (UniqueName: \"kubernetes.io/projected/8a1b6662-dff1-49b2-9061-d3f0fe6fb52c-kube-api-access-bqq2h\") pod \"authorino-c678885d-jt4n6\" (UID: \"8a1b6662-dff1-49b2-9061-d3f0fe6fb52c\") " pod="kuadrant-system/authorino-c678885d-jt4n6"
Jul 15 16:26:57.061495 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:57.061464    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqq2h\" (UniqueName: \"kubernetes.io/projected/8a1b6662-dff1-49b2-9061-d3f0fe6fb52c-kube-api-access-bqq2h\") pod \"authorino-c678885d-jt4n6\" (UID: \"8a1b6662-dff1-49b2-9061-d3f0fe6fb52c\") " pod="kuadrant-system/authorino-c678885d-jt4n6"
Jul 15 16:26:57.070323 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:57.070291    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqq2h\" (UniqueName: \"kubernetes.io/projected/8a1b6662-dff1-49b2-9061-d3f0fe6fb52c-kube-api-access-bqq2h\") pod \"authorino-c678885d-jt4n6\" (UID: \"8a1b6662-dff1-49b2-9061-d3f0fe6fb52c\") " pod="kuadrant-system/authorino-c678885d-jt4n6"
Jul 15 16:26:57.143741 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:57.143714    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c678885d-jt4n6"]
Jul 15 16:26:57.143973 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:57.143961    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c678885d-jt4n6"
Jul 15 16:26:57.276661 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:57.276636    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c678885d-jt4n6"]
Jul 15 16:26:57.278700 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:26:57.278676    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a1b6662_dff1_49b2_9061_d3f0fe6fb52c.slice/crio-c6bba4787cf9508504507694c656099b176da487f4b840b3723ad71e91f05591 WatchSource:0}: Error finding container c6bba4787cf9508504507694c656099b176da487f4b840b3723ad71e91f05591: Status 404 returned error can't find the container with id c6bba4787cf9508504507694c656099b176da487f4b840b3723ad71e91f05591
Jul 15 16:26:57.952866 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:26:57.952824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c678885d-jt4n6" event={"ID":"8a1b6662-dff1-49b2-9061-d3f0fe6fb52c","Type":"ContainerStarted","Data":"c6bba4787cf9508504507694c656099b176da487f4b840b3723ad71e91f05591"}
Jul 15 16:27:00.971919 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:00.971862    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c678885d-jt4n6" podUID="8a1b6662-dff1-49b2-9061-d3f0fe6fb52c" containerName="authorino" containerID="cri-o://78fc27a11cc1efa42b70618a8bba458de9e0e368617a1ddbb6b304dbae488855" gracePeriod=30
Jul 15 16:27:00.976947 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:00.976924    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c678885d-jt4n6" event={"ID":"8a1b6662-dff1-49b2-9061-d3f0fe6fb52c","Type":"ContainerStarted","Data":"78fc27a11cc1efa42b70618a8bba458de9e0e368617a1ddbb6b304dbae488855"}
Jul 15 16:27:00.991468 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:00.991426    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c678885d-jt4n6" podStartSLOduration=1.850437764 podStartE2EDuration="4.991404585s" totalImagesPullingTime="3.140966821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:26:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:27:00.990093171 +0000 UTC m=+668.527918831" watchObservedRunningTime="2026-07-15 16:27:00.991404585 +0000 UTC m=+668.529230241"
Jul 15 16:27:01.216349 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:01.216311    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c678885d-jt4n6"
Jul 15 16:27:01.295030 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:01.294946    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqq2h\" (UniqueName: \"kubernetes.io/projected/8a1b6662-dff1-49b2-9061-d3f0fe6fb52c-kube-api-access-bqq2h\") pod \"8a1b6662-dff1-49b2-9061-d3f0fe6fb52c\" (UID: \"8a1b6662-dff1-49b2-9061-d3f0fe6fb52c\") "
Jul 15 16:27:01.296922 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:01.296896    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a1b6662-dff1-49b2-9061-d3f0fe6fb52c-kube-api-access-bqq2h" (OuterVolumeSpecName: "kube-api-access-bqq2h") pod "8a1b6662-dff1-49b2-9061-d3f0fe6fb52c" (UID: "8a1b6662-dff1-49b2-9061-d3f0fe6fb52c"). InnerVolumeSpecName "kube-api-access-bqq2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:27:01.396533 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:01.396490    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqq2h\" (UniqueName: \"kubernetes.io/projected/8a1b6662-dff1-49b2-9061-d3f0fe6fb52c-kube-api-access-bqq2h\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:27:01.977163 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:01.977126    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a1b6662-dff1-49b2-9061-d3f0fe6fb52c" containerID="78fc27a11cc1efa42b70618a8bba458de9e0e368617a1ddbb6b304dbae488855" exitCode=0
Jul 15 16:27:01.977636 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:01.977169    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c678885d-jt4n6"
Jul 15 16:27:01.977636 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:01.977221    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c678885d-jt4n6" event={"ID":"8a1b6662-dff1-49b2-9061-d3f0fe6fb52c","Type":"ContainerDied","Data":"78fc27a11cc1efa42b70618a8bba458de9e0e368617a1ddbb6b304dbae488855"}
Jul 15 16:27:01.977636 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:01.977261    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c678885d-jt4n6" event={"ID":"8a1b6662-dff1-49b2-9061-d3f0fe6fb52c","Type":"ContainerDied","Data":"c6bba4787cf9508504507694c656099b176da487f4b840b3723ad71e91f05591"}
Jul 15 16:27:01.977636 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:01.977278    2582 scope.go:117] "RemoveContainer" containerID="78fc27a11cc1efa42b70618a8bba458de9e0e368617a1ddbb6b304dbae488855"
Jul 15 16:27:01.985835 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:01.985821    2582 scope.go:117] "RemoveContainer" containerID="78fc27a11cc1efa42b70618a8bba458de9e0e368617a1ddbb6b304dbae488855"
Jul 15 16:27:01.986110 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:27:01.986092    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78fc27a11cc1efa42b70618a8bba458de9e0e368617a1ddbb6b304dbae488855\": container with ID starting with 78fc27a11cc1efa42b70618a8bba458de9e0e368617a1ddbb6b304dbae488855 not found: ID does not exist" containerID="78fc27a11cc1efa42b70618a8bba458de9e0e368617a1ddbb6b304dbae488855"
Jul 15 16:27:01.986163 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:01.986118    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78fc27a11cc1efa42b70618a8bba458de9e0e368617a1ddbb6b304dbae488855"} err="failed to get container status \"78fc27a11cc1efa42b70618a8bba458de9e0e368617a1ddbb6b304dbae488855\": rpc error: code = NotFound desc = could not find container \"78fc27a11cc1efa42b70618a8bba458de9e0e368617a1ddbb6b304dbae488855\": container with ID starting with 78fc27a11cc1efa42b70618a8bba458de9e0e368617a1ddbb6b304dbae488855 not found: ID does not exist"
Jul 15 16:27:01.999192 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:01.999169    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c678885d-jt4n6"]
Jul 15 16:27:02.003238 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:02.003219    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c678885d-jt4n6"]
Jul 15 16:27:02.977959 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:02.977929    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a1b6662-dff1-49b2-9061-d3f0fe6fb52c" path="/var/lib/kubelet/pods/8a1b6662-dff1-49b2-9061-d3f0fe6fb52c/volumes"
Jul 15 16:27:03.925365 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:03.925311    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bbdf6b594-vqrv5"]
Jul 15 16:27:03.925741 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:03.925723    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a1b6662-dff1-49b2-9061-d3f0fe6fb52c" containerName="authorino"
Jul 15 16:27:03.925830 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:03.925744    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a1b6662-dff1-49b2-9061-d3f0fe6fb52c" containerName="authorino"
Jul 15 16:27:03.925883 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:03.925832    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a1b6662-dff1-49b2-9061-d3f0fe6fb52c" containerName="authorino"
Jul 15 16:27:03.930210 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:03.930190    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bbdf6b594-vqrv5"
Jul 15 16:27:03.933214 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:03.933192    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bdx69\""
Jul 15 16:27:03.933702 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:03.933679    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 16:27:03.934598 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:03.934584    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 16:27:03.954742 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:03.954714    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bbdf6b594-vqrv5"]
Jul 15 16:27:04.018918 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.018885    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6697545-cdde-48a4-99c1-7f6a61be597b-webhook-cert\") pod \"maas-controller-bbdf6b594-vqrv5\" (UID: \"f6697545-cdde-48a4-99c1-7f6a61be597b\") " pod="opendatahub/maas-controller-bbdf6b594-vqrv5"
Jul 15 16:27:04.019279 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.018934    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvdqf\" (UniqueName: \"kubernetes.io/projected/f6697545-cdde-48a4-99c1-7f6a61be597b-kube-api-access-xvdqf\") pod \"maas-controller-bbdf6b594-vqrv5\" (UID: \"f6697545-cdde-48a4-99c1-7f6a61be597b\") " pod="opendatahub/maas-controller-bbdf6b594-vqrv5"
Jul 15 16:27:04.119606 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.119570    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvdqf\" (UniqueName: \"kubernetes.io/projected/f6697545-cdde-48a4-99c1-7f6a61be597b-kube-api-access-xvdqf\") pod \"maas-controller-bbdf6b594-vqrv5\" (UID: \"f6697545-cdde-48a4-99c1-7f6a61be597b\") " pod="opendatahub/maas-controller-bbdf6b594-vqrv5"
Jul 15 16:27:04.119774 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.119655    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6697545-cdde-48a4-99c1-7f6a61be597b-webhook-cert\") pod \"maas-controller-bbdf6b594-vqrv5\" (UID: \"f6697545-cdde-48a4-99c1-7f6a61be597b\") " pod="opendatahub/maas-controller-bbdf6b594-vqrv5"
Jul 15 16:27:04.121970 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.121952    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6697545-cdde-48a4-99c1-7f6a61be597b-webhook-cert\") pod \"maas-controller-bbdf6b594-vqrv5\" (UID: \"f6697545-cdde-48a4-99c1-7f6a61be597b\") " pod="opendatahub/maas-controller-bbdf6b594-vqrv5"
Jul 15 16:27:04.128949 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.128923    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvdqf\" (UniqueName: \"kubernetes.io/projected/f6697545-cdde-48a4-99c1-7f6a61be597b-kube-api-access-xvdqf\") pod \"maas-controller-bbdf6b594-vqrv5\" (UID: \"f6697545-cdde-48a4-99c1-7f6a61be597b\") " pod="opendatahub/maas-controller-bbdf6b594-vqrv5"
Jul 15 16:27:04.165932 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.165907    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cff9854fb-w9fxw"]
Jul 15 16:27:04.169236 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.169220    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cff9854fb-w9fxw"
Jul 15 16:27:04.182294 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.182269    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cff9854fb-w9fxw"]
Jul 15 16:27:04.220695 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.220666    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjr72\" (UniqueName: \"kubernetes.io/projected/bfaba5ea-2a04-4496-b8d4-91b90f58df0c-kube-api-access-xjr72\") pod \"maas-controller-6cff9854fb-w9fxw\" (UID: \"bfaba5ea-2a04-4496-b8d4-91b90f58df0c\") " pod="opendatahub/maas-controller-6cff9854fb-w9fxw"
Jul 15 16:27:04.220842 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.220720    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfaba5ea-2a04-4496-b8d4-91b90f58df0c-webhook-cert\") pod \"maas-controller-6cff9854fb-w9fxw\" (UID: \"bfaba5ea-2a04-4496-b8d4-91b90f58df0c\") " pod="opendatahub/maas-controller-6cff9854fb-w9fxw"
Jul 15 16:27:04.240002 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.239974    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bbdf6b594-vqrv5"
Jul 15 16:27:04.322600 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.321747    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjr72\" (UniqueName: \"kubernetes.io/projected/bfaba5ea-2a04-4496-b8d4-91b90f58df0c-kube-api-access-xjr72\") pod \"maas-controller-6cff9854fb-w9fxw\" (UID: \"bfaba5ea-2a04-4496-b8d4-91b90f58df0c\") " pod="opendatahub/maas-controller-6cff9854fb-w9fxw"
Jul 15 16:27:04.322600 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.321866    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfaba5ea-2a04-4496-b8d4-91b90f58df0c-webhook-cert\") pod \"maas-controller-6cff9854fb-w9fxw\" (UID: \"bfaba5ea-2a04-4496-b8d4-91b90f58df0c\") " pod="opendatahub/maas-controller-6cff9854fb-w9fxw"
Jul 15 16:27:04.324873 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.324844    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfaba5ea-2a04-4496-b8d4-91b90f58df0c-webhook-cert\") pod \"maas-controller-6cff9854fb-w9fxw\" (UID: \"bfaba5ea-2a04-4496-b8d4-91b90f58df0c\") " pod="opendatahub/maas-controller-6cff9854fb-w9fxw"
Jul 15 16:27:04.331180 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.331157    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjr72\" (UniqueName: \"kubernetes.io/projected/bfaba5ea-2a04-4496-b8d4-91b90f58df0c-kube-api-access-xjr72\") pod \"maas-controller-6cff9854fb-w9fxw\" (UID: \"bfaba5ea-2a04-4496-b8d4-91b90f58df0c\") " pod="opendatahub/maas-controller-6cff9854fb-w9fxw"
Jul 15 16:27:04.393059 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.392999    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bbdf6b594-vqrv5"]
Jul 15 16:27:04.395139 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:27:04.395108    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6697545_cdde_48a4_99c1_7f6a61be597b.slice/crio-8b8d8b87869de38c03c0045b2337998c1b1b983172702cf838c589f12718117f WatchSource:0}: Error finding container 8b8d8b87869de38c03c0045b2337998c1b1b983172702cf838c589f12718117f: Status 404 returned error can't find the container with id 8b8d8b87869de38c03c0045b2337998c1b1b983172702cf838c589f12718117f
Jul 15 16:27:04.479591 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.479560    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cff9854fb-w9fxw"
Jul 15 16:27:04.610852 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.610829    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cff9854fb-w9fxw"]
Jul 15 16:27:04.612579 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:27:04.612553    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfaba5ea_2a04_4496_b8d4_91b90f58df0c.slice/crio-55ee32a091a46c2868500c997c85ff425e0530ba295d679cfd7d88bd0d8bb22e WatchSource:0}: Error finding container 55ee32a091a46c2868500c997c85ff425e0530ba295d679cfd7d88bd0d8bb22e: Status 404 returned error can't find the container with id 55ee32a091a46c2868500c997c85ff425e0530ba295d679cfd7d88bd0d8bb22e
Jul 15 16:27:04.999033 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:04.998997    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cff9854fb-w9fxw" event={"ID":"bfaba5ea-2a04-4496-b8d4-91b90f58df0c","Type":"ContainerStarted","Data":"55ee32a091a46c2868500c997c85ff425e0530ba295d679cfd7d88bd0d8bb22e"}
Jul 15 16:27:05.000096 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:05.000066    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bbdf6b594-vqrv5" event={"ID":"f6697545-cdde-48a4-99c1-7f6a61be597b","Type":"ContainerStarted","Data":"8b8d8b87869de38c03c0045b2337998c1b1b983172702cf838c589f12718117f"}
Jul 15 16:27:08.018633 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:08.018596    2582 generic.go:356] "Generic (PLEG): container finished" podID="bfaba5ea-2a04-4496-b8d4-91b90f58df0c" containerID="88db022fc48328102160eb67d156129be36b7790947acbbb244ab45c9e276dfa" exitCode=1
Jul 15 16:27:08.019077 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:08.018678    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cff9854fb-w9fxw" event={"ID":"bfaba5ea-2a04-4496-b8d4-91b90f58df0c","Type":"ContainerDied","Data":"88db022fc48328102160eb67d156129be36b7790947acbbb244ab45c9e276dfa"}
Jul 15 16:27:08.019077 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:08.018880    2582 scope.go:117] "RemoveContainer" containerID="88db022fc48328102160eb67d156129be36b7790947acbbb244ab45c9e276dfa"
Jul 15 16:27:08.020308 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:08.020280    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bbdf6b594-vqrv5" event={"ID":"f6697545-cdde-48a4-99c1-7f6a61be597b","Type":"ContainerStarted","Data":"eec4be976eb083b6302c921a64b3e77c9ee5a176655516a29a1b1766de74cac8"}
Jul 15 16:27:08.020428 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:08.020383    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bbdf6b594-vqrv5"
Jul 15 16:27:08.065088 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:08.065044    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bbdf6b594-vqrv5" podStartSLOduration=2.275153963 podStartE2EDuration="5.065030204s" totalImagesPullingTime="2.789876241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:27:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:27:08.062745061 +0000 UTC m=+675.600570717" watchObservedRunningTime="2026-07-15 16:27:08.065030204 +0000 UTC m=+675.602855859"
Jul 15 16:27:09.025879 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:09.025841    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cff9854fb-w9fxw" event={"ID":"bfaba5ea-2a04-4496-b8d4-91b90f58df0c","Type":"ContainerStarted","Data":"1b05c117ffee10218a69c74128ef3a02bfed3ab830310fb36d323f8ed8d68a9b"}
Jul 15 16:27:09.026235 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:09.025921    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cff9854fb-w9fxw"
Jul 15 16:27:09.062897 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:09.062844    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cff9854fb-w9fxw" podStartSLOduration=2.049740388 podStartE2EDuration="5.06282949s" totalImagesPullingTime="3.013089102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:27:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:27:09.060234104 +0000 UTC m=+676.598059760" watchObservedRunningTime="2026-07-15 16:27:09.06282949 +0000 UTC m=+676.600655145"
Jul 15 16:27:19.028768 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:19.028734    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bbdf6b594-vqrv5"
Jul 15 16:27:20.032363 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:20.032316    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cff9854fb-w9fxw"
Jul 15 16:27:20.088584 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:20.088553    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bbdf6b594-vqrv5"]
Jul 15 16:27:20.088776 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:20.088751    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-bbdf6b594-vqrv5" podUID="f6697545-cdde-48a4-99c1-7f6a61be597b" containerName="manager" containerID="cri-o://eec4be976eb083b6302c921a64b3e77c9ee5a176655516a29a1b1766de74cac8" gracePeriod=30
Jul 15 16:27:20.339652 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:20.339629    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bbdf6b594-vqrv5"
Jul 15 16:27:20.473687 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:20.473647    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6697545-cdde-48a4-99c1-7f6a61be597b-webhook-cert\") pod \"f6697545-cdde-48a4-99c1-7f6a61be597b\" (UID: \"f6697545-cdde-48a4-99c1-7f6a61be597b\") "
Jul 15 16:27:20.473884 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:20.473701    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvdqf\" (UniqueName: \"kubernetes.io/projected/f6697545-cdde-48a4-99c1-7f6a61be597b-kube-api-access-xvdqf\") pod \"f6697545-cdde-48a4-99c1-7f6a61be597b\" (UID: \"f6697545-cdde-48a4-99c1-7f6a61be597b\") "
Jul 15 16:27:20.475921 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:20.475891    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6697545-cdde-48a4-99c1-7f6a61be597b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f6697545-cdde-48a4-99c1-7f6a61be597b" (UID: "f6697545-cdde-48a4-99c1-7f6a61be597b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:27:20.475921 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:20.475909    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6697545-cdde-48a4-99c1-7f6a61be597b-kube-api-access-xvdqf" (OuterVolumeSpecName: "kube-api-access-xvdqf") pod "f6697545-cdde-48a4-99c1-7f6a61be597b" (UID: "f6697545-cdde-48a4-99c1-7f6a61be597b"). InnerVolumeSpecName "kube-api-access-xvdqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:27:20.574986 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:20.574899    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6697545-cdde-48a4-99c1-7f6a61be597b-webhook-cert\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:27:20.574986 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:20.574939    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvdqf\" (UniqueName: \"kubernetes.io/projected/f6697545-cdde-48a4-99c1-7f6a61be597b-kube-api-access-xvdqf\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:27:21.084106 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:21.084075    2582 generic.go:356] "Generic (PLEG): container finished" podID="f6697545-cdde-48a4-99c1-7f6a61be597b" containerID="eec4be976eb083b6302c921a64b3e77c9ee5a176655516a29a1b1766de74cac8" exitCode=0
Jul 15 16:27:21.084513 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:21.084116    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bbdf6b594-vqrv5"
Jul 15 16:27:21.084513 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:21.084127    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bbdf6b594-vqrv5" event={"ID":"f6697545-cdde-48a4-99c1-7f6a61be597b","Type":"ContainerDied","Data":"eec4be976eb083b6302c921a64b3e77c9ee5a176655516a29a1b1766de74cac8"}
Jul 15 16:27:21.084513 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:21.084166    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bbdf6b594-vqrv5" event={"ID":"f6697545-cdde-48a4-99c1-7f6a61be597b","Type":"ContainerDied","Data":"8b8d8b87869de38c03c0045b2337998c1b1b983172702cf838c589f12718117f"}
Jul 15 16:27:21.084513 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:21.084188    2582 scope.go:117] "RemoveContainer" containerID="eec4be976eb083b6302c921a64b3e77c9ee5a176655516a29a1b1766de74cac8"
Jul 15 16:27:21.092937 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:21.092743    2582 scope.go:117] "RemoveContainer" containerID="eec4be976eb083b6302c921a64b3e77c9ee5a176655516a29a1b1766de74cac8"
Jul 15 16:27:21.093048 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:27:21.093029    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eec4be976eb083b6302c921a64b3e77c9ee5a176655516a29a1b1766de74cac8\": container with ID starting with eec4be976eb083b6302c921a64b3e77c9ee5a176655516a29a1b1766de74cac8 not found: ID does not exist" containerID="eec4be976eb083b6302c921a64b3e77c9ee5a176655516a29a1b1766de74cac8"
Jul 15 16:27:21.093090 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:21.093057    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eec4be976eb083b6302c921a64b3e77c9ee5a176655516a29a1b1766de74cac8"} err="failed to get container status \"eec4be976eb083b6302c921a64b3e77c9ee5a176655516a29a1b1766de74cac8\": rpc error: code = NotFound desc = could not find container \"eec4be976eb083b6302c921a64b3e77c9ee5a176655516a29a1b1766de74cac8\": container with ID starting with eec4be976eb083b6302c921a64b3e77c9ee5a176655516a29a1b1766de74cac8 not found: ID does not exist"
Jul 15 16:27:21.102737 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:21.102711    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bbdf6b594-vqrv5"]
Jul 15 16:27:21.108539 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:21.108517    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bbdf6b594-vqrv5"]
Jul 15 16:27:22.977116 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:22.977082    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6697545-cdde-48a4-99c1-7f6a61be597b" path="/var/lib/kubelet/pods/f6697545-cdde-48a4-99c1-7f6a61be597b/volumes"
Jul 15 16:27:40.131568 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.131516    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq"]
Jul 15 16:27:40.131968 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.131913    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6697545-cdde-48a4-99c1-7f6a61be597b" containerName="manager"
Jul 15 16:27:40.131968 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.131925    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6697545-cdde-48a4-99c1-7f6a61be597b" containerName="manager"
Jul 15 16:27:40.132045 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.131980    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6697545-cdde-48a4-99c1-7f6a61be597b" containerName="manager"
Jul 15 16:27:40.144703 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.144667    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq"
Jul 15 16:27:40.145977 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.145949    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq"]
Jul 15 16:27:40.147642 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.147619    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 15 16:27:40.147738 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.147697    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-v8jb8\""
Jul 15 16:27:40.246363 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.246309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e103985d-2289-4b76-a324-320563a0c350-openshift-service-ca\") pod \"maas-api-5484fd6ff-zcmzq\" (UID: \"e103985d-2289-4b76-a324-320563a0c350\") " pod="odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq"
Jul 15 16:27:40.246537 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.246375    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwt8d\" (UniqueName: \"kubernetes.io/projected/e103985d-2289-4b76-a324-320563a0c350-kube-api-access-zwt8d\") pod \"maas-api-5484fd6ff-zcmzq\" (UID: \"e103985d-2289-4b76-a324-320563a0c350\") " pod="odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq"
Jul 15 16:27:40.246537 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.246444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e103985d-2289-4b76-a324-320563a0c350-maas-api-tls\") pod \"maas-api-5484fd6ff-zcmzq\" (UID: \"e103985d-2289-4b76-a324-320563a0c350\") " pod="odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq"
Jul 15 16:27:40.347720 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.347685    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e103985d-2289-4b76-a324-320563a0c350-openshift-service-ca\") pod \"maas-api-5484fd6ff-zcmzq\" (UID: \"e103985d-2289-4b76-a324-320563a0c350\") " pod="odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq"
Jul 15 16:27:40.347720 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.347721    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwt8d\" (UniqueName: \"kubernetes.io/projected/e103985d-2289-4b76-a324-320563a0c350-kube-api-access-zwt8d\") pod \"maas-api-5484fd6ff-zcmzq\" (UID: \"e103985d-2289-4b76-a324-320563a0c350\") " pod="odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq"
Jul 15 16:27:40.347928 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.347783    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e103985d-2289-4b76-a324-320563a0c350-maas-api-tls\") pod \"maas-api-5484fd6ff-zcmzq\" (UID: \"e103985d-2289-4b76-a324-320563a0c350\") " pod="odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq"
Jul 15 16:27:40.348472 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.348450    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e103985d-2289-4b76-a324-320563a0c350-openshift-service-ca\") pod \"maas-api-5484fd6ff-zcmzq\" (UID: \"e103985d-2289-4b76-a324-320563a0c350\") " pod="odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq"
Jul 15 16:27:40.350236 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.350216    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e103985d-2289-4b76-a324-320563a0c350-maas-api-tls\") pod \"maas-api-5484fd6ff-zcmzq\" (UID: \"e103985d-2289-4b76-a324-320563a0c350\") " pod="odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq"
Jul 15 16:27:40.357141 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.357114    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwt8d\" (UniqueName: \"kubernetes.io/projected/e103985d-2289-4b76-a324-320563a0c350-kube-api-access-zwt8d\") pod \"maas-api-5484fd6ff-zcmzq\" (UID: \"e103985d-2289-4b76-a324-320563a0c350\") " pod="odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq"
Jul 15 16:27:40.456777 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.456743    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq"
Jul 15 16:27:40.604734 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.604712    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq"]
Jul 15 16:27:40.607142 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:27:40.607112    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode103985d_2289_4b76_a324_320563a0c350.slice/crio-971f8fb0c640fa1c3375857791249bd1ad9f0de8b54a2b332b4829fa1f9a1894 WatchSource:0}: Error finding container 971f8fb0c640fa1c3375857791249bd1ad9f0de8b54a2b332b4829fa1f9a1894: Status 404 returned error can't find the container with id 971f8fb0c640fa1c3375857791249bd1ad9f0de8b54a2b332b4829fa1f9a1894
Jul 15 16:27:40.803948 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.803867    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-m5plh"]
Jul 15 16:27:40.810309 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.810288    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-m5plh"
Jul 15 16:27:40.813084 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.813065    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 15 16:27:40.821386 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.821363    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-m5plh"]
Jul 15 16:27:40.839468 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.839444    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-42ffq"]
Jul 15 16:27:40.844688 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.844666    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-42ffq"
Jul 15 16:27:40.847424 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.847405    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-c5gq6\""
Jul 15 16:27:40.866406 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.866383    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-42ffq"]
Jul 15 16:27:40.952601 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.952572    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce90b6a1-2e7e-4495-ab83-0bfa357aa683-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-m5plh\" (UID: \"ce90b6a1-2e7e-4495-ab83-0bfa357aa683\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-m5plh"
Jul 15 16:27:40.952601 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.952606    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4zzb\" (UniqueName: \"kubernetes.io/projected/5441e553-15ff-49c6-972e-ff3b423b44ed-kube-api-access-n4zzb\") pod \"payload-pre-processing-74584bb9f8-42ffq\" (UID: \"5441e553-15ff-49c6-972e-ff3b423b44ed\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-42ffq"
Jul 15 16:27:40.952843 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.952647    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ttqp\" (UniqueName: \"kubernetes.io/projected/ce90b6a1-2e7e-4495-ab83-0bfa357aa683-kube-api-access-2ttqp\") pod \"payload-processing-f9b8d9b9b-m5plh\" (UID: \"ce90b6a1-2e7e-4495-ab83-0bfa357aa683\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-m5plh"
Jul 15 16:27:40.952843 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:40.952683    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5441e553-15ff-49c6-972e-ff3b423b44ed-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-42ffq\" (UID: \"5441e553-15ff-49c6-972e-ff3b423b44ed\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-42ffq"
Jul 15 16:27:41.053307 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:41.053278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce90b6a1-2e7e-4495-ab83-0bfa357aa683-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-m5plh\" (UID: \"ce90b6a1-2e7e-4495-ab83-0bfa357aa683\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-m5plh"
Jul 15 16:27:41.053307 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:41.053314    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4zzb\" (UniqueName: \"kubernetes.io/projected/5441e553-15ff-49c6-972e-ff3b423b44ed-kube-api-access-n4zzb\") pod \"payload-pre-processing-74584bb9f8-42ffq\" (UID: \"5441e553-15ff-49c6-972e-ff3b423b44ed\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-42ffq"
Jul 15 16:27:41.053582 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:41.053373    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ttqp\" (UniqueName: \"kubernetes.io/projected/ce90b6a1-2e7e-4495-ab83-0bfa357aa683-kube-api-access-2ttqp\") pod \"payload-processing-f9b8d9b9b-m5plh\" (UID: \"ce90b6a1-2e7e-4495-ab83-0bfa357aa683\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-m5plh"
Jul 15 16:27:41.053582 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:41.053395    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5441e553-15ff-49c6-972e-ff3b423b44ed-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-42ffq\" (UID: \"5441e553-15ff-49c6-972e-ff3b423b44ed\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-42ffq"
Jul 15 16:27:41.054106 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:41.054062    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce90b6a1-2e7e-4495-ab83-0bfa357aa683-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-m5plh\" (UID: \"ce90b6a1-2e7e-4495-ab83-0bfa357aa683\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-m5plh"
Jul 15 16:27:41.054106 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:41.054069    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5441e553-15ff-49c6-972e-ff3b423b44ed-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-42ffq\" (UID: \"5441e553-15ff-49c6-972e-ff3b423b44ed\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-42ffq"
Jul 15 16:27:41.065653 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:41.065622    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ttqp\" (UniqueName: \"kubernetes.io/projected/ce90b6a1-2e7e-4495-ab83-0bfa357aa683-kube-api-access-2ttqp\") pod \"payload-processing-f9b8d9b9b-m5plh\" (UID: \"ce90b6a1-2e7e-4495-ab83-0bfa357aa683\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-m5plh"
Jul 15 16:27:41.065777 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:41.065682    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4zzb\" (UniqueName: \"kubernetes.io/projected/5441e553-15ff-49c6-972e-ff3b423b44ed-kube-api-access-n4zzb\") pod \"payload-pre-processing-74584bb9f8-42ffq\" (UID: \"5441e553-15ff-49c6-972e-ff3b423b44ed\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-42ffq"
Jul 15 16:27:41.121870 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:41.121843    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-m5plh"
Jul 15 16:27:41.155575 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:41.155547    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-42ffq"
Jul 15 16:27:41.175642 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:41.175617    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq" event={"ID":"e103985d-2289-4b76-a324-320563a0c350","Type":"ContainerStarted","Data":"971f8fb0c640fa1c3375857791249bd1ad9f0de8b54a2b332b4829fa1f9a1894"}
Jul 15 16:27:41.322389 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:41.322362    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-m5plh"]
Jul 15 16:27:41.323891 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:27:41.323862    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce90b6a1_2e7e_4495_ab83_0bfa357aa683.slice/crio-db710818dee6ce00c7717f27dee9d59e383c63b50d905f9d09470c0815389eac WatchSource:0}: Error finding container db710818dee6ce00c7717f27dee9d59e383c63b50d905f9d09470c0815389eac: Status 404 returned error can't find the container with id db710818dee6ce00c7717f27dee9d59e383c63b50d905f9d09470c0815389eac
Jul 15 16:27:41.346245 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:41.346159    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-42ffq"]
Jul 15 16:27:41.348624 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:27:41.348587    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5441e553_15ff_49c6_972e_ff3b423b44ed.slice/crio-d5bcbdee266b9df84f35dee0de03b175079eeb08683a83b5b9aac816ee04a43f WatchSource:0}: Error finding container d5bcbdee266b9df84f35dee0de03b175079eeb08683a83b5b9aac816ee04a43f: Status 404 returned error can't find the container with id d5bcbdee266b9df84f35dee0de03b175079eeb08683a83b5b9aac816ee04a43f
Jul 15 16:27:42.185154 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:42.185111    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-m5plh" event={"ID":"ce90b6a1-2e7e-4495-ab83-0bfa357aa683","Type":"ContainerStarted","Data":"db710818dee6ce00c7717f27dee9d59e383c63b50d905f9d09470c0815389eac"}
Jul 15 16:27:42.186893 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:42.186829    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-42ffq" event={"ID":"5441e553-15ff-49c6-972e-ff3b423b44ed","Type":"ContainerStarted","Data":"d5bcbdee266b9df84f35dee0de03b175079eeb08683a83b5b9aac816ee04a43f"}
Jul 15 16:27:43.193146 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:43.193056    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-42ffq" event={"ID":"5441e553-15ff-49c6-972e-ff3b423b44ed","Type":"ContainerStarted","Data":"47a450cd575cc8710e39e3c17928b9fe853eeb7f8c252802042a1c4ad2e9f67b"}
Jul 15 16:27:43.193146 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:43.193132    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-42ffq"
Jul 15 16:27:43.194675 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:43.194651    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq" event={"ID":"e103985d-2289-4b76-a324-320563a0c350","Type":"ContainerStarted","Data":"8600ca7b045605a92c36f4185230ddca352ee74aaf45f4b377c768e8b8ad2620"}
Jul 15 16:27:43.194742 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:43.194700    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq"
Jul 15 16:27:43.196062 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:43.196043    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-m5plh" event={"ID":"ce90b6a1-2e7e-4495-ab83-0bfa357aa683","Type":"ContainerStarted","Data":"0c92445725cd7c56b54e40a8acc0926d49ce60b20eff652179698208b46bb123"}
Jul 15 16:27:43.196187 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:43.196157    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-m5plh"
Jul 15 16:27:43.211614 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:43.211561    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-42ffq" podStartSLOduration=1.75692657 podStartE2EDuration="3.211545058s" totalImagesPullingTime="1.454618488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:27:43.210753147 +0000 UTC m=+710.748578802" watchObservedRunningTime="2026-07-15 16:27:43.211545058 +0000 UTC m=+710.749370715"
Jul 15 16:27:43.229909 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:43.229868    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq" podStartSLOduration=1.5154454149999999 podStartE2EDuration="3.229854504s" totalImagesPullingTime="1.714409089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:27:43.22904699 +0000 UTC m=+710.766872668" watchObservedRunningTime="2026-07-15 16:27:43.229854504 +0000 UTC m=+710.767680159"
Jul 15 16:27:43.248803 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:43.248763    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-m5plh" podStartSLOduration=1.766644388 podStartE2EDuration="3.248750342s" totalImagesPullingTime="1.482105954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:27:43.24759211 +0000 UTC m=+710.785417766" watchObservedRunningTime="2026-07-15 16:27:43.248750342 +0000 UTC m=+710.786575999"
Jul 15 16:27:49.209395 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:49.209361    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5484fd6ff-zcmzq"
Jul 15 16:27:51.240911 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:51.240882    2582 generic.go:356] "Generic (PLEG): container finished" podID="c067a8e3-b716-429b-bb35-796f8ef55d08" containerID="7cfef16eb2c0ef76ede074b50753ef601ee88cd136866c1abc5bea9fe9101fd7" exitCode=0
Jul 15 16:27:51.241269 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:51.240927    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv" event={"ID":"c067a8e3-b716-429b-bb35-796f8ef55d08","Type":"ContainerDied","Data":"7cfef16eb2c0ef76ede074b50753ef601ee88cd136866c1abc5bea9fe9101fd7"}
Jul 15 16:27:51.241314 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:51.241303    2582 scope.go:117] "RemoveContainer" containerID="7cfef16eb2c0ef76ede074b50753ef601ee88cd136866c1abc5bea9fe9101fd7"
Jul 15 16:27:51.242434 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:51.242404    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:27:51.242501 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:51.242473    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:27:51.242539 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:51.242510    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:27:52.249188 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:52.249148    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv" event={"ID":"c067a8e3-b716-429b-bb35-796f8ef55d08","Type":"ContainerStarted","Data":"442ed9e05c700d69060d47a1e555e677d78b6cd0bef9d136450fdb1810f99e8a"}
Jul 15 16:27:52.979044 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:52.978668    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-sh5pv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 15 16:27:52.979044 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:52.978737    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv" podUID="c067a8e3-b716-429b-bb35-796f8ef55d08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 15 16:27:52.980242 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:52.980209    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:27:53.970857 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:53.970807    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-sh5pv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 15 16:27:53.971370 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:53.970892    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv" podUID="c067a8e3-b716-429b-bb35-796f8ef55d08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 15 16:27:54.205211 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:54.205184    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-m5plh"
Jul 15 16:27:54.205406 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:54.205362    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-42ffq"
Jul 15 16:27:54.970831 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:54.970787    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-sh5pv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 15 16:27:54.971049 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:54.970873    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv" podUID="c067a8e3-b716-429b-bb35-796f8ef55d08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 15 16:27:55.971354 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:55.971288    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-sh5pv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 15 16:27:55.971857 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:55.971381    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv" podUID="c067a8e3-b716-429b-bb35-796f8ef55d08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 15 16:27:56.722196 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:56.722147    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:27:56.977358 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:56.977251    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:27:57.275684 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:27:57.275603    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-sh5pv"
Jul 15 16:28:37.526377 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.526332    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"]
Jul 15 16:28:37.529791 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.529774    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.532566 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.532545    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 16:28:37.533827 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.533806    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cb2r6\""
Jul 15 16:28:37.533827 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.533817    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 15 16:28:37.533984 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.533847    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 16:28:37.542085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.542064    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"]
Jul 15 16:28:37.568615 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.568587    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03b21b5e-0e5d-4a8c-b1e3-a826ebdad436-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n\" (UID: \"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.568724 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.568640    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03b21b5e-0e5d-4a8c-b1e3-a826ebdad436-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n\" (UID: \"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.568724 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.568692    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03b21b5e-0e5d-4a8c-b1e3-a826ebdad436-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n\" (UID: \"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.568810 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.568742    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rzqc\" (UniqueName: \"kubernetes.io/projected/03b21b5e-0e5d-4a8c-b1e3-a826ebdad436-kube-api-access-5rzqc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n\" (UID: \"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.568810 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.568797    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03b21b5e-0e5d-4a8c-b1e3-a826ebdad436-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n\" (UID: \"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.568889 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.568826    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03b21b5e-0e5d-4a8c-b1e3-a826ebdad436-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n\" (UID: \"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.670276 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.670246    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03b21b5e-0e5d-4a8c-b1e3-a826ebdad436-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n\" (UID: \"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.670424 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.670278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03b21b5e-0e5d-4a8c-b1e3-a826ebdad436-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n\" (UID: \"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.670473 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.670415    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rzqc\" (UniqueName: \"kubernetes.io/projected/03b21b5e-0e5d-4a8c-b1e3-a826ebdad436-kube-api-access-5rzqc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n\" (UID: \"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.670518 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.670485    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03b21b5e-0e5d-4a8c-b1e3-a826ebdad436-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n\" (UID: \"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.670563 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.670515    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03b21b5e-0e5d-4a8c-b1e3-a826ebdad436-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n\" (UID: \"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.670616 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.670583    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03b21b5e-0e5d-4a8c-b1e3-a826ebdad436-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n\" (UID: \"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.670666 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.670625    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03b21b5e-0e5d-4a8c-b1e3-a826ebdad436-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n\" (UID: \"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.670666 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.670653    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03b21b5e-0e5d-4a8c-b1e3-a826ebdad436-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n\" (UID: \"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.670850 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.670831    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03b21b5e-0e5d-4a8c-b1e3-a826ebdad436-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n\" (UID: \"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.673002 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.672979    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03b21b5e-0e5d-4a8c-b1e3-a826ebdad436-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n\" (UID: \"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.673245 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.673223    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03b21b5e-0e5d-4a8c-b1e3-a826ebdad436-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n\" (UID: \"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.678769 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.678746    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rzqc\" (UniqueName: \"kubernetes.io/projected/03b21b5e-0e5d-4a8c-b1e3-a826ebdad436-kube-api-access-5rzqc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n\" (UID: \"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.842684 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.842586    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:37.976793 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.976765    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"]
Jul 15 16:28:37.978063 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:28:37.978037    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b21b5e_0e5d_4a8c_b1e3_a826ebdad436.slice/crio-7503b69e146b87af5fb8885a4c4ba0cf673cdbd00ed07c3a60af15cdeeb4b087 WatchSource:0}: Error finding container 7503b69e146b87af5fb8885a4c4ba0cf673cdbd00ed07c3a60af15cdeeb4b087: Status 404 returned error can't find the container with id 7503b69e146b87af5fb8885a4c4ba0cf673cdbd00ed07c3a60af15cdeeb4b087
Jul 15 16:28:37.979318 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:37.979299    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 16:28:38.478355 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:38.478280    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n" event={"ID":"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436","Type":"ContainerStarted","Data":"7503b69e146b87af5fb8885a4c4ba0cf673cdbd00ed07c3a60af15cdeeb4b087"}
Jul 15 16:28:39.485127 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:39.485091    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n" event={"ID":"03b21b5e-0e5d-4a8c-b1e3-a826ebdad436","Type":"ContainerStarted","Data":"4d2b1ec22935e4f432571b73e91565a99070c16731d7447cab4f5b6e16b0ce8e"}
Jul 15 16:28:39.510590 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:39.510542    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n" podStartSLOduration=1.420832616 podStartE2EDuration="2.510527284s" totalImagesPullingTime="1.089694668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:28:39.509451469 +0000 UTC m=+767.047277139" watchObservedRunningTime="2026-07-15 16:28:39.510527284 +0000 UTC m=+767.048352960"
Jul 15 16:28:46.750795 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.750767    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"]
Jul 15 16:28:46.755297 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.755281    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:46.759643 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.759622    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 15 16:28:46.775107 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.775085    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"]
Jul 15 16:28:46.853162 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.853127    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2pmp\" (UniqueName: \"kubernetes.io/projected/a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4-kube-api-access-d2pmp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rfcx\" (UID: \"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:46.853316 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.853173    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rfcx\" (UID: \"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:46.853316 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.853212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rfcx\" (UID: \"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:46.853316 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.853252    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rfcx\" (UID: \"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:46.853316 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.853279    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rfcx\" (UID: \"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:46.853489 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.853313    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rfcx\" (UID: \"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:46.954583 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.954534    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rfcx\" (UID: \"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:46.954583 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.954586    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rfcx\" (UID: \"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:46.954776 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.954708    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rfcx\" (UID: \"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:46.954833 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.954814    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2pmp\" (UniqueName: \"kubernetes.io/projected/a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4-kube-api-access-d2pmp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rfcx\" (UID: \"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:46.954865 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.954852    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rfcx\" (UID: \"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:46.954911 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.954901    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rfcx\" (UID: \"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:46.955035 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.955010    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rfcx\" (UID: \"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:46.955035 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.955030    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rfcx\" (UID: \"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:46.955192 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.955168    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rfcx\" (UID: \"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:46.956952 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.956930    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rfcx\" (UID: \"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:46.957011 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.956939    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rfcx\" (UID: \"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:46.963134 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:46.963112    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2pmp\" (UniqueName: \"kubernetes.io/projected/a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4-kube-api-access-d2pmp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5rfcx\" (UID: \"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:47.065567 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:47.065485    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:47.198396 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:47.198374    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"]
Jul 15 16:28:47.200248 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:28:47.200220    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda97018fa_fe9d_4fbf_9d3e_ed3c2691b6f4.slice/crio-a43e398a9e2f60c834da3d2c36a77f3e290c1caa148d48e0e2266de10b2bd7b2 WatchSource:0}: Error finding container a43e398a9e2f60c834da3d2c36a77f3e290c1caa148d48e0e2266de10b2bd7b2: Status 404 returned error can't find the container with id a43e398a9e2f60c834da3d2c36a77f3e290c1caa148d48e0e2266de10b2bd7b2
Jul 15 16:28:47.523015 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:47.522976    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx" event={"ID":"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4","Type":"ContainerStarted","Data":"97c47063fd54fcf55e4dba3c435f749b46e298b915f3371179012478cb97c8d3"}
Jul 15 16:28:47.523157 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:47.523041    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx" event={"ID":"a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4","Type":"ContainerStarted","Data":"a43e398a9e2f60c834da3d2c36a77f3e290c1caa148d48e0e2266de10b2bd7b2"}
Jul 15 16:28:47.842749 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:47.842720    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:47.843098 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:47.842779    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:47.854952 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:47.854926    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:47.878494 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:47.878449    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx" podStartSLOduration=1.675338456 podStartE2EDuration="1.878435377s" totalImagesPullingTime="203.096921ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:28:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:28:47.542311173 +0000 UTC m=+775.080136830" watchObservedRunningTime="2026-07-15 16:28:47.878435377 +0000 UTC m=+775.416261042"
Jul 15 16:28:48.539987 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:48.539958    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n"
Jul 15 16:28:57.066379 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:57.066323    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:57.066784 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:57.066432    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:57.081976 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:57.081938    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:28:57.585253 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:28:57.585216    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5rfcx"
Jul 15 16:30:52.943106 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:30:52.943024    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:30:52.945520 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:30:52.945485    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:30:52.950385 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:30:52.950366    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:30:52.952220 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:30:52.952204    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:31:14.189143 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:14.189106    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cff9854fb-w9fxw"]
Jul 15 16:31:14.189680 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:14.189318    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6cff9854fb-w9fxw" podUID="bfaba5ea-2a04-4496-b8d4-91b90f58df0c" containerName="manager" containerID="cri-o://1b05c117ffee10218a69c74128ef3a02bfed3ab830310fb36d323f8ed8d68a9b" gracePeriod=30
Jul 15 16:31:14.448193 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:14.448137    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cff9854fb-w9fxw"
Jul 15 16:31:14.497937 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:14.497907    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjr72\" (UniqueName: \"kubernetes.io/projected/bfaba5ea-2a04-4496-b8d4-91b90f58df0c-kube-api-access-xjr72\") pod \"bfaba5ea-2a04-4496-b8d4-91b90f58df0c\" (UID: \"bfaba5ea-2a04-4496-b8d4-91b90f58df0c\") "
Jul 15 16:31:14.497937 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:14.497940    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfaba5ea-2a04-4496-b8d4-91b90f58df0c-webhook-cert\") pod \"bfaba5ea-2a04-4496-b8d4-91b90f58df0c\" (UID: \"bfaba5ea-2a04-4496-b8d4-91b90f58df0c\") "
Jul 15 16:31:14.500062 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:14.500026    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfaba5ea-2a04-4496-b8d4-91b90f58df0c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bfaba5ea-2a04-4496-b8d4-91b90f58df0c" (UID: "bfaba5ea-2a04-4496-b8d4-91b90f58df0c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:31:14.500170 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:14.500072    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfaba5ea-2a04-4496-b8d4-91b90f58df0c-kube-api-access-xjr72" (OuterVolumeSpecName: "kube-api-access-xjr72") pod "bfaba5ea-2a04-4496-b8d4-91b90f58df0c" (UID: "bfaba5ea-2a04-4496-b8d4-91b90f58df0c"). InnerVolumeSpecName "kube-api-access-xjr72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:31:14.598767 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:14.598741    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjr72\" (UniqueName: \"kubernetes.io/projected/bfaba5ea-2a04-4496-b8d4-91b90f58df0c-kube-api-access-xjr72\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:31:14.598767 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:14.598766    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfaba5ea-2a04-4496-b8d4-91b90f58df0c-webhook-cert\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:31:15.221866 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:15.221830    2582 generic.go:356] "Generic (PLEG): container finished" podID="bfaba5ea-2a04-4496-b8d4-91b90f58df0c" containerID="1b05c117ffee10218a69c74128ef3a02bfed3ab830310fb36d323f8ed8d68a9b" exitCode=0
Jul 15 16:31:15.222315 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:15.221874    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cff9854fb-w9fxw" event={"ID":"bfaba5ea-2a04-4496-b8d4-91b90f58df0c","Type":"ContainerDied","Data":"1b05c117ffee10218a69c74128ef3a02bfed3ab830310fb36d323f8ed8d68a9b"}
Jul 15 16:31:15.222315 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:15.221882    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cff9854fb-w9fxw"
Jul 15 16:31:15.222315 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:15.221923    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cff9854fb-w9fxw" event={"ID":"bfaba5ea-2a04-4496-b8d4-91b90f58df0c","Type":"ContainerDied","Data":"55ee32a091a46c2868500c997c85ff425e0530ba295d679cfd7d88bd0d8bb22e"}
Jul 15 16:31:15.222315 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:15.221955    2582 scope.go:117] "RemoveContainer" containerID="1b05c117ffee10218a69c74128ef3a02bfed3ab830310fb36d323f8ed8d68a9b"
Jul 15 16:31:15.230359 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:15.230328    2582 scope.go:117] "RemoveContainer" containerID="88db022fc48328102160eb67d156129be36b7790947acbbb244ab45c9e276dfa"
Jul 15 16:31:15.237473 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:15.237454    2582 scope.go:117] "RemoveContainer" containerID="1b05c117ffee10218a69c74128ef3a02bfed3ab830310fb36d323f8ed8d68a9b"
Jul 15 16:31:15.237701 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:31:15.237684    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b05c117ffee10218a69c74128ef3a02bfed3ab830310fb36d323f8ed8d68a9b\": container with ID starting with 1b05c117ffee10218a69c74128ef3a02bfed3ab830310fb36d323f8ed8d68a9b not found: ID does not exist" containerID="1b05c117ffee10218a69c74128ef3a02bfed3ab830310fb36d323f8ed8d68a9b"
Jul 15 16:31:15.237739 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:15.237708    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b05c117ffee10218a69c74128ef3a02bfed3ab830310fb36d323f8ed8d68a9b"} err="failed to get container status \"1b05c117ffee10218a69c74128ef3a02bfed3ab830310fb36d323f8ed8d68a9b\": rpc error: code = NotFound desc = could not find container \"1b05c117ffee10218a69c74128ef3a02bfed3ab830310fb36d323f8ed8d68a9b\": container with ID starting with 1b05c117ffee10218a69c74128ef3a02bfed3ab830310fb36d323f8ed8d68a9b not found: ID does not exist"
Jul 15 16:31:15.237739 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:15.237722    2582 scope.go:117] "RemoveContainer" containerID="88db022fc48328102160eb67d156129be36b7790947acbbb244ab45c9e276dfa"
Jul 15 16:31:15.237922 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:31:15.237906    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88db022fc48328102160eb67d156129be36b7790947acbbb244ab45c9e276dfa\": container with ID starting with 88db022fc48328102160eb67d156129be36b7790947acbbb244ab45c9e276dfa not found: ID does not exist" containerID="88db022fc48328102160eb67d156129be36b7790947acbbb244ab45c9e276dfa"
Jul 15 16:31:15.237964 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:15.237928    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88db022fc48328102160eb67d156129be36b7790947acbbb244ab45c9e276dfa"} err="failed to get container status \"88db022fc48328102160eb67d156129be36b7790947acbbb244ab45c9e276dfa\": rpc error: code = NotFound desc = could not find container \"88db022fc48328102160eb67d156129be36b7790947acbbb244ab45c9e276dfa\": container with ID starting with 88db022fc48328102160eb67d156129be36b7790947acbbb244ab45c9e276dfa not found: ID does not exist"
Jul 15 16:31:15.242623 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:15.242576    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cff9854fb-w9fxw"]
Jul 15 16:31:15.250843 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:15.250822    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6cff9854fb-w9fxw"]
Jul 15 16:31:16.092286 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.092253    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cff9854fb-v77nm"]
Jul 15 16:31:16.092630 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.092618    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfaba5ea-2a04-4496-b8d4-91b90f58df0c" containerName="manager"
Jul 15 16:31:16.092675 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.092631    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfaba5ea-2a04-4496-b8d4-91b90f58df0c" containerName="manager"
Jul 15 16:31:16.092675 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.092652    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfaba5ea-2a04-4496-b8d4-91b90f58df0c" containerName="manager"
Jul 15 16:31:16.092675 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.092657    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfaba5ea-2a04-4496-b8d4-91b90f58df0c" containerName="manager"
Jul 15 16:31:16.092771 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.092722    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfaba5ea-2a04-4496-b8d4-91b90f58df0c" containerName="manager"
Jul 15 16:31:16.092771 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.092728    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfaba5ea-2a04-4496-b8d4-91b90f58df0c" containerName="manager"
Jul 15 16:31:16.097030 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.097015    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cff9854fb-v77nm"
Jul 15 16:31:16.101065 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.101028    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 16:31:16.101186 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.101141    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bdx69\""
Jul 15 16:31:16.101262 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.101184    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 16:31:16.106521 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.106501    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cff9854fb-v77nm"]
Jul 15 16:31:16.110375 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.110352    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1aefef03-b9c8-4c11-9388-a8e0c7f427da-webhook-cert\") pod \"maas-controller-6cff9854fb-v77nm\" (UID: \"1aefef03-b9c8-4c11-9388-a8e0c7f427da\") " pod="opendatahub/maas-controller-6cff9854fb-v77nm"
Jul 15 16:31:16.110466 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.110403    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttgxs\" (UniqueName: \"kubernetes.io/projected/1aefef03-b9c8-4c11-9388-a8e0c7f427da-kube-api-access-ttgxs\") pod \"maas-controller-6cff9854fb-v77nm\" (UID: \"1aefef03-b9c8-4c11-9388-a8e0c7f427da\") " pod="opendatahub/maas-controller-6cff9854fb-v77nm"
Jul 15 16:31:16.211230 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.211202    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1aefef03-b9c8-4c11-9388-a8e0c7f427da-webhook-cert\") pod \"maas-controller-6cff9854fb-v77nm\" (UID: \"1aefef03-b9c8-4c11-9388-a8e0c7f427da\") " pod="opendatahub/maas-controller-6cff9854fb-v77nm"
Jul 15 16:31:16.211376 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.211245    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttgxs\" (UniqueName: \"kubernetes.io/projected/1aefef03-b9c8-4c11-9388-a8e0c7f427da-kube-api-access-ttgxs\") pod \"maas-controller-6cff9854fb-v77nm\" (UID: \"1aefef03-b9c8-4c11-9388-a8e0c7f427da\") " pod="opendatahub/maas-controller-6cff9854fb-v77nm"
Jul 15 16:31:16.213571 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.213547    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1aefef03-b9c8-4c11-9388-a8e0c7f427da-webhook-cert\") pod \"maas-controller-6cff9854fb-v77nm\" (UID: \"1aefef03-b9c8-4c11-9388-a8e0c7f427da\") " pod="opendatahub/maas-controller-6cff9854fb-v77nm"
Jul 15 16:31:16.219801 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.219778    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttgxs\" (UniqueName: \"kubernetes.io/projected/1aefef03-b9c8-4c11-9388-a8e0c7f427da-kube-api-access-ttgxs\") pod \"maas-controller-6cff9854fb-v77nm\" (UID: \"1aefef03-b9c8-4c11-9388-a8e0c7f427da\") " pod="opendatahub/maas-controller-6cff9854fb-v77nm"
Jul 15 16:31:16.407677 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.407595    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cff9854fb-v77nm"
Jul 15 16:31:16.556231 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.556209    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cff9854fb-v77nm"]
Jul 15 16:31:16.558233 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:31:16.558209    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aefef03_b9c8_4c11_9388_a8e0c7f427da.slice/crio-80ff0b540d6a8af5562aa3d1908f3a67757c3c5be55ba7f8cc6d5f5d8101d000 WatchSource:0}: Error finding container 80ff0b540d6a8af5562aa3d1908f3a67757c3c5be55ba7f8cc6d5f5d8101d000: Status 404 returned error can't find the container with id 80ff0b540d6a8af5562aa3d1908f3a67757c3c5be55ba7f8cc6d5f5d8101d000
Jul 15 16:31:16.977228 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:16.977196    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfaba5ea-2a04-4496-b8d4-91b90f58df0c" path="/var/lib/kubelet/pods/bfaba5ea-2a04-4496-b8d4-91b90f58df0c/volumes"
Jul 15 16:31:17.234174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:17.234099    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cff9854fb-v77nm" event={"ID":"1aefef03-b9c8-4c11-9388-a8e0c7f427da","Type":"ContainerStarted","Data":"eee445a4600c99b1a6e93d9215b97c97460689e1afd0956c027022f3251886c8"}
Jul 15 16:31:17.234174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:17.234154    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cff9854fb-v77nm" event={"ID":"1aefef03-b9c8-4c11-9388-a8e0c7f427da","Type":"ContainerStarted","Data":"80ff0b540d6a8af5562aa3d1908f3a67757c3c5be55ba7f8cc6d5f5d8101d000"}
Jul 15 16:31:17.234385 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:17.234241    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cff9854fb-v77nm"
Jul 15 16:31:17.252881 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:17.252833    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cff9854fb-v77nm" podStartSLOduration=0.772224314 podStartE2EDuration="1.252820062s" totalImagesPullingTime="480.595748ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:31:17.25201377 +0000 UTC m=+924.789839427" watchObservedRunningTime="2026-07-15 16:31:17.252820062 +0000 UTC m=+924.790645718"
Jul 15 16:31:28.241077 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:31:28.241048    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cff9854fb-v77nm"
Jul 15 16:35:52.974202 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:35:52.974111    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:35:52.974202 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:35:52.974135    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:35:52.988615 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:35:52.988591    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:35:52.988764 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:35:52.988681    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:40:53.010620 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:40:53.010581    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:40:53.011380 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:40:53.011361    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:40:53.017377 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:40:53.017356    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:40:53.018143 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:40:53.018126    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:43:31.814892 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:31.814853    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"]
Jul 15 16:43:31.817754 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:31.817735    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:31.820530 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:31.820512    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-51d2510e-openshift-default-dockercfg-8pbxg\""
Jul 15 16:43:31.851246 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:31.851195    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"]
Jul 15 16:43:31.922543 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:31.922517    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-workload-socket\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:31.922692 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:31.922556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-data\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:31.922692 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:31.922585    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-envoy\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:31.922692 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:31.922611    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-token\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:31.922692 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:31.922656    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-credential-socket\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:31.922692 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:31.922687    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-workload-certs\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:31.922855 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:31.922702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5kst\" (UniqueName: \"kubernetes.io/projected/07bf63c1-6ad5-4bb8-bb38-71ba67254596-kube-api-access-q5kst\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:31.922855 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:31.922727    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-podinfo\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:31.922855 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:31.922750    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istiod-ca-cert\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.023496 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.023460    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-data\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.023639 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.023503    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-envoy\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.023639 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.023530    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-token\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.023639 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.023587    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-credential-socket\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.023639 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.023621    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-workload-certs\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.023868 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.023643    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5kst\" (UniqueName: \"kubernetes.io/projected/07bf63c1-6ad5-4bb8-bb38-71ba67254596-kube-api-access-q5kst\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.023868 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.023764    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-podinfo\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.023868 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.023800    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istiod-ca-cert\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.023868 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.023847    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-workload-socket\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.024052 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.023849    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-data\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.024200 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.024179    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-credential-socket\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.024268 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.024226    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-workload-certs\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.024312 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.024278    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-workload-socket\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.024555 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.024534    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istiod-ca-cert\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.025907 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.025888    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-envoy\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.026101 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.026085    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-podinfo\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.033058 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.032999    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5kst\" (UniqueName: \"kubernetes.io/projected/07bf63c1-6ad5-4bb8-bb38-71ba67254596-kube-api-access-q5kst\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.033292 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.033276    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-token\") pod \"e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") " pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.128372 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.128324    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:32.268045 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.268021    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"]
Jul 15 16:43:32.270392 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:43:32.270359    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07bf63c1_6ad5_4bb8_bb38_71ba67254596.slice/crio-048bb90d1215099e10a720e31d0e6e6d30c4723ad710ed3c5b93f59b88dbdc96 WatchSource:0}: Error finding container 048bb90d1215099e10a720e31d0e6e6d30c4723ad710ed3c5b93f59b88dbdc96: Status 404 returned error can't find the container with id 048bb90d1215099e10a720e31d0e6e6d30c4723ad710ed3c5b93f59b88dbdc96
Jul 15 16:43:32.272670 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.272627    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:43:32.272740 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.272726    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:43:32.272788 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.272771    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:43:32.697670 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.697578    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx" event={"ID":"07bf63c1-6ad5-4bb8-bb38-71ba67254596","Type":"ContainerStarted","Data":"662cffc030a1931b45ee6723a6f6def1842cc6fc5e1143a6604fde481de91ed9"}
Jul 15 16:43:32.697670 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.697629    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx" event={"ID":"07bf63c1-6ad5-4bb8-bb38-71ba67254596","Type":"ContainerStarted","Data":"048bb90d1215099e10a720e31d0e6e6d30c4723ad710ed3c5b93f59b88dbdc96"}
Jul 15 16:43:32.722427 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:32.722382    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx" podStartSLOduration=1.7223679 podStartE2EDuration="1.7223679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:43:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:32.719461091 +0000 UTC m=+1660.257286768" watchObservedRunningTime="2026-07-15 16:43:32.7223679 +0000 UTC m=+1660.260193580"
Jul 15 16:43:33.128503 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:33.128463    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:33.130409 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:33.130380    2582 patch_prober.go:28] interesting pod/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 15 16:43:33.130537 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:33.130444    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx" podUID="07bf63c1-6ad5-4bb8-bb38-71ba67254596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 15 16:43:33.153204 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:33.153179    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"]
Jul 15 16:43:33.156853 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:33.156832    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"
Jul 15 16:43:33.160225 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:33.160209    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-51d2510e-serving-cert\""
Jul 15 16:43:33.173010 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:33.172983    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"]
Jul 15 16:43:33.234079 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:33.234039    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs6m4\" (UniqueName: \"kubernetes.io/projected/133454df-e198-4385-af63-3fb359e4c8fd-kube-api-access-gs6m4\") pod \"maas-api-e2e-ait-51d2510e-78c68446c7-djrg8\" (UID: \"133454df-e198-4385-af63-3fb359e4c8fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"
Jul 15 16:43:33.234229 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:33.234116    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133454df-e198-4385-af63-3fb359e4c8fd-maas-api-tls\") pod \"maas-api-e2e-ait-51d2510e-78c68446c7-djrg8\" (UID: \"133454df-e198-4385-af63-3fb359e4c8fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"
Jul 15 16:43:33.234229 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:33.234142    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133454df-e198-4385-af63-3fb359e4c8fd-openshift-service-ca\") pod \"maas-api-e2e-ait-51d2510e-78c68446c7-djrg8\" (UID: \"133454df-e198-4385-af63-3fb359e4c8fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"
Jul 15 16:43:33.335105 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:33.335072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs6m4\" (UniqueName: \"kubernetes.io/projected/133454df-e198-4385-af63-3fb359e4c8fd-kube-api-access-gs6m4\") pod \"maas-api-e2e-ait-51d2510e-78c68446c7-djrg8\" (UID: \"133454df-e198-4385-af63-3fb359e4c8fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"
Jul 15 16:43:33.335283 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:33.335119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133454df-e198-4385-af63-3fb359e4c8fd-maas-api-tls\") pod \"maas-api-e2e-ait-51d2510e-78c68446c7-djrg8\" (UID: \"133454df-e198-4385-af63-3fb359e4c8fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"
Jul 15 16:43:33.335283 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:33.335137    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133454df-e198-4385-af63-3fb359e4c8fd-openshift-service-ca\") pod \"maas-api-e2e-ait-51d2510e-78c68446c7-djrg8\" (UID: \"133454df-e198-4385-af63-3fb359e4c8fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"
Jul 15 16:43:33.335283 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:43:33.335242    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-serving-cert: secret "maas-api-e2e-ait-51d2510e-serving-cert" not found
Jul 15 16:43:33.335503 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:43:33.335313    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/133454df-e198-4385-af63-3fb359e4c8fd-maas-api-tls podName:133454df-e198-4385-af63-3fb359e4c8fd nodeName:}" failed. No retries permitted until 2026-07-15 16:43:33.83529289 +0000 UTC m=+1661.373118530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/133454df-e198-4385-af63-3fb359e4c8fd-maas-api-tls") pod "maas-api-e2e-ait-51d2510e-78c68446c7-djrg8" (UID: "133454df-e198-4385-af63-3fb359e4c8fd") : secret "maas-api-e2e-ait-51d2510e-serving-cert" not found
Jul 15 16:43:33.335743 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:33.335727    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133454df-e198-4385-af63-3fb359e4c8fd-openshift-service-ca\") pod \"maas-api-e2e-ait-51d2510e-78c68446c7-djrg8\" (UID: \"133454df-e198-4385-af63-3fb359e4c8fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"
Jul 15 16:43:33.350807 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:33.350779    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs6m4\" (UniqueName: \"kubernetes.io/projected/133454df-e198-4385-af63-3fb359e4c8fd-kube-api-access-gs6m4\") pod \"maas-api-e2e-ait-51d2510e-78c68446c7-djrg8\" (UID: \"133454df-e198-4385-af63-3fb359e4c8fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"
Jul 15 16:43:33.839410 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:33.839379    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133454df-e198-4385-af63-3fb359e4c8fd-maas-api-tls\") pod \"maas-api-e2e-ait-51d2510e-78c68446c7-djrg8\" (UID: \"133454df-e198-4385-af63-3fb359e4c8fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"
Jul 15 16:43:33.841878 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:33.841856    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133454df-e198-4385-af63-3fb359e4c8fd-maas-api-tls\") pod \"maas-api-e2e-ait-51d2510e-78c68446c7-djrg8\" (UID: \"133454df-e198-4385-af63-3fb359e4c8fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"
Jul 15 16:43:34.070001 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:34.069969    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"
Jul 15 16:43:34.134857 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:34.134832    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:34.426475 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:34.426445    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"]
Jul 15 16:43:34.427973 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:43:34.427949    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod133454df_e198_4385_af63_3fb359e4c8fd.slice/crio-5a29c4882e064c1015a581cfecba3db024c90ab72107df2ea8a2207c668273ee WatchSource:0}: Error finding container 5a29c4882e064c1015a581cfecba3db024c90ab72107df2ea8a2207c668273ee: Status 404 returned error can't find the container with id 5a29c4882e064c1015a581cfecba3db024c90ab72107df2ea8a2207c668273ee
Jul 15 16:43:34.429585 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:34.429567    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 16:43:34.708995 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:34.708962    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8" event={"ID":"133454df-e198-4385-af63-3fb359e4c8fd","Type":"ContainerStarted","Data":"5a29c4882e064c1015a581cfecba3db024c90ab72107df2ea8a2207c668273ee"}
Jul 15 16:43:34.709251 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:34.709227    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:34.710328 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:34.710311    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:37.725511 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:37.725478    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8" event={"ID":"133454df-e198-4385-af63-3fb359e4c8fd","Type":"ContainerStarted","Data":"949870118e01b74cea1abc94e769925a731d1ec16e8ce304ca33bc2dc74528c8"}
Jul 15 16:43:37.725883 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:37.725547    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"
Jul 15 16:43:37.748144 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:37.748099    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8" podStartSLOduration=1.596070089 podStartE2EDuration="4.748085328s" totalImagesPullingTime="3.152015239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:43:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:37.745763277 +0000 UTC m=+1665.283588934" watchObservedRunningTime="2026-07-15 16:43:37.748085328 +0000 UTC m=+1665.285910984"
Jul 15 16:43:43.736328 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:43.736292    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"
Jul 15 16:43:44.759542 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:44.759508    2582 generic.go:356] "Generic (PLEG): container finished" podID="07bf63c1-6ad5-4bb8-bb38-71ba67254596" containerID="662cffc030a1931b45ee6723a6f6def1842cc6fc5e1143a6604fde481de91ed9" exitCode=0
Jul 15 16:43:44.759943 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:44.759582    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx" event={"ID":"07bf63c1-6ad5-4bb8-bb38-71ba67254596","Type":"ContainerDied","Data":"662cffc030a1931b45ee6723a6f6def1842cc6fc5e1143a6604fde481de91ed9"}
Jul 15 16:43:44.759943 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:44.759931    2582 scope.go:117] "RemoveContainer" containerID="662cffc030a1931b45ee6723a6f6def1842cc6fc5e1143a6604fde481de91ed9"
Jul 15 16:43:44.760878 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:44.760846    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:43:44.760969 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:44.760930    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:43:44.761030 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:44.760987    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:43:45.766354 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:45.766312    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx" event={"ID":"07bf63c1-6ad5-4bb8-bb38-71ba67254596","Type":"ContainerStarted","Data":"17ee58491ff8e872be9d704ed8b38cc974dc1fad985aba48aeb097fbd25cd205"}
Jul 15 16:43:46.129122 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:46.129037    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:46.130209 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:46.130188    2582 patch_prober.go:28] interesting pod/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 15 16:43:46.130266 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:46.130246    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx" podUID="07bf63c1-6ad5-4bb8-bb38-71ba67254596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 15 16:43:47.129571 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:47.129536    2582 patch_prober.go:28] interesting pod/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 15 16:43:47.129951 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:47.129606    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx" podUID="07bf63c1-6ad5-4bb8-bb38-71ba67254596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 15 16:43:48.129513 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:48.129477    2582 patch_prober.go:28] interesting pod/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 15 16:43:48.129677 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:48.129544    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx" podUID="07bf63c1-6ad5-4bb8-bb38-71ba67254596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 15 16:43:49.129140 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:49.129104    2582 patch_prober.go:28] interesting pod/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 15 16:43:49.129321 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:49.129159    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx" podUID="07bf63c1-6ad5-4bb8-bb38-71ba67254596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 15 16:43:49.710136 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:49.710096    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:50.129061 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:50.128977    2582 patch_prober.go:28] interesting pod/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 15 16:43:50.129061 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:50.129030    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx" podUID="07bf63c1-6ad5-4bb8-bb38-71ba67254596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 15 16:43:51.128666 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:51.128634    2582 patch_prober.go:28] interesting pod/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 15 16:43:51.129030 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:51.128684    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx" podUID="07bf63c1-6ad5-4bb8-bb38-71ba67254596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 15 16:43:52.128717 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:52.128679    2582 patch_prober.go:28] interesting pod/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 15 16:43:52.129105 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:52.128736    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx" podUID="07bf63c1-6ad5-4bb8-bb38-71ba67254596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 15 16:43:53.132550 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:53.132518    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:43:53.133575 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:43:53.133556    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:44:38.864699 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:38.864626    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"]
Jul 15 16:44:38.865264 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:38.864828    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8" podUID="133454df-e198-4385-af63-3fb359e4c8fd" containerName="maas-api" containerID="cri-o://949870118e01b74cea1abc94e769925a731d1ec16e8ce304ca33bc2dc74528c8" gracePeriod=30
Jul 15 16:44:39.028929 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:39.028899    2582 generic.go:356] "Generic (PLEG): container finished" podID="133454df-e198-4385-af63-3fb359e4c8fd" containerID="949870118e01b74cea1abc94e769925a731d1ec16e8ce304ca33bc2dc74528c8" exitCode=0
Jul 15 16:44:39.029080 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:39.028984    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8" event={"ID":"133454df-e198-4385-af63-3fb359e4c8fd","Type":"ContainerDied","Data":"949870118e01b74cea1abc94e769925a731d1ec16e8ce304ca33bc2dc74528c8"}
Jul 15 16:44:39.109267 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:39.109245    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"
Jul 15 16:44:39.198520 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:39.198490    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133454df-e198-4385-af63-3fb359e4c8fd-openshift-service-ca\") pod \"133454df-e198-4385-af63-3fb359e4c8fd\" (UID: \"133454df-e198-4385-af63-3fb359e4c8fd\") "
Jul 15 16:44:39.198643 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:39.198568    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gs6m4\" (UniqueName: \"kubernetes.io/projected/133454df-e198-4385-af63-3fb359e4c8fd-kube-api-access-gs6m4\") pod \"133454df-e198-4385-af63-3fb359e4c8fd\" (UID: \"133454df-e198-4385-af63-3fb359e4c8fd\") "
Jul 15 16:44:39.198643 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:39.198623    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133454df-e198-4385-af63-3fb359e4c8fd-maas-api-tls\") pod \"133454df-e198-4385-af63-3fb359e4c8fd\" (UID: \"133454df-e198-4385-af63-3fb359e4c8fd\") "
Jul 15 16:44:39.198865 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:39.198840    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/133454df-e198-4385-af63-3fb359e4c8fd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "133454df-e198-4385-af63-3fb359e4c8fd" (UID: "133454df-e198-4385-af63-3fb359e4c8fd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:44:39.198971 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:39.198953    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133454df-e198-4385-af63-3fb359e4c8fd-openshift-service-ca\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:44:39.200654 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:39.200634    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/133454df-e198-4385-af63-3fb359e4c8fd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "133454df-e198-4385-af63-3fb359e4c8fd" (UID: "133454df-e198-4385-af63-3fb359e4c8fd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:44:39.200767 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:39.200746    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/133454df-e198-4385-af63-3fb359e4c8fd-kube-api-access-gs6m4" (OuterVolumeSpecName: "kube-api-access-gs6m4") pod "133454df-e198-4385-af63-3fb359e4c8fd" (UID: "133454df-e198-4385-af63-3fb359e4c8fd"). InnerVolumeSpecName "kube-api-access-gs6m4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:44:39.300220 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:39.300190    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs6m4\" (UniqueName: \"kubernetes.io/projected/133454df-e198-4385-af63-3fb359e4c8fd-kube-api-access-gs6m4\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:44:39.300220 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:39.300218    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133454df-e198-4385-af63-3fb359e4c8fd-maas-api-tls\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:44:40.034378 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:40.034321    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8" event={"ID":"133454df-e198-4385-af63-3fb359e4c8fd","Type":"ContainerDied","Data":"5a29c4882e064c1015a581cfecba3db024c90ab72107df2ea8a2207c668273ee"}
Jul 15 16:44:40.034790 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:40.034387    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"
Jul 15 16:44:40.034790 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:40.034413    2582 scope.go:117] "RemoveContainer" containerID="949870118e01b74cea1abc94e769925a731d1ec16e8ce304ca33bc2dc74528c8"
Jul 15 16:44:40.057815 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:40.057791    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"]
Jul 15 16:44:40.059556 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:40.059517    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-51d2510e-78c68446c7-djrg8"]
Jul 15 16:44:40.977034 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:40.976997    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="133454df-e198-4385-af63-3fb359e4c8fd" path="/var/lib/kubelet/pods/133454df-e198-4385-af63-3fb359e4c8fd/volumes"
Jul 15 16:44:53.455100 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:53.455069    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"]
Jul 15 16:44:53.455535 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:53.455277    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx" podUID="07bf63c1-6ad5-4bb8-bb38-71ba67254596" containerName="istio-proxy" containerID="cri-o://17ee58491ff8e872be9d704ed8b38cc974dc1fad985aba48aeb097fbd25cd205" gracePeriod=30
Jul 15 16:44:55.388140 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:55.388109    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"]
Jul 15 16:44:55.388617 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:55.388557    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="133454df-e198-4385-af63-3fb359e4c8fd" containerName="maas-api"
Jul 15 16:44:55.388617 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:55.388576    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="133454df-e198-4385-af63-3fb359e4c8fd" containerName="maas-api"
Jul 15 16:44:55.388730 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:55.388707    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="133454df-e198-4385-af63-3fb359e4c8fd" containerName="maas-api"
Jul 15 16:44:55.391832 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:55.391808    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"
Jul 15 16:44:55.395005 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:55.394985    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-439e5009-serving-cert\""
Jul 15 16:44:55.405009 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:55.404990    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"]
Jul 15 16:44:55.433577 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:55.433555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7025e005-a408-40c1-b855-af8e29c78565-maas-api-tls\") pod \"maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf\" (UID: \"7025e005-a408-40c1-b855-af8e29c78565\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"
Jul 15 16:44:55.433682 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:55.433582    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7025e005-a408-40c1-b855-af8e29c78565-openshift-service-ca\") pod \"maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf\" (UID: \"7025e005-a408-40c1-b855-af8e29c78565\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"
Jul 15 16:44:55.433682 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:55.433602    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mrz8\" (UniqueName: \"kubernetes.io/projected/7025e005-a408-40c1-b855-af8e29c78565-kube-api-access-9mrz8\") pod \"maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf\" (UID: \"7025e005-a408-40c1-b855-af8e29c78565\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"
Jul 15 16:44:55.534312 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:55.534277    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7025e005-a408-40c1-b855-af8e29c78565-maas-api-tls\") pod \"maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf\" (UID: \"7025e005-a408-40c1-b855-af8e29c78565\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"
Jul 15 16:44:55.534312 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:55.534313    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7025e005-a408-40c1-b855-af8e29c78565-openshift-service-ca\") pod \"maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf\" (UID: \"7025e005-a408-40c1-b855-af8e29c78565\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"
Jul 15 16:44:55.534536 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:55.534349    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mrz8\" (UniqueName: \"kubernetes.io/projected/7025e005-a408-40c1-b855-af8e29c78565-kube-api-access-9mrz8\") pod \"maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf\" (UID: \"7025e005-a408-40c1-b855-af8e29c78565\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"
Jul 15 16:44:55.534593 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:44:55.534563    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-serving-cert: secret "maas-api-e2e-migrate-439e5009-serving-cert" not found
Jul 15 16:44:55.534646 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:44:55.534638    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7025e005-a408-40c1-b855-af8e29c78565-maas-api-tls podName:7025e005-a408-40c1-b855-af8e29c78565 nodeName:}" failed. No retries permitted until 2026-07-15 16:44:56.034618327 +0000 UTC m=+1743.572443973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7025e005-a408-40c1-b855-af8e29c78565-maas-api-tls") pod "maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf" (UID: "7025e005-a408-40c1-b855-af8e29c78565") : secret "maas-api-e2e-migrate-439e5009-serving-cert" not found
Jul 15 16:44:55.535030 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:55.535005    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7025e005-a408-40c1-b855-af8e29c78565-openshift-service-ca\") pod \"maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf\" (UID: \"7025e005-a408-40c1-b855-af8e29c78565\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"
Jul 15 16:44:55.550268 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:55.550242    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mrz8\" (UniqueName: \"kubernetes.io/projected/7025e005-a408-40c1-b855-af8e29c78565-kube-api-access-9mrz8\") pod \"maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf\" (UID: \"7025e005-a408-40c1-b855-af8e29c78565\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"
Jul 15 16:44:56.039446 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:56.039414    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7025e005-a408-40c1-b855-af8e29c78565-maas-api-tls\") pod \"maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf\" (UID: \"7025e005-a408-40c1-b855-af8e29c78565\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"
Jul 15 16:44:56.041728 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:56.041698    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7025e005-a408-40c1-b855-af8e29c78565-maas-api-tls\") pod \"maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf\" (UID: \"7025e005-a408-40c1-b855-af8e29c78565\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"
Jul 15 16:44:56.304007 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:56.303926    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"
Jul 15 16:44:56.444412 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:56.444387    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"]
Jul 15 16:44:56.445761 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:44:56.445733    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7025e005_a408_40c1_b855_af8e29c78565.slice/crio-9bc5dc6d42eb531fcdc54f8432b0b50dbc8d62075e1b18a205e83a1c30c2a235 WatchSource:0}: Error finding container 9bc5dc6d42eb531fcdc54f8432b0b50dbc8d62075e1b18a205e83a1c30c2a235: Status 404 returned error can't find the container with id 9bc5dc6d42eb531fcdc54f8432b0b50dbc8d62075e1b18a205e83a1c30c2a235
Jul 15 16:44:57.114761 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:57.114729    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf" event={"ID":"7025e005-a408-40c1-b855-af8e29c78565","Type":"ContainerStarted","Data":"9bc5dc6d42eb531fcdc54f8432b0b50dbc8d62075e1b18a205e83a1c30c2a235"}
Jul 15 16:44:58.120905 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.120872    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf" event={"ID":"7025e005-a408-40c1-b855-af8e29c78565","Type":"ContainerStarted","Data":"396301811ac1982d8ea8daaa0ec84567bc43d57ab92076715d62a9be90293699"}
Jul 15 16:44:58.121464 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.120961    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"
Jul 15 16:44:58.141277 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.141239    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf" podStartSLOduration=2.386308054 podStartE2EDuration="3.141225825s" totalImagesPullingTime="754.917771ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:44:58.139565362 +0000 UTC m=+1745.677391038" watchObservedRunningTime="2026-07-15 16:44:58.141225825 +0000 UTC m=+1745.679051499"
Jul 15 16:44:58.712240 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.712216    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:44:58.764680 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.764622    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-data\") pod \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") "
Jul 15 16:44:58.764680 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.764654    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-envoy\") pod \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") "
Jul 15 16:44:58.764680 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.764674    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-workload-socket\") pod \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") "
Jul 15 16:44:58.764881 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.764751    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-workload-certs\") pod \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") "
Jul 15 16:44:58.764881 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.764788    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-podinfo\") pod \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") "
Jul 15 16:44:58.764881 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.764825    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istiod-ca-cert\") pod \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") "
Jul 15 16:44:58.764881 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.764862    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-credential-socket\") pod \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") "
Jul 15 16:44:58.765315 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.764892    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-token\") pod \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") "
Jul 15 16:44:58.765315 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.764931    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5kst\" (UniqueName: \"kubernetes.io/projected/07bf63c1-6ad5-4bb8-bb38-71ba67254596-kube-api-access-q5kst\") pod \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\" (UID: \"07bf63c1-6ad5-4bb8-bb38-71ba67254596\") "
Jul 15 16:44:58.765315 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.764983    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07bf63c1-6ad5-4bb8-bb38-71ba67254596" (UID: "07bf63c1-6ad5-4bb8-bb38-71ba67254596"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:44:58.765315 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.765209    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07bf63c1-6ad5-4bb8-bb38-71ba67254596" (UID: "07bf63c1-6ad5-4bb8-bb38-71ba67254596"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:44:58.765315 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.765309    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-credential-socket\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:44:58.765695 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.765327    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-workload-socket\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:44:58.765695 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.765555    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07bf63c1-6ad5-4bb8-bb38-71ba67254596" (UID: "07bf63c1-6ad5-4bb8-bb38-71ba67254596"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:44:58.765695 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.765590    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-data" (OuterVolumeSpecName: "istio-data") pod "07bf63c1-6ad5-4bb8-bb38-71ba67254596" (UID: "07bf63c1-6ad5-4bb8-bb38-71ba67254596"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:44:58.765695 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.765607    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07bf63c1-6ad5-4bb8-bb38-71ba67254596" (UID: "07bf63c1-6ad5-4bb8-bb38-71ba67254596"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:44:58.766868 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.766846    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07bf63c1-6ad5-4bb8-bb38-71ba67254596" (UID: "07bf63c1-6ad5-4bb8-bb38-71ba67254596"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:44:58.767073 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.767044    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-token" (OuterVolumeSpecName: "istio-token") pod "07bf63c1-6ad5-4bb8-bb38-71ba67254596" (UID: "07bf63c1-6ad5-4bb8-bb38-71ba67254596"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:44:58.767391 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.767361    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07bf63c1-6ad5-4bb8-bb38-71ba67254596" (UID: "07bf63c1-6ad5-4bb8-bb38-71ba67254596"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:44:58.767846 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.767816    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07bf63c1-6ad5-4bb8-bb38-71ba67254596-kube-api-access-q5kst" (OuterVolumeSpecName: "kube-api-access-q5kst") pod "07bf63c1-6ad5-4bb8-bb38-71ba67254596" (UID: "07bf63c1-6ad5-4bb8-bb38-71ba67254596"). InnerVolumeSpecName "kube-api-access-q5kst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:44:58.866743 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.866715    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-data\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:44:58.866743 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.866739    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-envoy\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:44:58.866743 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.866747    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07bf63c1-6ad5-4bb8-bb38-71ba67254596-workload-certs\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:44:58.866919 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.866777    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-podinfo\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:44:58.866919 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.866785    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istiod-ca-cert\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:44:58.866919 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.866793    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07bf63c1-6ad5-4bb8-bb38-71ba67254596-istio-token\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:44:58.866919 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:58.866800    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5kst\" (UniqueName: \"kubernetes.io/projected/07bf63c1-6ad5-4bb8-bb38-71ba67254596-kube-api-access-q5kst\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:44:59.127028 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:59.126953    2582 generic.go:356] "Generic (PLEG): container finished" podID="07bf63c1-6ad5-4bb8-bb38-71ba67254596" containerID="17ee58491ff8e872be9d704ed8b38cc974dc1fad985aba48aeb097fbd25cd205" exitCode=0
Jul 15 16:44:59.127028 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:59.126999    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"
Jul 15 16:44:59.127510 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:59.127039    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx" event={"ID":"07bf63c1-6ad5-4bb8-bb38-71ba67254596","Type":"ContainerDied","Data":"17ee58491ff8e872be9d704ed8b38cc974dc1fad985aba48aeb097fbd25cd205"}
Jul 15 16:44:59.127510 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:59.127090    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx" event={"ID":"07bf63c1-6ad5-4bb8-bb38-71ba67254596","Type":"ContainerDied","Data":"048bb90d1215099e10a720e31d0e6e6d30c4723ad710ed3c5b93f59b88dbdc96"}
Jul 15 16:44:59.127510 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:59.127114    2582 scope.go:117] "RemoveContainer" containerID="17ee58491ff8e872be9d704ed8b38cc974dc1fad985aba48aeb097fbd25cd205"
Jul 15 16:44:59.135927 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:59.135912    2582 scope.go:117] "RemoveContainer" containerID="662cffc030a1931b45ee6723a6f6def1842cc6fc5e1143a6604fde481de91ed9"
Jul 15 16:44:59.145509 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:59.145489    2582 scope.go:117] "RemoveContainer" containerID="17ee58491ff8e872be9d704ed8b38cc974dc1fad985aba48aeb097fbd25cd205"
Jul 15 16:44:59.145940 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:44:59.145811    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17ee58491ff8e872be9d704ed8b38cc974dc1fad985aba48aeb097fbd25cd205\": container with ID starting with 17ee58491ff8e872be9d704ed8b38cc974dc1fad985aba48aeb097fbd25cd205 not found: ID does not exist" containerID="17ee58491ff8e872be9d704ed8b38cc974dc1fad985aba48aeb097fbd25cd205"
Jul 15 16:44:59.145940 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:59.145845    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17ee58491ff8e872be9d704ed8b38cc974dc1fad985aba48aeb097fbd25cd205"} err="failed to get container status \"17ee58491ff8e872be9d704ed8b38cc974dc1fad985aba48aeb097fbd25cd205\": rpc error: code = NotFound desc = could not find container \"17ee58491ff8e872be9d704ed8b38cc974dc1fad985aba48aeb097fbd25cd205\": container with ID starting with 17ee58491ff8e872be9d704ed8b38cc974dc1fad985aba48aeb097fbd25cd205 not found: ID does not exist"
Jul 15 16:44:59.145940 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:59.145868    2582 scope.go:117] "RemoveContainer" containerID="662cffc030a1931b45ee6723a6f6def1842cc6fc5e1143a6604fde481de91ed9"
Jul 15 16:44:59.146211 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:44:59.146194    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"662cffc030a1931b45ee6723a6f6def1842cc6fc5e1143a6604fde481de91ed9\": container with ID starting with 662cffc030a1931b45ee6723a6f6def1842cc6fc5e1143a6604fde481de91ed9 not found: ID does not exist" containerID="662cffc030a1931b45ee6723a6f6def1842cc6fc5e1143a6604fde481de91ed9"
Jul 15 16:44:59.146285 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:59.146220    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"662cffc030a1931b45ee6723a6f6def1842cc6fc5e1143a6604fde481de91ed9"} err="failed to get container status \"662cffc030a1931b45ee6723a6f6def1842cc6fc5e1143a6604fde481de91ed9\": rpc error: code = NotFound desc = could not find container \"662cffc030a1931b45ee6723a6f6def1842cc6fc5e1143a6604fde481de91ed9\": container with ID starting with 662cffc030a1931b45ee6723a6f6def1842cc6fc5e1143a6604fde481de91ed9 not found: ID does not exist"
Jul 15 16:44:59.147974 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:59.147956    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"]
Jul 15 16:44:59.151223 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:44:59.151204    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-51d2510e-openshift-default-7bb65f9ff7-jzhhx"]
Jul 15 16:45:00.978993 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:45:00.978952    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07bf63c1-6ad5-4bb8-bb38-71ba67254596" path="/var/lib/kubelet/pods/07bf63c1-6ad5-4bb8-bb38-71ba67254596/volumes"
Jul 15 16:45:04.132159 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:45:04.132130    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"
Jul 15 16:45:53.045601 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:45:53.045565    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:45:53.049032 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:45:53.049009    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:45:53.052328 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:45:53.052308    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:45:53.055247 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:45:53.055230    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:46:00.602206 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:00.602173    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"]
Jul 15 16:46:00.602796 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:00.602401    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf" podUID="7025e005-a408-40c1-b855-af8e29c78565" containerName="maas-api" containerID="cri-o://396301811ac1982d8ea8daaa0ec84567bc43d57ab92076715d62a9be90293699" gracePeriod=30
Jul 15 16:46:00.855560 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:00.855497    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"
Jul 15 16:46:01.019410 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:01.019383    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mrz8\" (UniqueName: \"kubernetes.io/projected/7025e005-a408-40c1-b855-af8e29c78565-kube-api-access-9mrz8\") pod \"7025e005-a408-40c1-b855-af8e29c78565\" (UID: \"7025e005-a408-40c1-b855-af8e29c78565\") "
Jul 15 16:46:01.019568 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:01.019424    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7025e005-a408-40c1-b855-af8e29c78565-maas-api-tls\") pod \"7025e005-a408-40c1-b855-af8e29c78565\" (UID: \"7025e005-a408-40c1-b855-af8e29c78565\") "
Jul 15 16:46:01.019568 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:01.019447    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7025e005-a408-40c1-b855-af8e29c78565-openshift-service-ca\") pod \"7025e005-a408-40c1-b855-af8e29c78565\" (UID: \"7025e005-a408-40c1-b855-af8e29c78565\") "
Jul 15 16:46:01.019837 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:01.019805    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7025e005-a408-40c1-b855-af8e29c78565-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7025e005-a408-40c1-b855-af8e29c78565" (UID: "7025e005-a408-40c1-b855-af8e29c78565"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:46:01.021314 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:01.021293    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7025e005-a408-40c1-b855-af8e29c78565-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7025e005-a408-40c1-b855-af8e29c78565" (UID: "7025e005-a408-40c1-b855-af8e29c78565"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:46:01.021507 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:01.021486    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7025e005-a408-40c1-b855-af8e29c78565-kube-api-access-9mrz8" (OuterVolumeSpecName: "kube-api-access-9mrz8") pod "7025e005-a408-40c1-b855-af8e29c78565" (UID: "7025e005-a408-40c1-b855-af8e29c78565"). InnerVolumeSpecName "kube-api-access-9mrz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:46:01.120883 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:01.120800    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mrz8\" (UniqueName: \"kubernetes.io/projected/7025e005-a408-40c1-b855-af8e29c78565-kube-api-access-9mrz8\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:46:01.120883 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:01.120828    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7025e005-a408-40c1-b855-af8e29c78565-maas-api-tls\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:46:01.120883 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:01.120838    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7025e005-a408-40c1-b855-af8e29c78565-openshift-service-ca\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:46:01.422539 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:01.422451    2582 generic.go:356] "Generic (PLEG): container finished" podID="7025e005-a408-40c1-b855-af8e29c78565" containerID="396301811ac1982d8ea8daaa0ec84567bc43d57ab92076715d62a9be90293699" exitCode=0
Jul 15 16:46:01.422539 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:01.422500    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"
Jul 15 16:46:01.422720 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:01.422537    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf" event={"ID":"7025e005-a408-40c1-b855-af8e29c78565","Type":"ContainerDied","Data":"396301811ac1982d8ea8daaa0ec84567bc43d57ab92076715d62a9be90293699"}
Jul 15 16:46:01.422720 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:01.422597    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf" event={"ID":"7025e005-a408-40c1-b855-af8e29c78565","Type":"ContainerDied","Data":"9bc5dc6d42eb531fcdc54f8432b0b50dbc8d62075e1b18a205e83a1c30c2a235"}
Jul 15 16:46:01.422720 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:01.422619    2582 scope.go:117] "RemoveContainer" containerID="396301811ac1982d8ea8daaa0ec84567bc43d57ab92076715d62a9be90293699"
Jul 15 16:46:01.431596 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:01.431580    2582 scope.go:117] "RemoveContainer" containerID="396301811ac1982d8ea8daaa0ec84567bc43d57ab92076715d62a9be90293699"
Jul 15 16:46:01.431845 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:46:01.431829    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"396301811ac1982d8ea8daaa0ec84567bc43d57ab92076715d62a9be90293699\": container with ID starting with 396301811ac1982d8ea8daaa0ec84567bc43d57ab92076715d62a9be90293699 not found: ID does not exist" containerID="396301811ac1982d8ea8daaa0ec84567bc43d57ab92076715d62a9be90293699"
Jul 15 16:46:01.431884 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:01.431853    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"396301811ac1982d8ea8daaa0ec84567bc43d57ab92076715d62a9be90293699"} err="failed to get container status \"396301811ac1982d8ea8daaa0ec84567bc43d57ab92076715d62a9be90293699\": rpc error: code = NotFound desc = could not find container \"396301811ac1982d8ea8daaa0ec84567bc43d57ab92076715d62a9be90293699\": container with ID starting with 396301811ac1982d8ea8daaa0ec84567bc43d57ab92076715d62a9be90293699 not found: ID does not exist"
Jul 15 16:46:01.444439 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:01.444416    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"]
Jul 15 16:46:01.450839 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:01.450810    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-439e5009-67fcfdcd58-g7gbf"]
Jul 15 16:46:02.978086 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:02.978050    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7025e005-a408-40c1-b855-af8e29c78565" path="/var/lib/kubelet/pods/7025e005-a408-40c1-b855-af8e29c78565/volumes"
Jul 15 16:46:06.431452 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.431421    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"]
Jul 15 16:46:06.431826 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.431814    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7025e005-a408-40c1-b855-af8e29c78565" containerName="maas-api"
Jul 15 16:46:06.431826 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.431826    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7025e005-a408-40c1-b855-af8e29c78565" containerName="maas-api"
Jul 15 16:46:06.431899 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.431835    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07bf63c1-6ad5-4bb8-bb38-71ba67254596" containerName="istio-proxy"
Jul 15 16:46:06.431899 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.431841    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="07bf63c1-6ad5-4bb8-bb38-71ba67254596" containerName="istio-proxy"
Jul 15 16:46:06.431899 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.431848    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07bf63c1-6ad5-4bb8-bb38-71ba67254596" containerName="istio-proxy"
Jul 15 16:46:06.431899 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.431854    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="07bf63c1-6ad5-4bb8-bb38-71ba67254596" containerName="istio-proxy"
Jul 15 16:46:06.432024 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.431914    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7025e005-a408-40c1-b855-af8e29c78565" containerName="maas-api"
Jul 15 16:46:06.432024 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.431924    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="07bf63c1-6ad5-4bb8-bb38-71ba67254596" containerName="istio-proxy"
Jul 15 16:46:06.432024 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.431930    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="07bf63c1-6ad5-4bb8-bb38-71ba67254596" containerName="istio-proxy"
Jul 15 16:46:06.436393 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.436371    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.439369 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.439326    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3ac1ded3-openshift-default-dockercfg-dktj6\""
Jul 15 16:46:06.448748 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.448724    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"]
Jul 15 16:46:06.569121 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.569087    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-envoy\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.569121 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.569123    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07f57cb1-930d-4fc1-a610-03146d6dc016-istiod-ca-cert\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.569371 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.569198    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-workload-certs\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.569371 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.569259    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-workload-socket\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.569371 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.569281    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-credential-socket\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.569371 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.569299    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-podinfo\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.569371 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.569323    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-data\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.569649 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.569500    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-token\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.569649 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.569541    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-566p4\" (UniqueName: \"kubernetes.io/projected/07f57cb1-930d-4fc1-a610-03146d6dc016-kube-api-access-566p4\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.670678 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.670639    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-workload-certs\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.670860 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.670687    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-workload-socket\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.670860 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.670718    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-credential-socket\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.670860 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.670744    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-podinfo\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.670860 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.670771    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-data\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.670860 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.670828    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-token\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.670860 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.670851    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-566p4\" (UniqueName: \"kubernetes.io/projected/07f57cb1-930d-4fc1-a610-03146d6dc016-kube-api-access-566p4\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.671177 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.670910    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-envoy\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.671177 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.670933    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07f57cb1-930d-4fc1-a610-03146d6dc016-istiod-ca-cert\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.671275 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.671174    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-workload-socket\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.671275 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.671261    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-workload-certs\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.671395 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.671360    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-data\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.671537 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.671506    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-credential-socket\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.671937 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.671918    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07f57cb1-930d-4fc1-a610-03146d6dc016-istiod-ca-cert\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.673542 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.673511    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-envoy\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.673875 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.673857    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-podinfo\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.680274 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.680250    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-token\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.680375 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.680323    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-566p4\" (UniqueName: \"kubernetes.io/projected/07f57cb1-930d-4fc1-a610-03146d6dc016-kube-api-access-566p4\") pod \"e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") " pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.748971 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.748931    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:06.889630 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.889605    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"]
Jul 15 16:46:06.891731 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:46:06.891702    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07f57cb1_930d_4fc1_a610_03146d6dc016.slice/crio-f4b548224f1c3407d9cf2104ee1d73749b05a7b087307750f1af0e299fc457e3 WatchSource:0}: Error finding container f4b548224f1c3407d9cf2104ee1d73749b05a7b087307750f1af0e299fc457e3: Status 404 returned error can't find the container with id f4b548224f1c3407d9cf2104ee1d73749b05a7b087307750f1af0e299fc457e3
Jul 15 16:46:06.893822 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.893791    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:46:06.893895 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.893857    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:46:06.893895 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:06.893883    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:46:07.454925 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:07.454888    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw" event={"ID":"07f57cb1-930d-4fc1-a610-03146d6dc016","Type":"ContainerStarted","Data":"6c1deaa0416fabb1025d8e4702db391694df37d73b3554b0761353d2e485777e"}
Jul 15 16:46:07.455360 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:07.454941    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw" event={"ID":"07f57cb1-930d-4fc1-a610-03146d6dc016","Type":"ContainerStarted","Data":"f4b548224f1c3407d9cf2104ee1d73749b05a7b087307750f1af0e299fc457e3"}
Jul 15 16:46:07.476998 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:07.476944    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw" podStartSLOduration=1.476922215 podStartE2EDuration="1.476922215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:46:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:46:07.475395664 +0000 UTC m=+1815.013221338" watchObservedRunningTime="2026-07-15 16:46:07.476922215 +0000 UTC m=+1815.014747872"
Jul 15 16:46:07.645461 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:07.645432    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"]
Jul 15 16:46:07.648996 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:07.648977    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"
Jul 15 16:46:07.651863 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:07.651839    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3ac1ded3-serving-cert\""
Jul 15 16:46:07.661641 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:07.661613    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"]
Jul 15 16:46:07.750181 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:07.750105    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:07.754677 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:07.754656    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:07.781146 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:07.781116    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6wp5\" (UniqueName: \"kubernetes.io/projected/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-kube-api-access-c6wp5\") pod \"maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv\" (UID: \"c0c99d06-4e67-4ba9-bd13-e0308f44d81e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"
Jul 15 16:46:07.781303 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:07.781173    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-openshift-service-ca\") pod \"maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv\" (UID: \"c0c99d06-4e67-4ba9-bd13-e0308f44d81e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"
Jul 15 16:46:07.781384 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:07.781296    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-maas-api-tls\") pod \"maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv\" (UID: \"c0c99d06-4e67-4ba9-bd13-e0308f44d81e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"
Jul 15 16:46:07.882286 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:07.882257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-openshift-service-ca\") pod \"maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv\" (UID: \"c0c99d06-4e67-4ba9-bd13-e0308f44d81e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"
Jul 15 16:46:07.882459 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:07.882314    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-maas-api-tls\") pod \"maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv\" (UID: \"c0c99d06-4e67-4ba9-bd13-e0308f44d81e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"
Jul 15 16:46:07.882459 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:07.882375    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6wp5\" (UniqueName: \"kubernetes.io/projected/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-kube-api-access-c6wp5\") pod \"maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv\" (UID: \"c0c99d06-4e67-4ba9-bd13-e0308f44d81e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"
Jul 15 16:46:07.882604 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:46:07.882487    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-serving-cert: secret "maas-api-e2e-ait-3ac1ded3-serving-cert" not found
Jul 15 16:46:07.882604 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:46:07.882556    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-maas-api-tls podName:c0c99d06-4e67-4ba9-bd13-e0308f44d81e nodeName:}" failed. No retries permitted until 2026-07-15 16:46:08.382536994 +0000 UTC m=+1815.920362633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-maas-api-tls") pod "maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv" (UID: "c0c99d06-4e67-4ba9-bd13-e0308f44d81e") : secret "maas-api-e2e-ait-3ac1ded3-serving-cert" not found
Jul 15 16:46:07.882956 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:07.882925    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-openshift-service-ca\") pod \"maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv\" (UID: \"c0c99d06-4e67-4ba9-bd13-e0308f44d81e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"
Jul 15 16:46:07.891179 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:07.891154    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6wp5\" (UniqueName: \"kubernetes.io/projected/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-kube-api-access-c6wp5\") pod \"maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv\" (UID: \"c0c99d06-4e67-4ba9-bd13-e0308f44d81e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"
Jul 15 16:46:08.386896 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:08.386851    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-maas-api-tls\") pod \"maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv\" (UID: \"c0c99d06-4e67-4ba9-bd13-e0308f44d81e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"
Jul 15 16:46:08.389254 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:08.389232    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-maas-api-tls\") pod \"maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv\" (UID: \"c0c99d06-4e67-4ba9-bd13-e0308f44d81e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"
Jul 15 16:46:08.461062 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:08.461022    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:08.461919 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:08.461901    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:08.560471 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:08.560427    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"
Jul 15 16:46:08.731560 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:08.731535    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"]
Jul 15 16:46:08.733951 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:46:08.733928    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c99d06_4e67_4ba9_bd13_e0308f44d81e.slice/crio-28cba493ad8da91a8ce0b27456712821aa0b2d36dbb0fef555b4fe84967a6a3b WatchSource:0}: Error finding container 28cba493ad8da91a8ce0b27456712821aa0b2d36dbb0fef555b4fe84967a6a3b: Status 404 returned error can't find the container with id 28cba493ad8da91a8ce0b27456712821aa0b2d36dbb0fef555b4fe84967a6a3b
Jul 15 16:46:09.467632 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:09.467592    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv" event={"ID":"c0c99d06-4e67-4ba9-bd13-e0308f44d81e","Type":"ContainerStarted","Data":"28cba493ad8da91a8ce0b27456712821aa0b2d36dbb0fef555b4fe84967a6a3b"}
Jul 15 16:46:10.474701 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:10.474665    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv" event={"ID":"c0c99d06-4e67-4ba9-bd13-e0308f44d81e","Type":"ContainerStarted","Data":"3782d73f66d875eddbec0ef0c256024aed28ef3859f69066e83b1a071f6c366a"}
Jul 15 16:46:10.475059 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:10.474740    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"
Jul 15 16:46:10.496572 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:10.496524    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv" podStartSLOduration=2.626262678 podStartE2EDuration="3.496508967s" totalImagesPullingTime="870.246289ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:46:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:46:10.494513703 +0000 UTC m=+1818.032339379" watchObservedRunningTime="2026-07-15 16:46:10.496508967 +0000 UTC m=+1818.034334622"
Jul 15 16:46:16.484969 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:16.484939    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"
Jul 15 16:46:24.197911 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:24.196915    2582 patch_prober.go:28] interesting pod/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:35008->10.132.0.47:15021: read: connection reset by peer" start-of-body=
Jul 15 16:46:24.197911 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:24.196995    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw" podUID="07f57cb1-930d-4fc1-a610-03146d6dc016" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:35008->10.132.0.47:15021: read: connection reset by peer"
Jul 15 16:46:24.543192 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:24.543159    2582 generic.go:356] "Generic (PLEG): container finished" podID="07f57cb1-930d-4fc1-a610-03146d6dc016" containerID="6c1deaa0416fabb1025d8e4702db391694df37d73b3554b0761353d2e485777e" exitCode=0
Jul 15 16:46:24.543434 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:24.543202    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw" event={"ID":"07f57cb1-930d-4fc1-a610-03146d6dc016","Type":"ContainerDied","Data":"6c1deaa0416fabb1025d8e4702db391694df37d73b3554b0761353d2e485777e"}
Jul 15 16:46:24.543695 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:24.543677    2582 scope.go:117] "RemoveContainer" containerID="6c1deaa0416fabb1025d8e4702db391694df37d73b3554b0761353d2e485777e"
Jul 15 16:46:24.544713 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:24.544681    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:46:24.544805 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:24.544755    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:46:24.544805 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:24.544787    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:46:25.550048 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:25.550012    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw" event={"ID":"07f57cb1-930d-4fc1-a610-03146d6dc016","Type":"ContainerStarted","Data":"6f8107dcf8780c3e0538aafc9bd1811b5f1b96df3f1a1048748f21467e96f7f4"}
Jul 15 16:46:25.749518 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:25.749481    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:25.749818 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:25.749792    2582 patch_prober.go:28] interesting pod/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 15 16:46:25.749924 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:25.749860    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw" podUID="07f57cb1-930d-4fc1-a610-03146d6dc016" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 15 16:46:26.749253 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:26.749214    2582 patch_prober.go:28] interesting pod/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 15 16:46:26.749745 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:26.749289    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw" podUID="07f57cb1-930d-4fc1-a610-03146d6dc016" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 15 16:46:27.750144 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:27.750110    2582 patch_prober.go:28] interesting pod/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 15 16:46:27.750567 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:27.750181    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw" podUID="07f57cb1-930d-4fc1-a610-03146d6dc016" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 15 16:46:28.750210 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:28.750172    2582 patch_prober.go:28] interesting pod/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 15 16:46:28.750629 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:28.750233    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw" podUID="07f57cb1-930d-4fc1-a610-03146d6dc016" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 15 16:46:29.750140 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:29.750101    2582 patch_prober.go:28] interesting pod/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 15 16:46:29.750367 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:29.750160    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw" podUID="07f57cb1-930d-4fc1-a610-03146d6dc016" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 15 16:46:30.753470 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:30.753442    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:30.753905 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:30.753796    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:46:30.754516 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:46:30.754498    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:47:13.469553 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.468884    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"]
Jul 15 16:47:13.469553 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.469127    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv" podUID="c0c99d06-4e67-4ba9-bd13-e0308f44d81e" containerName="maas-api" containerID="cri-o://3782d73f66d875eddbec0ef0c256024aed28ef3859f69066e83b1a071f6c366a" gracePeriod=30
Jul 15 16:47:13.721890 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.721834    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"
Jul 15 16:47:13.785887 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.785861    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-openshift-service-ca\") pod \"c0c99d06-4e67-4ba9-bd13-e0308f44d81e\" (UID: \"c0c99d06-4e67-4ba9-bd13-e0308f44d81e\") "
Jul 15 16:47:13.786020 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.785896    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6wp5\" (UniqueName: \"kubernetes.io/projected/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-kube-api-access-c6wp5\") pod \"c0c99d06-4e67-4ba9-bd13-e0308f44d81e\" (UID: \"c0c99d06-4e67-4ba9-bd13-e0308f44d81e\") "
Jul 15 16:47:13.786020 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.785947    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-maas-api-tls\") pod \"c0c99d06-4e67-4ba9-bd13-e0308f44d81e\" (UID: \"c0c99d06-4e67-4ba9-bd13-e0308f44d81e\") "
Jul 15 16:47:13.786207 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.786186    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c0c99d06-4e67-4ba9-bd13-e0308f44d81e" (UID: "c0c99d06-4e67-4ba9-bd13-e0308f44d81e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:47:13.787960 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.787938    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c0c99d06-4e67-4ba9-bd13-e0308f44d81e" (UID: "c0c99d06-4e67-4ba9-bd13-e0308f44d81e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:47:13.788080 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.788002    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-kube-api-access-c6wp5" (OuterVolumeSpecName: "kube-api-access-c6wp5") pod "c0c99d06-4e67-4ba9-bd13-e0308f44d81e" (UID: "c0c99d06-4e67-4ba9-bd13-e0308f44d81e"). InnerVolumeSpecName "kube-api-access-c6wp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:47:13.792975 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.792954    2582 generic.go:356] "Generic (PLEG): container finished" podID="c0c99d06-4e67-4ba9-bd13-e0308f44d81e" containerID="3782d73f66d875eddbec0ef0c256024aed28ef3859f69066e83b1a071f6c366a" exitCode=0
Jul 15 16:47:13.793072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.793025    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv" event={"ID":"c0c99d06-4e67-4ba9-bd13-e0308f44d81e","Type":"ContainerDied","Data":"3782d73f66d875eddbec0ef0c256024aed28ef3859f69066e83b1a071f6c366a"}
Jul 15 16:47:13.793072 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.793056    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"
Jul 15 16:47:13.793145 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.793080    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv" event={"ID":"c0c99d06-4e67-4ba9-bd13-e0308f44d81e","Type":"ContainerDied","Data":"28cba493ad8da91a8ce0b27456712821aa0b2d36dbb0fef555b4fe84967a6a3b"}
Jul 15 16:47:13.793145 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.793110    2582 scope.go:117] "RemoveContainer" containerID="3782d73f66d875eddbec0ef0c256024aed28ef3859f69066e83b1a071f6c366a"
Jul 15 16:47:13.808401 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.808376    2582 scope.go:117] "RemoveContainer" containerID="3782d73f66d875eddbec0ef0c256024aed28ef3859f69066e83b1a071f6c366a"
Jul 15 16:47:13.808868 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:47:13.808849    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3782d73f66d875eddbec0ef0c256024aed28ef3859f69066e83b1a071f6c366a\": container with ID starting with 3782d73f66d875eddbec0ef0c256024aed28ef3859f69066e83b1a071f6c366a not found: ID does not exist" containerID="3782d73f66d875eddbec0ef0c256024aed28ef3859f69066e83b1a071f6c366a"
Jul 15 16:47:13.808963 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.808876    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3782d73f66d875eddbec0ef0c256024aed28ef3859f69066e83b1a071f6c366a"} err="failed to get container status \"3782d73f66d875eddbec0ef0c256024aed28ef3859f69066e83b1a071f6c366a\": rpc error: code = NotFound desc = could not find container \"3782d73f66d875eddbec0ef0c256024aed28ef3859f69066e83b1a071f6c366a\": container with ID starting with 3782d73f66d875eddbec0ef0c256024aed28ef3859f69066e83b1a071f6c366a not found: ID does not exist"
Jul 15 16:47:13.817963 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.817904    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"]
Jul 15 16:47:13.820414 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.820390    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ac1ded3-6587d8cf46-b9txv"]
Jul 15 16:47:13.886726 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.886705    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-openshift-service-ca\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:47:13.886726 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.886724    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6wp5\" (UniqueName: \"kubernetes.io/projected/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-kube-api-access-c6wp5\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:47:13.886843 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:13.886736    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0c99d06-4e67-4ba9-bd13-e0308f44d81e-maas-api-tls\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:47:14.977902 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:14.977824    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0c99d06-4e67-4ba9-bd13-e0308f44d81e" path="/var/lib/kubelet/pods/c0c99d06-4e67-4ba9-bd13-e0308f44d81e/volumes"
Jul 15 16:47:29.010645 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:29.010601    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"]
Jul 15 16:47:29.011251 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:29.010876    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw" podUID="07f57cb1-930d-4fc1-a610-03146d6dc016" containerName="istio-proxy" containerID="cri-o://6f8107dcf8780c3e0538aafc9bd1811b5f1b96df3f1a1048748f21467e96f7f4" gracePeriod=30
Jul 15 16:47:30.567089 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:30.567045    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"]
Jul 15 16:47:30.568199 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:30.568175    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0c99d06-4e67-4ba9-bd13-e0308f44d81e" containerName="maas-api"
Jul 15 16:47:30.568199 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:30.568200    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0c99d06-4e67-4ba9-bd13-e0308f44d81e" containerName="maas-api"
Jul 15 16:47:30.568515 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:30.568498    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0c99d06-4e67-4ba9-bd13-e0308f44d81e" containerName="maas-api"
Jul 15 16:47:30.574021 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:30.573958    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"
Jul 15 16:47:30.577440 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:30.577415    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-77b034d1-serving-cert\""
Jul 15 16:47:30.583753 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:30.583729    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"]
Jul 15 16:47:30.734434 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:30.734391    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cpf6\" (UniqueName: \"kubernetes.io/projected/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-kube-api-access-4cpf6\") pod \"maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm\" (UID: \"d9370ecf-4aa9-463e-9d8c-d1f648b5a479\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"
Jul 15 16:47:30.734595 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:30.734455    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-maas-api-tls\") pod \"maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm\" (UID: \"d9370ecf-4aa9-463e-9d8c-d1f648b5a479\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"
Jul 15 16:47:30.734595 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:30.734490    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-openshift-service-ca\") pod \"maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm\" (UID: \"d9370ecf-4aa9-463e-9d8c-d1f648b5a479\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"
Jul 15 16:47:30.756383 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:30.756353    2582 patch_prober.go:28] interesting pod/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 16:47:30.756528 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:30.756417    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw" podUID="07f57cb1-930d-4fc1-a610-03146d6dc016" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:47:30.835292 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:30.835217    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cpf6\" (UniqueName: \"kubernetes.io/projected/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-kube-api-access-4cpf6\") pod \"maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm\" (UID: \"d9370ecf-4aa9-463e-9d8c-d1f648b5a479\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"
Jul 15 16:47:30.835292 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:30.835258    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-maas-api-tls\") pod \"maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm\" (UID: \"d9370ecf-4aa9-463e-9d8c-d1f648b5a479\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"
Jul 15 16:47:30.835292 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:30.835277    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-openshift-service-ca\") pod \"maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm\" (UID: \"d9370ecf-4aa9-463e-9d8c-d1f648b5a479\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"
Jul 15 16:47:30.835529 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:47:30.835396    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-serving-cert: secret "maas-api-e2e-derive-77b034d1-serving-cert" not found
Jul 15 16:47:30.835529 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:47:30.835467    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-maas-api-tls podName:d9370ecf-4aa9-463e-9d8c-d1f648b5a479 nodeName:}" failed. No retries permitted until 2026-07-15 16:47:31.335447684 +0000 UTC m=+1898.873273325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-maas-api-tls") pod "maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm" (UID: "d9370ecf-4aa9-463e-9d8c-d1f648b5a479") : secret "maas-api-e2e-derive-77b034d1-serving-cert" not found
Jul 15 16:47:30.836054 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:30.836032    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-openshift-service-ca\") pod \"maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm\" (UID: \"d9370ecf-4aa9-463e-9d8c-d1f648b5a479\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"
Jul 15 16:47:30.844159 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:30.844134    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cpf6\" (UniqueName: \"kubernetes.io/projected/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-kube-api-access-4cpf6\") pod \"maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm\" (UID: \"d9370ecf-4aa9-463e-9d8c-d1f648b5a479\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"
Jul 15 16:47:31.339726 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:31.339681    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-maas-api-tls\") pod \"maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm\" (UID: \"d9370ecf-4aa9-463e-9d8c-d1f648b5a479\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"
Jul 15 16:47:31.342239 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:31.342207    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-maas-api-tls\") pod \"maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm\" (UID: \"d9370ecf-4aa9-463e-9d8c-d1f648b5a479\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"
Jul 15 16:47:31.486116 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:31.486077    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"
Jul 15 16:47:31.627585 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:31.627557    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"]
Jul 15 16:47:31.629830 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:47:31.629803    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9370ecf_4aa9_463e_9d8c_d1f648b5a479.slice/crio-381258c800c34d28208749d015240a776130255af670dc9449be06599b5340bb WatchSource:0}: Error finding container 381258c800c34d28208749d015240a776130255af670dc9449be06599b5340bb: Status 404 returned error can't find the container with id 381258c800c34d28208749d015240a776130255af670dc9449be06599b5340bb
Jul 15 16:47:31.883753 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:31.883661    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm" event={"ID":"d9370ecf-4aa9-463e-9d8c-d1f648b5a479","Type":"ContainerStarted","Data":"381258c800c34d28208749d015240a776130255af670dc9449be06599b5340bb"}
Jul 15 16:47:32.890202 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:32.890163    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm" event={"ID":"d9370ecf-4aa9-463e-9d8c-d1f648b5a479","Type":"ContainerStarted","Data":"e47fc440fd48aa93be52612b67f9e633aae9859825ba4a90075dcb3a562f78d9"}
Jul 15 16:47:32.890651 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:32.890267    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"
Jul 15 16:47:32.908650 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:32.908597    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm" podStartSLOduration=2.296978738 podStartE2EDuration="2.908581978s" totalImagesPullingTime="611.60324ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:47:32.906587972 +0000 UTC m=+1900.444413628" watchObservedRunningTime="2026-07-15 16:47:32.908581978 +0000 UTC m=+1900.446407631"
Jul 15 16:47:34.271589 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.271545    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:47:34.366623 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.366585    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-envoy\") pod \"07f57cb1-930d-4fc1-a610-03146d6dc016\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") "
Jul 15 16:47:34.366780 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.366645    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-podinfo\") pod \"07f57cb1-930d-4fc1-a610-03146d6dc016\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") "
Jul 15 16:47:34.366780 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.366694    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-credential-socket\") pod \"07f57cb1-930d-4fc1-a610-03146d6dc016\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") "
Jul 15 16:47:34.366780 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.366741    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-workload-socket\") pod \"07f57cb1-930d-4fc1-a610-03146d6dc016\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") "
Jul 15 16:47:34.366780 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.366767    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-566p4\" (UniqueName: \"kubernetes.io/projected/07f57cb1-930d-4fc1-a610-03146d6dc016-kube-api-access-566p4\") pod \"07f57cb1-930d-4fc1-a610-03146d6dc016\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") "
Jul 15 16:47:34.366989 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.366798    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-data\") pod \"07f57cb1-930d-4fc1-a610-03146d6dc016\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") "
Jul 15 16:47:34.366989 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.366835    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-workload-certs\") pod \"07f57cb1-930d-4fc1-a610-03146d6dc016\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") "
Jul 15 16:47:34.366989 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.366863    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-token\") pod \"07f57cb1-930d-4fc1-a610-03146d6dc016\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") "
Jul 15 16:47:34.366989 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.366957    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07f57cb1-930d-4fc1-a610-03146d6dc016-istiod-ca-cert\") pod \"07f57cb1-930d-4fc1-a610-03146d6dc016\" (UID: \"07f57cb1-930d-4fc1-a610-03146d6dc016\") "
Jul 15 16:47:34.367522 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.367425    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07f57cb1-930d-4fc1-a610-03146d6dc016" (UID: "07f57cb1-930d-4fc1-a610-03146d6dc016"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:47:34.367663 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.367606    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07f57cb1-930d-4fc1-a610-03146d6dc016-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07f57cb1-930d-4fc1-a610-03146d6dc016" (UID: "07f57cb1-930d-4fc1-a610-03146d6dc016"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:47:34.367938 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.367902    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07f57cb1-930d-4fc1-a610-03146d6dc016" (UID: "07f57cb1-930d-4fc1-a610-03146d6dc016"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:47:34.368139 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.368118    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07f57cb1-930d-4fc1-a610-03146d6dc016" (UID: "07f57cb1-930d-4fc1-a610-03146d6dc016"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:47:34.369196 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.368820    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-data" (OuterVolumeSpecName: "istio-data") pod "07f57cb1-930d-4fc1-a610-03146d6dc016" (UID: "07f57cb1-930d-4fc1-a610-03146d6dc016"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:47:34.369196 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.369154    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07f57cb1-930d-4fc1-a610-03146d6dc016" (UID: "07f57cb1-930d-4fc1-a610-03146d6dc016"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:47:34.370037 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.370013    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-token" (OuterVolumeSpecName: "istio-token") pod "07f57cb1-930d-4fc1-a610-03146d6dc016" (UID: "07f57cb1-930d-4fc1-a610-03146d6dc016"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:47:34.372061 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.372030    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07f57cb1-930d-4fc1-a610-03146d6dc016-kube-api-access-566p4" (OuterVolumeSpecName: "kube-api-access-566p4") pod "07f57cb1-930d-4fc1-a610-03146d6dc016" (UID: "07f57cb1-930d-4fc1-a610-03146d6dc016"). InnerVolumeSpecName "kube-api-access-566p4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:47:34.372262 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.372234    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07f57cb1-930d-4fc1-a610-03146d6dc016" (UID: "07f57cb1-930d-4fc1-a610-03146d6dc016"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:47:34.468058 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.468012    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-envoy\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:47:34.468058 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.468053    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-podinfo\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:47:34.468058 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.468063    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-credential-socket\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:47:34.468306 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.468074    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-workload-socket\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:47:34.468306 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.468084    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-566p4\" (UniqueName: \"kubernetes.io/projected/07f57cb1-930d-4fc1-a610-03146d6dc016-kube-api-access-566p4\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:47:34.468306 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.468092    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-data\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:47:34.468306 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.468100    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07f57cb1-930d-4fc1-a610-03146d6dc016-workload-certs\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:47:34.468306 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.468107    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07f57cb1-930d-4fc1-a610-03146d6dc016-istio-token\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:47:34.468306 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.468114    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07f57cb1-930d-4fc1-a610-03146d6dc016-istiod-ca-cert\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:47:34.902488 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.902451    2582 generic.go:356] "Generic (PLEG): container finished" podID="07f57cb1-930d-4fc1-a610-03146d6dc016" containerID="6f8107dcf8780c3e0538aafc9bd1811b5f1b96df3f1a1048748f21467e96f7f4" exitCode=0
Jul 15 16:47:34.902654 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.902501    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"
Jul 15 16:47:34.902654 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.902498    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw" event={"ID":"07f57cb1-930d-4fc1-a610-03146d6dc016","Type":"ContainerDied","Data":"6f8107dcf8780c3e0538aafc9bd1811b5f1b96df3f1a1048748f21467e96f7f4"}
Jul 15 16:47:34.902654 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.902623    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw" event={"ID":"07f57cb1-930d-4fc1-a610-03146d6dc016","Type":"ContainerDied","Data":"f4b548224f1c3407d9cf2104ee1d73749b05a7b087307750f1af0e299fc457e3"}
Jul 15 16:47:34.902762 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.902661    2582 scope.go:117] "RemoveContainer" containerID="6f8107dcf8780c3e0538aafc9bd1811b5f1b96df3f1a1048748f21467e96f7f4"
Jul 15 16:47:34.913094 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.913068    2582 scope.go:117] "RemoveContainer" containerID="6c1deaa0416fabb1025d8e4702db391694df37d73b3554b0761353d2e485777e"
Jul 15 16:47:34.921728 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.921709    2582 scope.go:117] "RemoveContainer" containerID="6f8107dcf8780c3e0538aafc9bd1811b5f1b96df3f1a1048748f21467e96f7f4"
Jul 15 16:47:34.921977 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:47:34.921959    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f8107dcf8780c3e0538aafc9bd1811b5f1b96df3f1a1048748f21467e96f7f4\": container with ID starting with 6f8107dcf8780c3e0538aafc9bd1811b5f1b96df3f1a1048748f21467e96f7f4 not found: ID does not exist" containerID="6f8107dcf8780c3e0538aafc9bd1811b5f1b96df3f1a1048748f21467e96f7f4"
Jul 15 16:47:34.922049 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.921990    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f8107dcf8780c3e0538aafc9bd1811b5f1b96df3f1a1048748f21467e96f7f4"} err="failed to get container status \"6f8107dcf8780c3e0538aafc9bd1811b5f1b96df3f1a1048748f21467e96f7f4\": rpc error: code = NotFound desc = could not find container \"6f8107dcf8780c3e0538aafc9bd1811b5f1b96df3f1a1048748f21467e96f7f4\": container with ID starting with 6f8107dcf8780c3e0538aafc9bd1811b5f1b96df3f1a1048748f21467e96f7f4 not found: ID does not exist"
Jul 15 16:47:34.922049 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.922018    2582 scope.go:117] "RemoveContainer" containerID="6c1deaa0416fabb1025d8e4702db391694df37d73b3554b0761353d2e485777e"
Jul 15 16:47:34.922278 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:47:34.922261    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c1deaa0416fabb1025d8e4702db391694df37d73b3554b0761353d2e485777e\": container with ID starting with 6c1deaa0416fabb1025d8e4702db391694df37d73b3554b0761353d2e485777e not found: ID does not exist" containerID="6c1deaa0416fabb1025d8e4702db391694df37d73b3554b0761353d2e485777e"
Jul 15 16:47:34.922314 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.922284    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1deaa0416fabb1025d8e4702db391694df37d73b3554b0761353d2e485777e"} err="failed to get container status \"6c1deaa0416fabb1025d8e4702db391694df37d73b3554b0761353d2e485777e\": rpc error: code = NotFound desc = could not find container \"6c1deaa0416fabb1025d8e4702db391694df37d73b3554b0761353d2e485777e\": container with ID starting with 6c1deaa0416fabb1025d8e4702db391694df37d73b3554b0761353d2e485777e not found: ID does not exist"
Jul 15 16:47:34.926881 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.926861    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"]
Jul 15 16:47:34.931409 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.931380    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3ac1ded3-openshift-default-9984db6dc-72mkw"]
Jul 15 16:47:34.978277 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:34.978245    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07f57cb1-930d-4fc1-a610-03146d6dc016" path="/var/lib/kubelet/pods/07f57cb1-930d-4fc1-a610-03146d6dc016/volumes"
Jul 15 16:47:38.901204 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:47:38.901173    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"
Jul 15 16:48:45.462163 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:45.461971    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"]
Jul 15 16:48:45.462738 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:45.462242    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm" podUID="d9370ecf-4aa9-463e-9d8c-d1f648b5a479" containerName="maas-api" containerID="cri-o://e47fc440fd48aa93be52612b67f9e633aae9859825ba4a90075dcb3a562f78d9" gracePeriod=30
Jul 15 16:48:45.710386 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:45.710360    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"
Jul 15 16:48:45.791323 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:45.791245    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-openshift-service-ca\") pod \"d9370ecf-4aa9-463e-9d8c-d1f648b5a479\" (UID: \"d9370ecf-4aa9-463e-9d8c-d1f648b5a479\") "
Jul 15 16:48:45.791323 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:45.791320    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cpf6\" (UniqueName: \"kubernetes.io/projected/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-kube-api-access-4cpf6\") pod \"d9370ecf-4aa9-463e-9d8c-d1f648b5a479\" (UID: \"d9370ecf-4aa9-463e-9d8c-d1f648b5a479\") "
Jul 15 16:48:45.791567 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:45.791364    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-maas-api-tls\") pod \"d9370ecf-4aa9-463e-9d8c-d1f648b5a479\" (UID: \"d9370ecf-4aa9-463e-9d8c-d1f648b5a479\") "
Jul 15 16:48:45.791727 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:45.791700    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d9370ecf-4aa9-463e-9d8c-d1f648b5a479" (UID: "d9370ecf-4aa9-463e-9d8c-d1f648b5a479"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:48:45.793469 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:45.793446    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-kube-api-access-4cpf6" (OuterVolumeSpecName: "kube-api-access-4cpf6") pod "d9370ecf-4aa9-463e-9d8c-d1f648b5a479" (UID: "d9370ecf-4aa9-463e-9d8c-d1f648b5a479"). InnerVolumeSpecName "kube-api-access-4cpf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:48:45.793542 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:45.793469    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d9370ecf-4aa9-463e-9d8c-d1f648b5a479" (UID: "d9370ecf-4aa9-463e-9d8c-d1f648b5a479"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:48:45.892328 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:45.892303    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cpf6\" (UniqueName: \"kubernetes.io/projected/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-kube-api-access-4cpf6\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:48:45.892328 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:45.892326    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-maas-api-tls\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:48:45.892328 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:45.892353    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9370ecf-4aa9-463e-9d8c-d1f648b5a479-openshift-service-ca\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:48:46.245272 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:46.245243    2582 generic.go:356] "Generic (PLEG): container finished" podID="d9370ecf-4aa9-463e-9d8c-d1f648b5a479" containerID="e47fc440fd48aa93be52612b67f9e633aae9859825ba4a90075dcb3a562f78d9" exitCode=0
Jul 15 16:48:46.245434 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:46.245283    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"
Jul 15 16:48:46.245434 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:46.245325    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm" event={"ID":"d9370ecf-4aa9-463e-9d8c-d1f648b5a479","Type":"ContainerDied","Data":"e47fc440fd48aa93be52612b67f9e633aae9859825ba4a90075dcb3a562f78d9"}
Jul 15 16:48:46.245434 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:46.245392    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm" event={"ID":"d9370ecf-4aa9-463e-9d8c-d1f648b5a479","Type":"ContainerDied","Data":"381258c800c34d28208749d015240a776130255af670dc9449be06599b5340bb"}
Jul 15 16:48:46.245434 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:46.245416    2582 scope.go:117] "RemoveContainer" containerID="e47fc440fd48aa93be52612b67f9e633aae9859825ba4a90075dcb3a562f78d9"
Jul 15 16:48:46.254154 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:46.254138    2582 scope.go:117] "RemoveContainer" containerID="e47fc440fd48aa93be52612b67f9e633aae9859825ba4a90075dcb3a562f78d9"
Jul 15 16:48:46.254428 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:48:46.254410    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e47fc440fd48aa93be52612b67f9e633aae9859825ba4a90075dcb3a562f78d9\": container with ID starting with e47fc440fd48aa93be52612b67f9e633aae9859825ba4a90075dcb3a562f78d9 not found: ID does not exist" containerID="e47fc440fd48aa93be52612b67f9e633aae9859825ba4a90075dcb3a562f78d9"
Jul 15 16:48:46.254476 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:46.254437    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e47fc440fd48aa93be52612b67f9e633aae9859825ba4a90075dcb3a562f78d9"} err="failed to get container status \"e47fc440fd48aa93be52612b67f9e633aae9859825ba4a90075dcb3a562f78d9\": rpc error: code = NotFound desc = could not find container \"e47fc440fd48aa93be52612b67f9e633aae9859825ba4a90075dcb3a562f78d9\": container with ID starting with e47fc440fd48aa93be52612b67f9e633aae9859825ba4a90075dcb3a562f78d9 not found: ID does not exist"
Jul 15 16:48:46.269190 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:46.269168    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"]
Jul 15 16:48:46.274771 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:46.274753    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-77b034d1-6dddcbc4bf-57pbm"]
Jul 15 16:48:46.977350 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:48:46.977306    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9370ecf-4aa9-463e-9d8c-d1f648b5a479" path="/var/lib/kubelet/pods/d9370ecf-4aa9-463e-9d8c-d1f648b5a479/volumes"
Jul 15 16:50:38.255287 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.255214    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"]
Jul 15 16:50:38.255832 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.255652    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9370ecf-4aa9-463e-9d8c-d1f648b5a479" containerName="maas-api"
Jul 15 16:50:38.255832 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.255667    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9370ecf-4aa9-463e-9d8c-d1f648b5a479" containerName="maas-api"
Jul 15 16:50:38.255832 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.255677    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07f57cb1-930d-4fc1-a610-03146d6dc016" containerName="istio-proxy"
Jul 15 16:50:38.255832 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.255683    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="07f57cb1-930d-4fc1-a610-03146d6dc016" containerName="istio-proxy"
Jul 15 16:50:38.255832 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.255694    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07f57cb1-930d-4fc1-a610-03146d6dc016" containerName="istio-proxy"
Jul 15 16:50:38.255832 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.255700    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="07f57cb1-930d-4fc1-a610-03146d6dc016" containerName="istio-proxy"
Jul 15 16:50:38.255832 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.255778    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="07f57cb1-930d-4fc1-a610-03146d6dc016" containerName="istio-proxy"
Jul 15 16:50:38.255832 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.255786    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9370ecf-4aa9-463e-9d8c-d1f648b5a479" containerName="maas-api"
Jul 15 16:50:38.255832 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.255792    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="07f57cb1-930d-4fc1-a610-03146d6dc016" containerName="istio-proxy"
Jul 15 16:50:38.258808 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.258792    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.262353 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.262319    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-19642093-openshift-default-dockercfg-bgwr9\""
Jul 15 16:50:38.283417 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.283390    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-workload-socket\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.283554 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.283468    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-credential-socket\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.283554 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.283515    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-workload-certs\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.283661 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.283558    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-envoy\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.283661 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.283583    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-podinfo\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.283661 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.283616    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-data\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.283661 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.283639    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9xt9\" (UniqueName: \"kubernetes.io/projected/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-kube-api-access-q9xt9\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.283871 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.283694    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istiod-ca-cert\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.283871 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.283730    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-token\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.284392 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.284366    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"]
Jul 15 16:50:38.384326 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.384296    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-workload-certs\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.384326 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.384328    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-envoy\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.384582 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.384453    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-podinfo\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.384582 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.384496    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-data\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.384582 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.384516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9xt9\" (UniqueName: \"kubernetes.io/projected/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-kube-api-access-q9xt9\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.384582 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.384573    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istiod-ca-cert\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.384819 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.384793    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-workload-certs\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.384875 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.384854    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-data\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.385003 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.384975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-token\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.385146 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.385039    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-workload-socket\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.385146 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.385116    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-credential-socket\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.385319 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.385274    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istiod-ca-cert\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.385463 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.385440    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-workload-socket\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.385537 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.385513    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-credential-socket\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.386780 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.386760    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-envoy\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.386913 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.386895    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-podinfo\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.393155 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.393131    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-token\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.393608 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.393592    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9xt9\" (UniqueName: \"kubernetes.io/projected/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-kube-api-access-q9xt9\") pod \"e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") " pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.572613 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.572537    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:38.712973 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.712950    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"]
Jul 15 16:50:38.714888 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:50:38.714862    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ea8d59_d394_4930_8ab0_cbd798cfe8b1.slice/crio-a7905cb14f6e4ead68fa8c8829e79aabb735832852db3ebca4748a01265fa26d WatchSource:0}: Error finding container a7905cb14f6e4ead68fa8c8829e79aabb735832852db3ebca4748a01265fa26d: Status 404 returned error can't find the container with id a7905cb14f6e4ead68fa8c8829e79aabb735832852db3ebca4748a01265fa26d
Jul 15 16:50:38.716915 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.716879    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:50:38.717016 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.716957    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:50:38.717016 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.717003    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:50:38.787307 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.787282    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx" event={"ID":"76ea8d59-d394-4930-8ab0-cbd798cfe8b1","Type":"ContainerStarted","Data":"5f30ae79b48c8019f6ba45126613b22d02243f0e8cf38ad2e0d1599dcecbd642"}
Jul 15 16:50:38.787432 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.787350    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx" event={"ID":"76ea8d59-d394-4930-8ab0-cbd798cfe8b1","Type":"ContainerStarted","Data":"a7905cb14f6e4ead68fa8c8829e79aabb735832852db3ebca4748a01265fa26d"}
Jul 15 16:50:38.816114 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:38.816068    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx" podStartSLOduration=0.816053142 podStartE2EDuration="816.053142ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:50:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:50:38.813018105 +0000 UTC m=+2086.350843761" watchObservedRunningTime="2026-07-15 16:50:38.816053142 +0000 UTC m=+2086.353878868"
Jul 15 16:50:39.572714 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:39.572681    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:39.577843 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:39.577821    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:39.792738 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:39.792700    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:39.793591 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:39.793570    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:41.370601 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:41.370569    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"]
Jul 15 16:50:41.374259 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:41.374240    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"
Jul 15 16:50:41.377871 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:41.377848    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-19642093-serving-cert\""
Jul 15 16:50:41.390471 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:41.390446    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"]
Jul 15 16:50:41.420063 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:41.420035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55987fc7-79b2-42b7-9140-a0d4734f9b75-openshift-service-ca\") pod \"maas-api-e2e-mt-19642093-8586c948bf-m86kr\" (UID: \"55987fc7-79b2-42b7-9140-a0d4734f9b75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"
Jul 15 16:50:41.420203 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:41.420076    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnkdm\" (UniqueName: \"kubernetes.io/projected/55987fc7-79b2-42b7-9140-a0d4734f9b75-kube-api-access-dnkdm\") pod \"maas-api-e2e-mt-19642093-8586c948bf-m86kr\" (UID: \"55987fc7-79b2-42b7-9140-a0d4734f9b75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"
Jul 15 16:50:41.420203 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:41.420099    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55987fc7-79b2-42b7-9140-a0d4734f9b75-maas-api-tls\") pod \"maas-api-e2e-mt-19642093-8586c948bf-m86kr\" (UID: \"55987fc7-79b2-42b7-9140-a0d4734f9b75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"
Jul 15 16:50:41.521198 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:41.521165    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnkdm\" (UniqueName: \"kubernetes.io/projected/55987fc7-79b2-42b7-9140-a0d4734f9b75-kube-api-access-dnkdm\") pod \"maas-api-e2e-mt-19642093-8586c948bf-m86kr\" (UID: \"55987fc7-79b2-42b7-9140-a0d4734f9b75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"
Jul 15 16:50:41.521401 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:41.521217    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55987fc7-79b2-42b7-9140-a0d4734f9b75-maas-api-tls\") pod \"maas-api-e2e-mt-19642093-8586c948bf-m86kr\" (UID: \"55987fc7-79b2-42b7-9140-a0d4734f9b75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"
Jul 15 16:50:41.521401 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:41.521328    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55987fc7-79b2-42b7-9140-a0d4734f9b75-openshift-service-ca\") pod \"maas-api-e2e-mt-19642093-8586c948bf-m86kr\" (UID: \"55987fc7-79b2-42b7-9140-a0d4734f9b75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"
Jul 15 16:50:41.521401 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:50:41.521383    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-19642093-serving-cert: secret "maas-api-e2e-mt-19642093-serving-cert" not found
Jul 15 16:50:41.521579 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:50:41.521443    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55987fc7-79b2-42b7-9140-a0d4734f9b75-maas-api-tls podName:55987fc7-79b2-42b7-9140-a0d4734f9b75 nodeName:}" failed. No retries permitted until 2026-07-15 16:50:42.021427916 +0000 UTC m=+2089.559253550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/55987fc7-79b2-42b7-9140-a0d4734f9b75-maas-api-tls") pod "maas-api-e2e-mt-19642093-8586c948bf-m86kr" (UID: "55987fc7-79b2-42b7-9140-a0d4734f9b75") : secret "maas-api-e2e-mt-19642093-serving-cert" not found
Jul 15 16:50:41.521919 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:41.521901    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55987fc7-79b2-42b7-9140-a0d4734f9b75-openshift-service-ca\") pod \"maas-api-e2e-mt-19642093-8586c948bf-m86kr\" (UID: \"55987fc7-79b2-42b7-9140-a0d4734f9b75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"
Jul 15 16:50:41.530448 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:41.530426    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnkdm\" (UniqueName: \"kubernetes.io/projected/55987fc7-79b2-42b7-9140-a0d4734f9b75-kube-api-access-dnkdm\") pod \"maas-api-e2e-mt-19642093-8586c948bf-m86kr\" (UID: \"55987fc7-79b2-42b7-9140-a0d4734f9b75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"
Jul 15 16:50:42.025284 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:42.025249    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55987fc7-79b2-42b7-9140-a0d4734f9b75-maas-api-tls\") pod \"maas-api-e2e-mt-19642093-8586c948bf-m86kr\" (UID: \"55987fc7-79b2-42b7-9140-a0d4734f9b75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"
Jul 15 16:50:42.025514 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:50:42.025412    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-19642093-serving-cert: secret "maas-api-e2e-mt-19642093-serving-cert" not found
Jul 15 16:50:42.025514 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:50:42.025473    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55987fc7-79b2-42b7-9140-a0d4734f9b75-maas-api-tls podName:55987fc7-79b2-42b7-9140-a0d4734f9b75 nodeName:}" failed. No retries permitted until 2026-07-15 16:50:43.025457016 +0000 UTC m=+2090.563282662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/55987fc7-79b2-42b7-9140-a0d4734f9b75-maas-api-tls") pod "maas-api-e2e-mt-19642093-8586c948bf-m86kr" (UID: "55987fc7-79b2-42b7-9140-a0d4734f9b75") : secret "maas-api-e2e-mt-19642093-serving-cert" not found
Jul 15 16:50:43.034272 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:43.034240    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55987fc7-79b2-42b7-9140-a0d4734f9b75-maas-api-tls\") pod \"maas-api-e2e-mt-19642093-8586c948bf-m86kr\" (UID: \"55987fc7-79b2-42b7-9140-a0d4734f9b75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"
Jul 15 16:50:43.036571 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:43.036540    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55987fc7-79b2-42b7-9140-a0d4734f9b75-maas-api-tls\") pod \"maas-api-e2e-mt-19642093-8586c948bf-m86kr\" (UID: \"55987fc7-79b2-42b7-9140-a0d4734f9b75\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"
Jul 15 16:50:43.184481 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:43.184443    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"
Jul 15 16:50:43.324371 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:43.324280    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"]
Jul 15 16:50:43.327246 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:50:43.327220    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55987fc7_79b2_42b7_9140_a0d4734f9b75.slice/crio-3c7b89e357f15cbc93667aef2d4856046ee2a7b6aebb377a3c61e60e9dc43504 WatchSource:0}: Error finding container 3c7b89e357f15cbc93667aef2d4856046ee2a7b6aebb377a3c61e60e9dc43504: Status 404 returned error can't find the container with id 3c7b89e357f15cbc93667aef2d4856046ee2a7b6aebb377a3c61e60e9dc43504
Jul 15 16:50:43.328713 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:43.328696    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 16:50:43.813093 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:43.813068    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr" event={"ID":"55987fc7-79b2-42b7-9140-a0d4734f9b75","Type":"ContainerStarted","Data":"3c7b89e357f15cbc93667aef2d4856046ee2a7b6aebb377a3c61e60e9dc43504"}
Jul 15 16:50:44.819463 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:44.819429    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr" event={"ID":"55987fc7-79b2-42b7-9140-a0d4734f9b75","Type":"ContainerStarted","Data":"c07f208411336f34e2279efd490ebc0eb3e14e1df7717ed7f27966765fe88e75"}
Jul 15 16:50:44.819872 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:44.819565    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"
Jul 15 16:50:44.844050 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:44.844005    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr" podStartSLOduration=3.393976273 podStartE2EDuration="3.843991465s" totalImagesPullingTime="450.015192ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:50:44.840874448 +0000 UTC m=+2092.378700103" watchObservedRunningTime="2026-07-15 16:50:44.843991465 +0000 UTC m=+2092.381817120"
Jul 15 16:50:50.829863 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:50.829835    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"
Jul 15 16:50:53.075784 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:53.075750    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:50:53.079687 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:53.079662    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:50:53.083109 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:53.083092    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:50:53.086831 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:53.086810    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:50:54.793938 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:54.793911    2582 patch_prober.go:28] interesting pod/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 15 16:50:54.794369 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:54.793970    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx" podUID="76ea8d59-d394-4930-8ab0-cbd798cfe8b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 15 16:50:54.876756 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:54.876723    2582 generic.go:356] "Generic (PLEG): container finished" podID="76ea8d59-d394-4930-8ab0-cbd798cfe8b1" containerID="5f30ae79b48c8019f6ba45126613b22d02243f0e8cf38ad2e0d1599dcecbd642" exitCode=0
Jul 15 16:50:54.876929 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:54.876794    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx" event={"ID":"76ea8d59-d394-4930-8ab0-cbd798cfe8b1","Type":"ContainerDied","Data":"5f30ae79b48c8019f6ba45126613b22d02243f0e8cf38ad2e0d1599dcecbd642"}
Jul 15 16:50:54.877220 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:54.877203    2582 scope.go:117] "RemoveContainer" containerID="5f30ae79b48c8019f6ba45126613b22d02243f0e8cf38ad2e0d1599dcecbd642"
Jul 15 16:50:54.878249 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:54.878219    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:50:54.878323 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:54.878305    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:50:54.878407 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:54.878391    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:50:55.888521 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:55.888476    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx" event={"ID":"76ea8d59-d394-4930-8ab0-cbd798cfe8b1","Type":"ContainerStarted","Data":"9902b4649b4068653e6b774b7d7a95f87b97504a24cd4ef9a486d974be881a37"}
Jul 15 16:50:56.573299 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:56.573260    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:50:56.573658 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:56.573630    2582 patch_prober.go:28] interesting pod/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 15 16:50:56.573750 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:56.573697    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx" podUID="76ea8d59-d394-4930-8ab0-cbd798cfe8b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 15 16:50:57.573383 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:57.573325    2582 patch_prober.go:28] interesting pod/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 15 16:50:57.573871 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:57.573416    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx" podUID="76ea8d59-d394-4930-8ab0-cbd798cfe8b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 15 16:50:58.573863 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:58.573821    2582 patch_prober.go:28] interesting pod/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 15 16:50:58.574373 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:58.573898    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx" podUID="76ea8d59-d394-4930-8ab0-cbd798cfe8b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 15 16:50:59.573080 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:59.573041    2582 patch_prober.go:28] interesting pod/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 15 16:50:59.573285 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:50:59.573111    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx" podUID="76ea8d59-d394-4930-8ab0-cbd798cfe8b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 15 16:51:00.576946 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:00.576918    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:51:00.577362 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:00.577276    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:51:00.578032 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:00.578015    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:51:04.254455 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.254420    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"]
Jul 15 16:51:04.254979 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.254665    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr" podUID="55987fc7-79b2-42b7-9140-a0d4734f9b75" containerName="maas-api" containerID="cri-o://c07f208411336f34e2279efd490ebc0eb3e14e1df7717ed7f27966765fe88e75" gracePeriod=30
Jul 15 16:51:04.500279 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.500256    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"
Jul 15 16:51:04.654680 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.654580    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55987fc7-79b2-42b7-9140-a0d4734f9b75-maas-api-tls\") pod \"55987fc7-79b2-42b7-9140-a0d4734f9b75\" (UID: \"55987fc7-79b2-42b7-9140-a0d4734f9b75\") "
Jul 15 16:51:04.654680 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.654626    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnkdm\" (UniqueName: \"kubernetes.io/projected/55987fc7-79b2-42b7-9140-a0d4734f9b75-kube-api-access-dnkdm\") pod \"55987fc7-79b2-42b7-9140-a0d4734f9b75\" (UID: \"55987fc7-79b2-42b7-9140-a0d4734f9b75\") "
Jul 15 16:51:04.654680 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.654659    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55987fc7-79b2-42b7-9140-a0d4734f9b75-openshift-service-ca\") pod \"55987fc7-79b2-42b7-9140-a0d4734f9b75\" (UID: \"55987fc7-79b2-42b7-9140-a0d4734f9b75\") "
Jul 15 16:51:04.655054 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.655023    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55987fc7-79b2-42b7-9140-a0d4734f9b75-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "55987fc7-79b2-42b7-9140-a0d4734f9b75" (UID: "55987fc7-79b2-42b7-9140-a0d4734f9b75"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:51:04.656785 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.656762    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55987fc7-79b2-42b7-9140-a0d4734f9b75-kube-api-access-dnkdm" (OuterVolumeSpecName: "kube-api-access-dnkdm") pod "55987fc7-79b2-42b7-9140-a0d4734f9b75" (UID: "55987fc7-79b2-42b7-9140-a0d4734f9b75"). InnerVolumeSpecName "kube-api-access-dnkdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:51:04.656870 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.656849    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55987fc7-79b2-42b7-9140-a0d4734f9b75-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "55987fc7-79b2-42b7-9140-a0d4734f9b75" (UID: "55987fc7-79b2-42b7-9140-a0d4734f9b75"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:51:04.756351 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.756322    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55987fc7-79b2-42b7-9140-a0d4734f9b75-maas-api-tls\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:51:04.756471 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.756369    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnkdm\" (UniqueName: \"kubernetes.io/projected/55987fc7-79b2-42b7-9140-a0d4734f9b75-kube-api-access-dnkdm\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:51:04.756471 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.756380    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55987fc7-79b2-42b7-9140-a0d4734f9b75-openshift-service-ca\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:51:04.934570 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.934472    2582 generic.go:356] "Generic (PLEG): container finished" podID="55987fc7-79b2-42b7-9140-a0d4734f9b75" containerID="c07f208411336f34e2279efd490ebc0eb3e14e1df7717ed7f27966765fe88e75" exitCode=0
Jul 15 16:51:04.934570 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.934527    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"
Jul 15 16:51:04.934570 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.934550    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr" event={"ID":"55987fc7-79b2-42b7-9140-a0d4734f9b75","Type":"ContainerDied","Data":"c07f208411336f34e2279efd490ebc0eb3e14e1df7717ed7f27966765fe88e75"}
Jul 15 16:51:04.934836 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.934592    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr" event={"ID":"55987fc7-79b2-42b7-9140-a0d4734f9b75","Type":"ContainerDied","Data":"3c7b89e357f15cbc93667aef2d4856046ee2a7b6aebb377a3c61e60e9dc43504"}
Jul 15 16:51:04.934836 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.934613    2582 scope.go:117] "RemoveContainer" containerID="c07f208411336f34e2279efd490ebc0eb3e14e1df7717ed7f27966765fe88e75"
Jul 15 16:51:04.943967 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.943946    2582 scope.go:117] "RemoveContainer" containerID="c07f208411336f34e2279efd490ebc0eb3e14e1df7717ed7f27966765fe88e75"
Jul 15 16:51:04.944234 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:51:04.944214    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c07f208411336f34e2279efd490ebc0eb3e14e1df7717ed7f27966765fe88e75\": container with ID starting with c07f208411336f34e2279efd490ebc0eb3e14e1df7717ed7f27966765fe88e75 not found: ID does not exist" containerID="c07f208411336f34e2279efd490ebc0eb3e14e1df7717ed7f27966765fe88e75"
Jul 15 16:51:04.944276 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.944244    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c07f208411336f34e2279efd490ebc0eb3e14e1df7717ed7f27966765fe88e75"} err="failed to get container status \"c07f208411336f34e2279efd490ebc0eb3e14e1df7717ed7f27966765fe88e75\": rpc error: code = NotFound desc = could not find container \"c07f208411336f34e2279efd490ebc0eb3e14e1df7717ed7f27966765fe88e75\": container with ID starting with c07f208411336f34e2279efd490ebc0eb3e14e1df7717ed7f27966765fe88e75 not found: ID does not exist"
Jul 15 16:51:04.956991 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.956958    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"]
Jul 15 16:51:04.961100 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.961077    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-19642093-8586c948bf-m86kr"]
Jul 15 16:51:04.979028 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:04.979001    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55987fc7-79b2-42b7-9140-a0d4734f9b75" path="/var/lib/kubelet/pods/55987fc7-79b2-42b7-9140-a0d4734f9b75/volumes"
Jul 15 16:51:19.413817 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:19.413772    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"]
Jul 15 16:51:19.414424 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:19.414038    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx" podUID="76ea8d59-d394-4930-8ab0-cbd798cfe8b1" containerName="istio-proxy" containerID="cri-o://9902b4649b4068653e6b774b7d7a95f87b97504a24cd4ef9a486d974be881a37" gracePeriod=30
Jul 15 16:51:24.678230 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.678201    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:51:24.739732 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.739700    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-token\") pod \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") "
Jul 15 16:51:24.739940 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.739741    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-workload-certs\") pod \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") "
Jul 15 16:51:24.739940 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.739773    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-podinfo\") pod \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") "
Jul 15 16:51:24.739940 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.739886    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-data\") pod \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") "
Jul 15 16:51:24.739940 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.739931    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-envoy\") pod \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") "
Jul 15 16:51:24.740159 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.739951    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-credential-socket\") pod \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") "
Jul 15 16:51:24.740159 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.739996    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istiod-ca-cert\") pod \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") "
Jul 15 16:51:24.740159 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.740023    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-workload-socket\") pod \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") "
Jul 15 16:51:24.740159 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.740045    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9xt9\" (UniqueName: \"kubernetes.io/projected/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-kube-api-access-q9xt9\") pod \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\" (UID: \"76ea8d59-d394-4930-8ab0-cbd798cfe8b1\") "
Jul 15 16:51:24.740159 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.740042    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "76ea8d59-d394-4930-8ab0-cbd798cfe8b1" (UID: "76ea8d59-d394-4930-8ab0-cbd798cfe8b1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:51:24.740460 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.740298    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "76ea8d59-d394-4930-8ab0-cbd798cfe8b1" (UID: "76ea8d59-d394-4930-8ab0-cbd798cfe8b1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:51:24.740460 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.740374    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-workload-certs\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:51:24.740460 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.740418    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "76ea8d59-d394-4930-8ab0-cbd798cfe8b1" (UID: "76ea8d59-d394-4930-8ab0-cbd798cfe8b1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:51:24.740606 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.740573    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "76ea8d59-d394-4930-8ab0-cbd798cfe8b1" (UID: "76ea8d59-d394-4930-8ab0-cbd798cfe8b1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:51:24.741123 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.741092    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-data" (OuterVolumeSpecName: "istio-data") pod "76ea8d59-d394-4930-8ab0-cbd798cfe8b1" (UID: "76ea8d59-d394-4930-8ab0-cbd798cfe8b1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:51:24.742074 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.742049    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "76ea8d59-d394-4930-8ab0-cbd798cfe8b1" (UID: "76ea8d59-d394-4930-8ab0-cbd798cfe8b1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:51:24.742204 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.742097    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-token" (OuterVolumeSpecName: "istio-token") pod "76ea8d59-d394-4930-8ab0-cbd798cfe8b1" (UID: "76ea8d59-d394-4930-8ab0-cbd798cfe8b1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:51:24.742317 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.742300    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-kube-api-access-q9xt9" (OuterVolumeSpecName: "kube-api-access-q9xt9") pod "76ea8d59-d394-4930-8ab0-cbd798cfe8b1" (UID: "76ea8d59-d394-4930-8ab0-cbd798cfe8b1"). InnerVolumeSpecName "kube-api-access-q9xt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:51:24.742429 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.742409    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "76ea8d59-d394-4930-8ab0-cbd798cfe8b1" (UID: "76ea8d59-d394-4930-8ab0-cbd798cfe8b1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:51:24.840920 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.840886    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istiod-ca-cert\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:51:24.840920 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.840917    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-workload-socket\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:51:24.840920 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.840928    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9xt9\" (UniqueName: \"kubernetes.io/projected/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-kube-api-access-q9xt9\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:51:24.841162 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.840940    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-token\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:51:24.841162 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.840949    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-podinfo\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:51:24.841162 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.840958    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-data\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:51:24.841162 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.840968    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-istio-envoy\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:51:24.841162 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:24.840976    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76ea8d59-d394-4930-8ab0-cbd798cfe8b1-credential-socket\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:51:25.033742 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:25.033651    2582 generic.go:356] "Generic (PLEG): container finished" podID="76ea8d59-d394-4930-8ab0-cbd798cfe8b1" containerID="9902b4649b4068653e6b774b7d7a95f87b97504a24cd4ef9a486d974be881a37" exitCode=0
Jul 15 16:51:25.033742 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:25.033701    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"
Jul 15 16:51:25.033926 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:25.033737    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx" event={"ID":"76ea8d59-d394-4930-8ab0-cbd798cfe8b1","Type":"ContainerDied","Data":"9902b4649b4068653e6b774b7d7a95f87b97504a24cd4ef9a486d974be881a37"}
Jul 15 16:51:25.033926 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:25.033786    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx" event={"ID":"76ea8d59-d394-4930-8ab0-cbd798cfe8b1","Type":"ContainerDied","Data":"a7905cb14f6e4ead68fa8c8829e79aabb735832852db3ebca4748a01265fa26d"}
Jul 15 16:51:25.033926 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:25.033809    2582 scope.go:117] "RemoveContainer" containerID="9902b4649b4068653e6b774b7d7a95f87b97504a24cd4ef9a486d974be881a37"
Jul 15 16:51:25.042715 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:25.042699    2582 scope.go:117] "RemoveContainer" containerID="5f30ae79b48c8019f6ba45126613b22d02243f0e8cf38ad2e0d1599dcecbd642"
Jul 15 16:51:25.050394 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:25.050375    2582 scope.go:117] "RemoveContainer" containerID="9902b4649b4068653e6b774b7d7a95f87b97504a24cd4ef9a486d974be881a37"
Jul 15 16:51:25.050674 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:51:25.050653    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9902b4649b4068653e6b774b7d7a95f87b97504a24cd4ef9a486d974be881a37\": container with ID starting with 9902b4649b4068653e6b774b7d7a95f87b97504a24cd4ef9a486d974be881a37 not found: ID does not exist" containerID="9902b4649b4068653e6b774b7d7a95f87b97504a24cd4ef9a486d974be881a37"
Jul 15 16:51:25.050751 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:25.050683    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9902b4649b4068653e6b774b7d7a95f87b97504a24cd4ef9a486d974be881a37"} err="failed to get container status \"9902b4649b4068653e6b774b7d7a95f87b97504a24cd4ef9a486d974be881a37\": rpc error: code = NotFound desc = could not find container \"9902b4649b4068653e6b774b7d7a95f87b97504a24cd4ef9a486d974be881a37\": container with ID starting with 9902b4649b4068653e6b774b7d7a95f87b97504a24cd4ef9a486d974be881a37 not found: ID does not exist"
Jul 15 16:51:25.050751 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:25.050702    2582 scope.go:117] "RemoveContainer" containerID="5f30ae79b48c8019f6ba45126613b22d02243f0e8cf38ad2e0d1599dcecbd642"
Jul 15 16:51:25.050963 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:51:25.050945    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f30ae79b48c8019f6ba45126613b22d02243f0e8cf38ad2e0d1599dcecbd642\": container with ID starting with 5f30ae79b48c8019f6ba45126613b22d02243f0e8cf38ad2e0d1599dcecbd642 not found: ID does not exist" containerID="5f30ae79b48c8019f6ba45126613b22d02243f0e8cf38ad2e0d1599dcecbd642"
Jul 15 16:51:25.051022 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:25.050971    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f30ae79b48c8019f6ba45126613b22d02243f0e8cf38ad2e0d1599dcecbd642"} err="failed to get container status \"5f30ae79b48c8019f6ba45126613b22d02243f0e8cf38ad2e0d1599dcecbd642\": rpc error: code = NotFound desc = could not find container \"5f30ae79b48c8019f6ba45126613b22d02243f0e8cf38ad2e0d1599dcecbd642\": container with ID starting with 5f30ae79b48c8019f6ba45126613b22d02243f0e8cf38ad2e0d1599dcecbd642 not found: ID does not exist"
Jul 15 16:51:25.058159 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:25.058136    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"]
Jul 15 16:51:25.066467 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:25.066435    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-19642093-openshift-default-74b5d7975f-wrqsx"]
Jul 15 16:51:26.978160 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:26.978125    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76ea8d59-d394-4930-8ab0-cbd798cfe8b1" path="/var/lib/kubelet/pods/76ea8d59-d394-4930-8ab0-cbd798cfe8b1/volumes"
Jul 15 16:51:40.341016 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.340978    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"]
Jul 15 16:51:40.341506 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.341398    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76ea8d59-d394-4930-8ab0-cbd798cfe8b1" containerName="istio-proxy"
Jul 15 16:51:40.341506 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.341410    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="76ea8d59-d394-4930-8ab0-cbd798cfe8b1" containerName="istio-proxy"
Jul 15 16:51:40.341506 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.341424    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55987fc7-79b2-42b7-9140-a0d4734f9b75" containerName="maas-api"
Jul 15 16:51:40.341506 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.341429    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="55987fc7-79b2-42b7-9140-a0d4734f9b75" containerName="maas-api"
Jul 15 16:51:40.341506 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.341501    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="55987fc7-79b2-42b7-9140-a0d4734f9b75" containerName="maas-api"
Jul 15 16:51:40.341506 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.341510    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="76ea8d59-d394-4930-8ab0-cbd798cfe8b1" containerName="istio-proxy"
Jul 15 16:51:40.341828 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.341519    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="76ea8d59-d394-4930-8ab0-cbd798cfe8b1" containerName="istio-proxy"
Jul 15 16:51:40.344585 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.344567    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.349357 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.349311    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-dc2354a8-openshift-default-dockercfg-52ff8\""
Jul 15 16:51:40.377174 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.377141    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"]
Jul 15 16:51:40.491983 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.491945    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-data\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.491983 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.491980    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-token\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.492215 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.491999    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50702288-ecc4-4a94-8a46-3c8dff43b467-istiod-ca-cert\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.492215 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.492161    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-workload-certs\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.492289 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.492243    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-credential-socket\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.492289 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.492274    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-envoy\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.492387 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.492367    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-podinfo\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.492429 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.492407    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px5kz\" (UniqueName: \"kubernetes.io/projected/50702288-ecc4-4a94-8a46-3c8dff43b467-kube-api-access-px5kz\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.492465 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.492432    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-workload-socket\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.593964 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.593869    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-data\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.593964 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.593906    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-token\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.593964 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.593926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50702288-ecc4-4a94-8a46-3c8dff43b467-istiod-ca-cert\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.594251 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.593983    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-workload-certs\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.594251 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.594014    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-credential-socket\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.594251 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.594032    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-envoy\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.594251 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.594120    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-podinfo\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.594251 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.594169    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px5kz\" (UniqueName: \"kubernetes.io/projected/50702288-ecc4-4a94-8a46-3c8dff43b467-kube-api-access-px5kz\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.594251 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.594199    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-workload-socket\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.594617 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.594373    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-data\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.594617 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.594414    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-workload-certs\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.594617 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.594550    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-credential-socket\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.594617 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.594552    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-workload-socket\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.594875 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.594854    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50702288-ecc4-4a94-8a46-3c8dff43b467-istiod-ca-cert\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.596644 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.596606    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-envoy\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.596813 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.596791    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-podinfo\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.614688 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.614661    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-token\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.616406 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.616380    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px5kz\" (UniqueName: \"kubernetes.io/projected/50702288-ecc4-4a94-8a46-3c8dff43b467-kube-api-access-px5kz\") pod \"e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") " pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.656369 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.656307    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:40.817282 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.817252    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"]
Jul 15 16:51:40.819938 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:51:40.819913    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50702288_ecc4_4a94_8a46_3c8dff43b467.slice/crio-143600d2aad9be5d395d161b3c6adbd6280099b3dd3a2dcedc063a767a2b9f1d WatchSource:0}: Error finding container 143600d2aad9be5d395d161b3c6adbd6280099b3dd3a2dcedc063a767a2b9f1d: Status 404 returned error can't find the container with id 143600d2aad9be5d395d161b3c6adbd6280099b3dd3a2dcedc063a767a2b9f1d
Jul 15 16:51:40.822041 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.822012    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:51:40.822103 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.822079    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:51:40.822140 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:40.822107    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:51:41.121282 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:41.121178    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65" event={"ID":"50702288-ecc4-4a94-8a46-3c8dff43b467","Type":"ContainerStarted","Data":"91b54112d69bf75c8174fdda7cc95e6fa66b9fb5a081c341c6479caed5a04be6"}
Jul 15 16:51:41.121282 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:41.121230    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65" event={"ID":"50702288-ecc4-4a94-8a46-3c8dff43b467","Type":"ContainerStarted","Data":"143600d2aad9be5d395d161b3c6adbd6280099b3dd3a2dcedc063a767a2b9f1d"}
Jul 15 16:51:41.158663 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:41.158596    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65" podStartSLOduration=1.158574591 podStartE2EDuration="1.158574591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:51:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:51:41.158024278 +0000 UTC m=+2148.695849953" watchObservedRunningTime="2026-07-15 16:51:41.158574591 +0000 UTC m=+2148.696400249"
Jul 15 16:51:41.657279 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:41.657238    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:41.661982 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:41.661954    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:42.126475 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:42.126441    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:42.127616 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:42.127595    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:43.712924 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:43.712886    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"]
Jul 15 16:51:43.713512 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:43.713492    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76ea8d59-d394-4930-8ab0-cbd798cfe8b1" containerName="istio-proxy"
Jul 15 16:51:43.713613 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:43.713515    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="76ea8d59-d394-4930-8ab0-cbd798cfe8b1" containerName="istio-proxy"
Jul 15 16:51:43.716799 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:43.716777    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"
Jul 15 16:51:43.721297 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:43.721275    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-dc2354a8-serving-cert\""
Jul 15 16:51:43.743562 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:43.743533    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"]
Jul 15 16:51:43.827472 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:43.827433    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-maas-api-tls\") pod \"maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7\" (UID: \"7fd84963-7a06-46d4-98a1-5b50d1f2e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"
Jul 15 16:51:43.827472 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:43.827479    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95grv\" (UniqueName: \"kubernetes.io/projected/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-kube-api-access-95grv\") pod \"maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7\" (UID: \"7fd84963-7a06-46d4-98a1-5b50d1f2e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"
Jul 15 16:51:43.827741 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:43.827574    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-openshift-service-ca\") pod \"maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7\" (UID: \"7fd84963-7a06-46d4-98a1-5b50d1f2e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"
Jul 15 16:51:43.928821 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:43.928776    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-maas-api-tls\") pod \"maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7\" (UID: \"7fd84963-7a06-46d4-98a1-5b50d1f2e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"
Jul 15 16:51:43.928821 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:43.928827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95grv\" (UniqueName: \"kubernetes.io/projected/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-kube-api-access-95grv\") pod \"maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7\" (UID: \"7fd84963-7a06-46d4-98a1-5b50d1f2e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"
Jul 15 16:51:43.929162 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:43.928881    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-openshift-service-ca\") pod \"maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7\" (UID: \"7fd84963-7a06-46d4-98a1-5b50d1f2e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"
Jul 15 16:51:43.929162 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:51:43.928927    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-serving-cert: secret "maas-api-e2e-mt-dc2354a8-serving-cert" not found
Jul 15 16:51:43.929162 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:51:43.928991    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-maas-api-tls podName:7fd84963-7a06-46d4-98a1-5b50d1f2e72a nodeName:}" failed. No retries permitted until 2026-07-15 16:51:44.428972723 +0000 UTC m=+2151.966798360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-maas-api-tls") pod "maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7" (UID: "7fd84963-7a06-46d4-98a1-5b50d1f2e72a") : secret "maas-api-e2e-mt-dc2354a8-serving-cert" not found
Jul 15 16:51:43.929633 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:43.929614    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-openshift-service-ca\") pod \"maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7\" (UID: \"7fd84963-7a06-46d4-98a1-5b50d1f2e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"
Jul 15 16:51:43.959027 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:43.958987    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95grv\" (UniqueName: \"kubernetes.io/projected/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-kube-api-access-95grv\") pod \"maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7\" (UID: \"7fd84963-7a06-46d4-98a1-5b50d1f2e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"
Jul 15 16:51:44.433132 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:44.433097    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-maas-api-tls\") pod \"maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7\" (UID: \"7fd84963-7a06-46d4-98a1-5b50d1f2e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"
Jul 15 16:51:44.435493 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:44.435469    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-maas-api-tls\") pod \"maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7\" (UID: \"7fd84963-7a06-46d4-98a1-5b50d1f2e72a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"
Jul 15 16:51:44.628036 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:44.627997    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"
Jul 15 16:51:44.775994 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:44.775970    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"]
Jul 15 16:51:44.777968 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:51:44.777942    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fd84963_7a06_46d4_98a1_5b50d1f2e72a.slice/crio-9f0218116b9f513f102bf0f93f2b84ba87595624cc2233842972b9820c2b48b9 WatchSource:0}: Error finding container 9f0218116b9f513f102bf0f93f2b84ba87595624cc2233842972b9820c2b48b9: Status 404 returned error can't find the container with id 9f0218116b9f513f102bf0f93f2b84ba87595624cc2233842972b9820c2b48b9
Jul 15 16:51:45.140782 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:45.140655    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7" event={"ID":"7fd84963-7a06-46d4-98a1-5b50d1f2e72a","Type":"ContainerStarted","Data":"9f0218116b9f513f102bf0f93f2b84ba87595624cc2233842972b9820c2b48b9"}
Jul 15 16:51:46.146756 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:46.146719    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7" event={"ID":"7fd84963-7a06-46d4-98a1-5b50d1f2e72a","Type":"ContainerStarted","Data":"a8a28cd7be2564612dd075602319906dc323ee58fa280e851e75efbeb76c02ce"}
Jul 15 16:51:46.147152 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:46.146794    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"
Jul 15 16:51:46.172019 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:46.171944    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7" podStartSLOduration=2.729979996 podStartE2EDuration="3.171926835s" totalImagesPullingTime="441.946839ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:51:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:51:46.17171323 +0000 UTC m=+2153.709538909" watchObservedRunningTime="2026-07-15 16:51:46.171926835 +0000 UTC m=+2153.709752491"
Jul 15 16:51:52.157137 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:52.157099    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"
Jul 15 16:51:57.128133 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:57.128088    2582 patch_prober.go:28] interesting pod/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 15 16:51:57.128670 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:57.128167    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65" podUID="50702288-ecc4-4a94-8a46-3c8dff43b467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 15 16:51:57.225263 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:57.225231    2582 generic.go:356] "Generic (PLEG): container finished" podID="50702288-ecc4-4a94-8a46-3c8dff43b467" containerID="91b54112d69bf75c8174fdda7cc95e6fa66b9fb5a081c341c6479caed5a04be6" exitCode=0
Jul 15 16:51:57.225473 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:57.225297    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65" event={"ID":"50702288-ecc4-4a94-8a46-3c8dff43b467","Type":"ContainerDied","Data":"91b54112d69bf75c8174fdda7cc95e6fa66b9fb5a081c341c6479caed5a04be6"}
Jul 15 16:51:57.225732 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:57.225711    2582 scope.go:117] "RemoveContainer" containerID="91b54112d69bf75c8174fdda7cc95e6fa66b9fb5a081c341c6479caed5a04be6"
Jul 15 16:51:57.226708 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:57.226683    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:51:57.226762 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:57.226748    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:51:57.226798 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:57.226781    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:51:58.231849 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:58.231814    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65" event={"ID":"50702288-ecc4-4a94-8a46-3c8dff43b467","Type":"ContainerStarted","Data":"536e6da05bd720e0042712a5f393c18dae83b331c1464555737cf9a68108f7b5"}
Jul 15 16:51:58.657428 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:58.657319    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:51:58.657670 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:58.657646    2582 patch_prober.go:28] interesting pod/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 15 16:51:58.657759 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:58.657699    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65" podUID="50702288-ecc4-4a94-8a46-3c8dff43b467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 15 16:51:59.657294 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:59.657261    2582 patch_prober.go:28] interesting pod/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 15 16:51:59.657722 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:51:59.657324    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65" podUID="50702288-ecc4-4a94-8a46-3c8dff43b467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 15 16:52:00.657672 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:00.657636    2582 patch_prober.go:28] interesting pod/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 15 16:52:00.658101 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:00.657699    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65" podUID="50702288-ecc4-4a94-8a46-3c8dff43b467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 15 16:52:01.657526 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:01.657489    2582 patch_prober.go:28] interesting pod/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 15 16:52:01.657714 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:01.657544    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65" podUID="50702288-ecc4-4a94-8a46-3c8dff43b467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 15 16:52:02.661808 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:02.661778    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:52:02.662196 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:02.662041    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:52:02.662750 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:02.662734    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:52:32.148462 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:32.148427    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"]
Jul 15 16:52:32.149035 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:32.148683    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7" podUID="7fd84963-7a06-46d4-98a1-5b50d1f2e72a" containerName="maas-api" containerID="cri-o://a8a28cd7be2564612dd075602319906dc323ee58fa280e851e75efbeb76c02ce" gracePeriod=30
Jul 15 16:52:32.152732 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:32.152698    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7" podUID="7fd84963-7a06-46d4-98a1-5b50d1f2e72a" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.53:8443/health\": dial tcp 10.132.0.53:8443: connect: connection refused"
Jul 15 16:52:32.400607 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:32.400520    2582 generic.go:356] "Generic (PLEG): container finished" podID="7fd84963-7a06-46d4-98a1-5b50d1f2e72a" containerID="a8a28cd7be2564612dd075602319906dc323ee58fa280e851e75efbeb76c02ce" exitCode=0
Jul 15 16:52:32.400607 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:32.400597    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7" event={"ID":"7fd84963-7a06-46d4-98a1-5b50d1f2e72a","Type":"ContainerDied","Data":"a8a28cd7be2564612dd075602319906dc323ee58fa280e851e75efbeb76c02ce"}
Jul 15 16:52:32.400788 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:32.400646    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7" event={"ID":"7fd84963-7a06-46d4-98a1-5b50d1f2e72a","Type":"ContainerDied","Data":"9f0218116b9f513f102bf0f93f2b84ba87595624cc2233842972b9820c2b48b9"}
Jul 15 16:52:32.400788 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:32.400669    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f0218116b9f513f102bf0f93f2b84ba87595624cc2233842972b9820c2b48b9"
Jul 15 16:52:32.402918 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:32.402895    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"
Jul 15 16:52:32.476409 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:32.476376    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-openshift-service-ca\") pod \"7fd84963-7a06-46d4-98a1-5b50d1f2e72a\" (UID: \"7fd84963-7a06-46d4-98a1-5b50d1f2e72a\") "
Jul 15 16:52:32.476596 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:32.476465    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95grv\" (UniqueName: \"kubernetes.io/projected/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-kube-api-access-95grv\") pod \"7fd84963-7a06-46d4-98a1-5b50d1f2e72a\" (UID: \"7fd84963-7a06-46d4-98a1-5b50d1f2e72a\") "
Jul 15 16:52:32.476596 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:32.476493    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-maas-api-tls\") pod \"7fd84963-7a06-46d4-98a1-5b50d1f2e72a\" (UID: \"7fd84963-7a06-46d4-98a1-5b50d1f2e72a\") "
Jul 15 16:52:32.476804 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:32.476778    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7fd84963-7a06-46d4-98a1-5b50d1f2e72a" (UID: "7fd84963-7a06-46d4-98a1-5b50d1f2e72a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:52:32.478605 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:32.478579    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-kube-api-access-95grv" (OuterVolumeSpecName: "kube-api-access-95grv") pod "7fd84963-7a06-46d4-98a1-5b50d1f2e72a" (UID: "7fd84963-7a06-46d4-98a1-5b50d1f2e72a"). InnerVolumeSpecName "kube-api-access-95grv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:52:32.478605 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:32.478589    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7fd84963-7a06-46d4-98a1-5b50d1f2e72a" (UID: "7fd84963-7a06-46d4-98a1-5b50d1f2e72a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:52:32.577445 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:32.577405    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95grv\" (UniqueName: \"kubernetes.io/projected/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-kube-api-access-95grv\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:52:32.577445 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:32.577443    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-maas-api-tls\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:52:32.577445 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:32.577452    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fd84963-7a06-46d4-98a1-5b50d1f2e72a-openshift-service-ca\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:52:33.405100 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:33.405009    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"
Jul 15 16:52:33.429829 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:33.429795    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"]
Jul 15 16:52:33.433260 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:33.433226    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dc2354a8-57d6f445cc-d8zd7"]
Jul 15 16:52:34.977633 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:52:34.977592    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fd84963-7a06-46d4-98a1-5b50d1f2e72a" path="/var/lib/kubelet/pods/7fd84963-7a06-46d4-98a1-5b50d1f2e72a/volumes"
Jul 15 16:53:38.902678 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:38.902589    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"]
Jul 15 16:53:38.903222 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:38.902861    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65" podUID="50702288-ecc4-4a94-8a46-3c8dff43b467" containerName="istio-proxy" containerID="cri-o://536e6da05bd720e0042712a5f393c18dae83b331c1464555737cf9a68108f7b5" gracePeriod=30
Jul 15 16:53:44.170713 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.170651    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:53:44.284581 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.284551    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-envoy\") pod \"50702288-ecc4-4a94-8a46-3c8dff43b467\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") "
Jul 15 16:53:44.284767 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.284599    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-credential-socket\") pod \"50702288-ecc4-4a94-8a46-3c8dff43b467\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") "
Jul 15 16:53:44.284767 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.284640    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-token\") pod \"50702288-ecc4-4a94-8a46-3c8dff43b467\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") "
Jul 15 16:53:44.284767 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.284690    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-px5kz\" (UniqueName: \"kubernetes.io/projected/50702288-ecc4-4a94-8a46-3c8dff43b467-kube-api-access-px5kz\") pod \"50702288-ecc4-4a94-8a46-3c8dff43b467\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") "
Jul 15 16:53:44.284767 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.284717    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-workload-certs\") pod \"50702288-ecc4-4a94-8a46-3c8dff43b467\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") "
Jul 15 16:53:44.284767 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.284737    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-workload-socket\") pod \"50702288-ecc4-4a94-8a46-3c8dff43b467\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") "
Jul 15 16:53:44.285038 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.284900    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-data\") pod \"50702288-ecc4-4a94-8a46-3c8dff43b467\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") "
Jul 15 16:53:44.285038 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.284952    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-podinfo\") pod \"50702288-ecc4-4a94-8a46-3c8dff43b467\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") "
Jul 15 16:53:44.285038 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.284939    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "50702288-ecc4-4a94-8a46-3c8dff43b467" (UID: "50702288-ecc4-4a94-8a46-3c8dff43b467"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:53:44.285038 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.284988    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50702288-ecc4-4a94-8a46-3c8dff43b467-istiod-ca-cert\") pod \"50702288-ecc4-4a94-8a46-3c8dff43b467\" (UID: \"50702288-ecc4-4a94-8a46-3c8dff43b467\") "
Jul 15 16:53:44.285038 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.285023    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "50702288-ecc4-4a94-8a46-3c8dff43b467" (UID: "50702288-ecc4-4a94-8a46-3c8dff43b467"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:53:44.285385 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.285283    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-credential-socket\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:53:44.285385 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.285301    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-workload-socket\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:53:44.285492 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.285410    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50702288-ecc4-4a94-8a46-3c8dff43b467-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "50702288-ecc4-4a94-8a46-3c8dff43b467" (UID: "50702288-ecc4-4a94-8a46-3c8dff43b467"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:53:44.285793 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.285768    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "50702288-ecc4-4a94-8a46-3c8dff43b467" (UID: "50702288-ecc4-4a94-8a46-3c8dff43b467"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:53:44.285793 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.285780    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-data" (OuterVolumeSpecName: "istio-data") pod "50702288-ecc4-4a94-8a46-3c8dff43b467" (UID: "50702288-ecc4-4a94-8a46-3c8dff43b467"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:53:44.286828 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.286805    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "50702288-ecc4-4a94-8a46-3c8dff43b467" (UID: "50702288-ecc4-4a94-8a46-3c8dff43b467"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:53:44.286934 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.286918    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-token" (OuterVolumeSpecName: "istio-token") pod "50702288-ecc4-4a94-8a46-3c8dff43b467" (UID: "50702288-ecc4-4a94-8a46-3c8dff43b467"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:53:44.286998 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.286969    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "50702288-ecc4-4a94-8a46-3c8dff43b467" (UID: "50702288-ecc4-4a94-8a46-3c8dff43b467"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:53:44.286998 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.286975    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50702288-ecc4-4a94-8a46-3c8dff43b467-kube-api-access-px5kz" (OuterVolumeSpecName: "kube-api-access-px5kz") pod "50702288-ecc4-4a94-8a46-3c8dff43b467" (UID: "50702288-ecc4-4a94-8a46-3c8dff43b467"). InnerVolumeSpecName "kube-api-access-px5kz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:53:44.386036 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.386012    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-data\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:53:44.386036 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.386033    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-podinfo\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:53:44.386171 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.386042    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50702288-ecc4-4a94-8a46-3c8dff43b467-istiod-ca-cert\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:53:44.386171 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.386050    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-envoy\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:53:44.386171 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.386058    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50702288-ecc4-4a94-8a46-3c8dff43b467-istio-token\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:53:44.386171 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.386067    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-px5kz\" (UniqueName: \"kubernetes.io/projected/50702288-ecc4-4a94-8a46-3c8dff43b467-kube-api-access-px5kz\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:53:44.386171 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.386077    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50702288-ecc4-4a94-8a46-3c8dff43b467-workload-certs\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:53:44.754047 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.754017    2582 generic.go:356] "Generic (PLEG): container finished" podID="50702288-ecc4-4a94-8a46-3c8dff43b467" containerID="536e6da05bd720e0042712a5f393c18dae83b331c1464555737cf9a68108f7b5" exitCode=0
Jul 15 16:53:44.754219 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.754065    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"
Jul 15 16:53:44.754219 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.754110    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65" event={"ID":"50702288-ecc4-4a94-8a46-3c8dff43b467","Type":"ContainerDied","Data":"536e6da05bd720e0042712a5f393c18dae83b331c1464555737cf9a68108f7b5"}
Jul 15 16:53:44.754219 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.754167    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65" event={"ID":"50702288-ecc4-4a94-8a46-3c8dff43b467","Type":"ContainerDied","Data":"143600d2aad9be5d395d161b3c6adbd6280099b3dd3a2dcedc063a767a2b9f1d"}
Jul 15 16:53:44.754219 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.754190    2582 scope.go:117] "RemoveContainer" containerID="536e6da05bd720e0042712a5f393c18dae83b331c1464555737cf9a68108f7b5"
Jul 15 16:53:44.764290 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.764272    2582 scope.go:117] "RemoveContainer" containerID="91b54112d69bf75c8174fdda7cc95e6fa66b9fb5a081c341c6479caed5a04be6"
Jul 15 16:53:44.778473 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.778326    2582 scope.go:117] "RemoveContainer" containerID="536e6da05bd720e0042712a5f393c18dae83b331c1464555737cf9a68108f7b5"
Jul 15 16:53:44.778860 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:53:44.778817    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"536e6da05bd720e0042712a5f393c18dae83b331c1464555737cf9a68108f7b5\": container with ID starting with 536e6da05bd720e0042712a5f393c18dae83b331c1464555737cf9a68108f7b5 not found: ID does not exist" containerID="536e6da05bd720e0042712a5f393c18dae83b331c1464555737cf9a68108f7b5"
Jul 15 16:53:44.778962 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.778875    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"536e6da05bd720e0042712a5f393c18dae83b331c1464555737cf9a68108f7b5"} err="failed to get container status \"536e6da05bd720e0042712a5f393c18dae83b331c1464555737cf9a68108f7b5\": rpc error: code = NotFound desc = could not find container \"536e6da05bd720e0042712a5f393c18dae83b331c1464555737cf9a68108f7b5\": container with ID starting with 536e6da05bd720e0042712a5f393c18dae83b331c1464555737cf9a68108f7b5 not found: ID does not exist"
Jul 15 16:53:44.778962 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.778913    2582 scope.go:117] "RemoveContainer" containerID="91b54112d69bf75c8174fdda7cc95e6fa66b9fb5a081c341c6479caed5a04be6"
Jul 15 16:53:44.779205 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:53:44.779176    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91b54112d69bf75c8174fdda7cc95e6fa66b9fb5a081c341c6479caed5a04be6\": container with ID starting with 91b54112d69bf75c8174fdda7cc95e6fa66b9fb5a081c341c6479caed5a04be6 not found: ID does not exist" containerID="91b54112d69bf75c8174fdda7cc95e6fa66b9fb5a081c341c6479caed5a04be6"
Jul 15 16:53:44.779259 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.779216    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91b54112d69bf75c8174fdda7cc95e6fa66b9fb5a081c341c6479caed5a04be6"} err="failed to get container status \"91b54112d69bf75c8174fdda7cc95e6fa66b9fb5a081c341c6479caed5a04be6\": rpc error: code = NotFound desc = could not find container \"91b54112d69bf75c8174fdda7cc95e6fa66b9fb5a081c341c6479caed5a04be6\": container with ID starting with 91b54112d69bf75c8174fdda7cc95e6fa66b9fb5a081c341c6479caed5a04be6 not found: ID does not exist"
Jul 15 16:53:44.782044 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.782023    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"]
Jul 15 16:53:44.785237 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.785216    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-dc2354a8-openshift-default-5bf8db9b9f-nlp65"]
Jul 15 16:53:44.977645 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:53:44.977609    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50702288-ecc4-4a94-8a46-3c8dff43b467" path="/var/lib/kubelet/pods/50702288-ecc4-4a94-8a46-3c8dff43b467/volumes"
Jul 15 16:54:34.556868 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.556831    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"]
Jul 15 16:54:34.557452 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.557424    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50702288-ecc4-4a94-8a46-3c8dff43b467" containerName="istio-proxy"
Jul 15 16:54:34.557452 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.557443    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="50702288-ecc4-4a94-8a46-3c8dff43b467" containerName="istio-proxy"
Jul 15 16:54:34.557580 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.557473    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fd84963-7a06-46d4-98a1-5b50d1f2e72a" containerName="maas-api"
Jul 15 16:54:34.557580 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.557481    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fd84963-7a06-46d4-98a1-5b50d1f2e72a" containerName="maas-api"
Jul 15 16:54:34.557690 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.557580    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fd84963-7a06-46d4-98a1-5b50d1f2e72a" containerName="maas-api"
Jul 15 16:54:34.557690 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.557594    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="50702288-ecc4-4a94-8a46-3c8dff43b467" containerName="istio-proxy"
Jul 15 16:54:34.560740 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.560717    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.564151 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.564111    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-5b944f-openshift-default-dockercfg-cnmxz\""
Jul 15 16:54:34.574441 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.574413    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"]
Jul 15 16:54:34.698416 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.698391    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-data\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.698572 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.698440    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-podinfo\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.698572 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.698461    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcrz9\" (UniqueName: \"kubernetes.io/projected/733224f2-62f2-4d72-b03c-3116b5a836cd-kube-api-access-xcrz9\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.698572 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.698546    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-token\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.698683 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.698576    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-workload-certs\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.698683 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.698611    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-credential-socket\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.698683 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.698626    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-envoy\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.698778 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.698700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-workload-socket\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.698778 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.698744    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/733224f2-62f2-4d72-b03c-3116b5a836cd-istiod-ca-cert\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.800027 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.799996    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-data\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.800166 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.800142    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-podinfo\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.800219 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.800171    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcrz9\" (UniqueName: \"kubernetes.io/projected/733224f2-62f2-4d72-b03c-3116b5a836cd-kube-api-access-xcrz9\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.800219 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.800206    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-token\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.800308 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.800233    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-workload-certs\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.800308 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.800278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-credential-socket\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.800308 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.800300    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-envoy\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.800491 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.800383    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-workload-socket\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.800491 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.800387    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-data\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.800491 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.800417    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/733224f2-62f2-4d72-b03c-3116b5a836cd-istiod-ca-cert\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.800671 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.800650    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-credential-socket\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.800786 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.800770    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-workload-socket\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.800847 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.800820    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-workload-certs\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.801175 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.801151    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/733224f2-62f2-4d72-b03c-3116b5a836cd-istiod-ca-cert\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.802739 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.802711    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-envoy\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.802739 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.802731    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-podinfo\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.809698 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.809652    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-token\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.810064 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.810042    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcrz9\" (UniqueName: \"kubernetes.io/projected/733224f2-62f2-4d72-b03c-3116b5a836cd-kube-api-access-xcrz9\") pod \"e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") " pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:34.873974 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:34.873950    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:35.016202 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:35.016180    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"]
Jul 15 16:54:35.018274 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:54:35.018247    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733224f2_62f2_4d72_b03c_3116b5a836cd.slice/crio-99732c6de38c6dbf9ddba60ce325f8785c505cca3766355d7b1c927bddc06b19 WatchSource:0}: Error finding container 99732c6de38c6dbf9ddba60ce325f8785c505cca3766355d7b1c927bddc06b19: Status 404 returned error can't find the container with id 99732c6de38c6dbf9ddba60ce325f8785c505cca3766355d7b1c927bddc06b19
Jul 15 16:54:35.020676 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:35.020634    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:54:35.020777 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:35.020755    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:54:35.020823 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:35.020795    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:54:35.991740 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:35.991709    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9" event={"ID":"733224f2-62f2-4d72-b03c-3116b5a836cd","Type":"ContainerStarted","Data":"cf44b138510d2b842aa797338101bcdcf4c04a642e806fe0377a336992527416"}
Jul 15 16:54:35.992085 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:35.991756    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9" event={"ID":"733224f2-62f2-4d72-b03c-3116b5a836cd","Type":"ContainerStarted","Data":"99732c6de38c6dbf9ddba60ce325f8785c505cca3766355d7b1c927bddc06b19"}
Jul 15 16:54:36.015166 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:36.015121    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9" podStartSLOduration=2.015107296 podStartE2EDuration="2.015107296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:54:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:54:36.013483684 +0000 UTC m=+2323.551309339" watchObservedRunningTime="2026-07-15 16:54:36.015107296 +0000 UTC m=+2323.552932950"
Jul 15 16:54:36.874465 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:36.874432    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:36.879522 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:36.879487    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:36.996858 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:36.996832    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:36.997618 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:36.997603    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:38.141092 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:38.141062    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"]
Jul 15 16:54:38.141706 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:38.141690    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50702288-ecc4-4a94-8a46-3c8dff43b467" containerName="istio-proxy"
Jul 15 16:54:38.141758 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:38.141710    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="50702288-ecc4-4a94-8a46-3c8dff43b467" containerName="istio-proxy"
Jul 15 16:54:38.141818 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:38.141807    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="50702288-ecc4-4a94-8a46-3c8dff43b467" containerName="istio-proxy"
Jul 15 16:54:38.145441 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:38.145419    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"
Jul 15 16:54:38.148240 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:38.148216    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-5b944f-serving-cert\""
Jul 15 16:54:38.156130 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:38.156104    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"]
Jul 15 16:54:38.233232 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:38.233208    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35570996-86b0-4743-b7a7-542a0763ab1c-maas-api-tls\") pod \"maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm\" (UID: \"35570996-86b0-4743-b7a7-542a0763ab1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"
Jul 15 16:54:38.233409 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:38.233291    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35570996-86b0-4743-b7a7-542a0763ab1c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm\" (UID: \"35570996-86b0-4743-b7a7-542a0763ab1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"
Jul 15 16:54:38.233409 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:38.233319    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzv8g\" (UniqueName: \"kubernetes.io/projected/35570996-86b0-4743-b7a7-542a0763ab1c-kube-api-access-pzv8g\") pod \"maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm\" (UID: \"35570996-86b0-4743-b7a7-542a0763ab1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"
Jul 15 16:54:38.334548 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:38.334523    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35570996-86b0-4743-b7a7-542a0763ab1c-maas-api-tls\") pod \"maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm\" (UID: \"35570996-86b0-4743-b7a7-542a0763ab1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"
Jul 15 16:54:38.334711 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:54:38.334687    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-serving-cert: secret "maas-api-e2e-inf-a-5b944f-serving-cert" not found
Jul 15 16:54:38.334762 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:38.334684    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35570996-86b0-4743-b7a7-542a0763ab1c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm\" (UID: \"35570996-86b0-4743-b7a7-542a0763ab1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"
Jul 15 16:54:38.334762 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:54:38.334756    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35570996-86b0-4743-b7a7-542a0763ab1c-maas-api-tls podName:35570996-86b0-4743-b7a7-542a0763ab1c nodeName:}" failed. No retries permitted until 2026-07-15 16:54:38.834735411 +0000 UTC m=+2326.372561049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/35570996-86b0-4743-b7a7-542a0763ab1c-maas-api-tls") pod "maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm" (UID: "35570996-86b0-4743-b7a7-542a0763ab1c") : secret "maas-api-e2e-inf-a-5b944f-serving-cert" not found
Jul 15 16:54:38.334839 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:38.334787    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzv8g\" (UniqueName: \"kubernetes.io/projected/35570996-86b0-4743-b7a7-542a0763ab1c-kube-api-access-pzv8g\") pod \"maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm\" (UID: \"35570996-86b0-4743-b7a7-542a0763ab1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"
Jul 15 16:54:38.335247 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:38.335230    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35570996-86b0-4743-b7a7-542a0763ab1c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm\" (UID: \"35570996-86b0-4743-b7a7-542a0763ab1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"
Jul 15 16:54:38.344961 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:38.344942    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzv8g\" (UniqueName: \"kubernetes.io/projected/35570996-86b0-4743-b7a7-542a0763ab1c-kube-api-access-pzv8g\") pod \"maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm\" (UID: \"35570996-86b0-4743-b7a7-542a0763ab1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"
Jul 15 16:54:38.840117 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:38.840087    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35570996-86b0-4743-b7a7-542a0763ab1c-maas-api-tls\") pod \"maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm\" (UID: \"35570996-86b0-4743-b7a7-542a0763ab1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"
Jul 15 16:54:38.842518 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:38.842493    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35570996-86b0-4743-b7a7-542a0763ab1c-maas-api-tls\") pod \"maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm\" (UID: \"35570996-86b0-4743-b7a7-542a0763ab1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"
Jul 15 16:54:39.058461 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:39.058434    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"
Jul 15 16:54:39.201493 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:39.201471    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"]
Jul 15 16:54:39.203119 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:54:39.203093    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35570996_86b0_4743_b7a7_542a0763ab1c.slice/crio-9198fe60bba2a85c5af80ab2a095e99e15d4cfd3f280dcb0692c10b652f4759a WatchSource:0}: Error finding container 9198fe60bba2a85c5af80ab2a095e99e15d4cfd3f280dcb0692c10b652f4759a: Status 404 returned error can't find the container with id 9198fe60bba2a85c5af80ab2a095e99e15d4cfd3f280dcb0692c10b652f4759a
Jul 15 16:54:40.016570 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:40.016483    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm" event={"ID":"35570996-86b0-4743-b7a7-542a0763ab1c","Type":"ContainerStarted","Data":"40fb48714438971bb219b7b6e9a9b037d8668f6c7e0ef63cf59d48817da8e441"}
Jul 15 16:54:40.016745 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:40.016613    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"
Jul 15 16:54:40.016745 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:40.016644    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm" event={"ID":"35570996-86b0-4743-b7a7-542a0763ab1c","Type":"ContainerStarted","Data":"9198fe60bba2a85c5af80ab2a095e99e15d4cfd3f280dcb0692c10b652f4759a"}
Jul 15 16:54:40.036870 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:40.036824    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm" podStartSLOduration=1.488823531 podStartE2EDuration="2.036808265s" totalImagesPullingTime="547.984734ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:54:40.034347656 +0000 UTC m=+2327.572173302" watchObservedRunningTime="2026-07-15 16:54:40.036808265 +0000 UTC m=+2327.574633918"
Jul 15 16:54:46.027853 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:46.027765    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"
Jul 15 16:54:52.907705 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:52.906739    2582 patch_prober.go:28] interesting pod/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:37012->10.132.0.54:15021: read: connection reset by peer" start-of-body=
Jul 15 16:54:52.907705 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:52.906790    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9" podUID="733224f2-62f2-4d72-b03c-3116b5a836cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:37012->10.132.0.54:15021: read: connection reset by peer"
Jul 15 16:54:53.084303 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:53.084242    2582 generic.go:356] "Generic (PLEG): container finished" podID="733224f2-62f2-4d72-b03c-3116b5a836cd" containerID="cf44b138510d2b842aa797338101bcdcf4c04a642e806fe0377a336992527416" exitCode=0
Jul 15 16:54:53.084444 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:53.084313    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9" event={"ID":"733224f2-62f2-4d72-b03c-3116b5a836cd","Type":"ContainerDied","Data":"cf44b138510d2b842aa797338101bcdcf4c04a642e806fe0377a336992527416"}
Jul 15 16:54:53.084650 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:53.084637    2582 scope.go:117] "RemoveContainer" containerID="cf44b138510d2b842aa797338101bcdcf4c04a642e806fe0377a336992527416"
Jul 15 16:54:53.085572 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:53.085546    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:54:53.085637 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:53.085611    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:54:53.085684 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:53.085642    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:54:54.094434 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:54.094398    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9" event={"ID":"733224f2-62f2-4d72-b03c-3116b5a836cd","Type":"ContainerStarted","Data":"ddcb5fc38fe91dd7991a6cad79d6a1664943d50cf3e8ef5f070121e6817b7dac"}
Jul 15 16:54:54.874506 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:54.874471    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:54.874704 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:54.874592    2582 patch_prober.go:28] interesting pod/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 15 16:54:54.874704 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:54.874634    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9" podUID="733224f2-62f2-4d72-b03c-3116b5a836cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 15 16:54:55.874658 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:55.874623    2582 patch_prober.go:28] interesting pod/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 15 16:54:55.875241 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:55.875209    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9" podUID="733224f2-62f2-4d72-b03c-3116b5a836cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 15 16:54:56.875235 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:56.875198    2582 patch_prober.go:28] interesting pod/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 15 16:54:56.875846 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:56.875813    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9" podUID="733224f2-62f2-4d72-b03c-3116b5a836cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 15 16:54:57.874598 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:57.874561    2582 patch_prober.go:28] interesting pod/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 15 16:54:57.874864 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:57.874837    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9" podUID="733224f2-62f2-4d72-b03c-3116b5a836cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 15 16:54:58.877691 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:58.877660    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:58.878155 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:58.878049    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:54:58.878764 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:54:58.878745    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:55:51.929094 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:51.929063    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"]
Jul 15 16:55:51.929535 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:51.929286    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm" podUID="35570996-86b0-4743-b7a7-542a0763ab1c" containerName="maas-api" containerID="cri-o://40fb48714438971bb219b7b6e9a9b037d8668f6c7e0ef63cf59d48817da8e441" gracePeriod=30
Jul 15 16:55:52.184132 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.184083    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"
Jul 15 16:55:52.370322 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.370288    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35570996-86b0-4743-b7a7-542a0763ab1c-openshift-service-ca\") pod \"35570996-86b0-4743-b7a7-542a0763ab1c\" (UID: \"35570996-86b0-4743-b7a7-542a0763ab1c\") "
Jul 15 16:55:52.370528 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.370372    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35570996-86b0-4743-b7a7-542a0763ab1c-maas-api-tls\") pod \"35570996-86b0-4743-b7a7-542a0763ab1c\" (UID: \"35570996-86b0-4743-b7a7-542a0763ab1c\") "
Jul 15 16:55:52.370528 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.370397    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzv8g\" (UniqueName: \"kubernetes.io/projected/35570996-86b0-4743-b7a7-542a0763ab1c-kube-api-access-pzv8g\") pod \"35570996-86b0-4743-b7a7-542a0763ab1c\" (UID: \"35570996-86b0-4743-b7a7-542a0763ab1c\") "
Jul 15 16:55:52.370673 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.370643    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35570996-86b0-4743-b7a7-542a0763ab1c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "35570996-86b0-4743-b7a7-542a0763ab1c" (UID: "35570996-86b0-4743-b7a7-542a0763ab1c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:55:52.372532 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.372509    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35570996-86b0-4743-b7a7-542a0763ab1c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "35570996-86b0-4743-b7a7-542a0763ab1c" (UID: "35570996-86b0-4743-b7a7-542a0763ab1c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:55:52.372933 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.372910    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35570996-86b0-4743-b7a7-542a0763ab1c-kube-api-access-pzv8g" (OuterVolumeSpecName: "kube-api-access-pzv8g") pod "35570996-86b0-4743-b7a7-542a0763ab1c" (UID: "35570996-86b0-4743-b7a7-542a0763ab1c"). InnerVolumeSpecName "kube-api-access-pzv8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:55:52.377431 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.377408    2582 generic.go:356] "Generic (PLEG): container finished" podID="35570996-86b0-4743-b7a7-542a0763ab1c" containerID="40fb48714438971bb219b7b6e9a9b037d8668f6c7e0ef63cf59d48817da8e441" exitCode=0
Jul 15 16:55:52.377533 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.377453    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"
Jul 15 16:55:52.377533 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.377475    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm" event={"ID":"35570996-86b0-4743-b7a7-542a0763ab1c","Type":"ContainerDied","Data":"40fb48714438971bb219b7b6e9a9b037d8668f6c7e0ef63cf59d48817da8e441"}
Jul 15 16:55:52.377533 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.377515    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm" event={"ID":"35570996-86b0-4743-b7a7-542a0763ab1c","Type":"ContainerDied","Data":"9198fe60bba2a85c5af80ab2a095e99e15d4cfd3f280dcb0692c10b652f4759a"}
Jul 15 16:55:52.377692 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.377538    2582 scope.go:117] "RemoveContainer" containerID="40fb48714438971bb219b7b6e9a9b037d8668f6c7e0ef63cf59d48817da8e441"
Jul 15 16:55:52.391594 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.391580    2582 scope.go:117] "RemoveContainer" containerID="40fb48714438971bb219b7b6e9a9b037d8668f6c7e0ef63cf59d48817da8e441"
Jul 15 16:55:52.391827 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:55:52.391809    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40fb48714438971bb219b7b6e9a9b037d8668f6c7e0ef63cf59d48817da8e441\": container with ID starting with 40fb48714438971bb219b7b6e9a9b037d8668f6c7e0ef63cf59d48817da8e441 not found: ID does not exist" containerID="40fb48714438971bb219b7b6e9a9b037d8668f6c7e0ef63cf59d48817da8e441"
Jul 15 16:55:52.391881 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.391834    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40fb48714438971bb219b7b6e9a9b037d8668f6c7e0ef63cf59d48817da8e441"} err="failed to get container status \"40fb48714438971bb219b7b6e9a9b037d8668f6c7e0ef63cf59d48817da8e441\": rpc error: code = NotFound desc = could not find container \"40fb48714438971bb219b7b6e9a9b037d8668f6c7e0ef63cf59d48817da8e441\": container with ID starting with 40fb48714438971bb219b7b6e9a9b037d8668f6c7e0ef63cf59d48817da8e441 not found: ID does not exist"
Jul 15 16:55:52.404038 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.404009    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"]
Jul 15 16:55:52.408257 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.408235    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5b944f-d6c8587d9-rktlm"]
Jul 15 16:55:52.471928 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.471911    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35570996-86b0-4743-b7a7-542a0763ab1c-maas-api-tls\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:55:52.472007 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.471930    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzv8g\" (UniqueName: \"kubernetes.io/projected/35570996-86b0-4743-b7a7-542a0763ab1c-kube-api-access-pzv8g\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:55:52.472007 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.471939    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35570996-86b0-4743-b7a7-542a0763ab1c-openshift-service-ca\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:55:52.978535 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:52.978503    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35570996-86b0-4743-b7a7-542a0763ab1c" path="/var/lib/kubelet/pods/35570996-86b0-4743-b7a7-542a0763ab1c/volumes"
Jul 15 16:55:53.105212 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:53.105186    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:55:53.109952 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:53.109926    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 16:55:53.112386 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:53.112363    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:55:53.116720 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:55:53.116704    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 16:56:07.292267 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:07.292236    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"]
Jul 15 16:56:07.292766 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:07.292452    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9" podUID="733224f2-62f2-4d72-b03c-3116b5a836cd" containerName="istio-proxy" containerID="cri-o://ddcb5fc38fe91dd7991a6cad79d6a1664943d50cf3e8ef5f070121e6817b7dac" gracePeriod=30
Jul 15 16:56:12.473609 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.473582    2582 generic.go:356] "Generic (PLEG): container finished" podID="733224f2-62f2-4d72-b03c-3116b5a836cd" containerID="ddcb5fc38fe91dd7991a6cad79d6a1664943d50cf3e8ef5f070121e6817b7dac" exitCode=0
Jul 15 16:56:12.473956 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.473655    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9" event={"ID":"733224f2-62f2-4d72-b03c-3116b5a836cd","Type":"ContainerDied","Data":"ddcb5fc38fe91dd7991a6cad79d6a1664943d50cf3e8ef5f070121e6817b7dac"}
Jul 15 16:56:12.473956 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.473730    2582 scope.go:117] "RemoveContainer" containerID="cf44b138510d2b842aa797338101bcdcf4c04a642e806fe0377a336992527416"
Jul 15 16:56:12.550658 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.550630    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:56:12.633178 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.633092    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-data\") pod \"733224f2-62f2-4d72-b03c-3116b5a836cd\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") "
Jul 15 16:56:12.633178 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.633125    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-envoy\") pod \"733224f2-62f2-4d72-b03c-3116b5a836cd\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") "
Jul 15 16:56:12.633178 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.633159    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-workload-socket\") pod \"733224f2-62f2-4d72-b03c-3116b5a836cd\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") "
Jul 15 16:56:12.633479 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.633187    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-credential-socket\") pod \"733224f2-62f2-4d72-b03c-3116b5a836cd\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") "
Jul 15 16:56:12.633479 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.633210    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-workload-certs\") pod \"733224f2-62f2-4d72-b03c-3116b5a836cd\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") "
Jul 15 16:56:12.633479 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.633232    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcrz9\" (UniqueName: \"kubernetes.io/projected/733224f2-62f2-4d72-b03c-3116b5a836cd-kube-api-access-xcrz9\") pod \"733224f2-62f2-4d72-b03c-3116b5a836cd\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") "
Jul 15 16:56:12.633479 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.633260    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/733224f2-62f2-4d72-b03c-3116b5a836cd-istiod-ca-cert\") pod \"733224f2-62f2-4d72-b03c-3116b5a836cd\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") "
Jul 15 16:56:12.633479 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.633317    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-token\") pod \"733224f2-62f2-4d72-b03c-3116b5a836cd\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") "
Jul 15 16:56:12.633479 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.633377    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-podinfo\") pod \"733224f2-62f2-4d72-b03c-3116b5a836cd\" (UID: \"733224f2-62f2-4d72-b03c-3116b5a836cd\") "
Jul 15 16:56:12.633787 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.633491    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "733224f2-62f2-4d72-b03c-3116b5a836cd" (UID: "733224f2-62f2-4d72-b03c-3116b5a836cd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:56:12.633787 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.633620    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "733224f2-62f2-4d72-b03c-3116b5a836cd" (UID: "733224f2-62f2-4d72-b03c-3116b5a836cd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:56:12.633787 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.633724    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-workload-socket\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:56:12.633787 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.633743    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-credential-socket\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:56:12.633977 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.633809    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/733224f2-62f2-4d72-b03c-3116b5a836cd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "733224f2-62f2-4d72-b03c-3116b5a836cd" (UID: "733224f2-62f2-4d72-b03c-3116b5a836cd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:56:12.633977 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.633875    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "733224f2-62f2-4d72-b03c-3116b5a836cd" (UID: "733224f2-62f2-4d72-b03c-3116b5a836cd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:56:12.634079 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.634046    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-data" (OuterVolumeSpecName: "istio-data") pod "733224f2-62f2-4d72-b03c-3116b5a836cd" (UID: "733224f2-62f2-4d72-b03c-3116b5a836cd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:56:12.635478 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.635448    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "733224f2-62f2-4d72-b03c-3116b5a836cd" (UID: "733224f2-62f2-4d72-b03c-3116b5a836cd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:56:12.635630 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.635614    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-token" (OuterVolumeSpecName: "istio-token") pod "733224f2-62f2-4d72-b03c-3116b5a836cd" (UID: "733224f2-62f2-4d72-b03c-3116b5a836cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:56:12.635828 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.635809    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/733224f2-62f2-4d72-b03c-3116b5a836cd-kube-api-access-xcrz9" (OuterVolumeSpecName: "kube-api-access-xcrz9") pod "733224f2-62f2-4d72-b03c-3116b5a836cd" (UID: "733224f2-62f2-4d72-b03c-3116b5a836cd"). InnerVolumeSpecName "kube-api-access-xcrz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:56:12.635875 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.635824    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "733224f2-62f2-4d72-b03c-3116b5a836cd" (UID: "733224f2-62f2-4d72-b03c-3116b5a836cd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:56:12.734635 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.734603    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-data\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:56:12.734635 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.734630    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-envoy\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:56:12.734635 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.734639    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/733224f2-62f2-4d72-b03c-3116b5a836cd-workload-certs\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:56:12.734861 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.734648    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcrz9\" (UniqueName: \"kubernetes.io/projected/733224f2-62f2-4d72-b03c-3116b5a836cd-kube-api-access-xcrz9\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:56:12.734861 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.734659    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/733224f2-62f2-4d72-b03c-3116b5a836cd-istiod-ca-cert\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:56:12.734861 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.734668    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-token\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:56:12.734861 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:12.734676    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/733224f2-62f2-4d72-b03c-3116b5a836cd-istio-podinfo\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:56:13.480108 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:13.480073    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9" event={"ID":"733224f2-62f2-4d72-b03c-3116b5a836cd","Type":"ContainerDied","Data":"99732c6de38c6dbf9ddba60ce325f8785c505cca3766355d7b1c927bddc06b19"}
Jul 15 16:56:13.480108 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:13.480103    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"
Jul 15 16:56:13.480680 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:13.480140    2582 scope.go:117] "RemoveContainer" containerID="ddcb5fc38fe91dd7991a6cad79d6a1664943d50cf3e8ef5f070121e6817b7dac"
Jul 15 16:56:13.508672 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:13.508646    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"]
Jul 15 16:56:13.510383 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:13.510362    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-5b944f-openshift-default-66865d5f45-lvdc9"]
Jul 15 16:56:14.977792 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:14.977714    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="733224f2-62f2-4d72-b03c-3116b5a836cd" path="/var/lib/kubelet/pods/733224f2-62f2-4d72-b03c-3116b5a836cd/volumes"
Jul 15 16:56:34.392048 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.392016    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"]
Jul 15 16:56:34.392513 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.392452    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733224f2-62f2-4d72-b03c-3116b5a836cd" containerName="istio-proxy"
Jul 15 16:56:34.392513 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.392464    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="733224f2-62f2-4d72-b03c-3116b5a836cd" containerName="istio-proxy"
Jul 15 16:56:34.392513 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.392482    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35570996-86b0-4743-b7a7-542a0763ab1c" containerName="maas-api"
Jul 15 16:56:34.392513 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.392488    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="35570996-86b0-4743-b7a7-542a0763ab1c" containerName="maas-api"
Jul 15 16:56:34.392650 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.392559    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="733224f2-62f2-4d72-b03c-3116b5a836cd" containerName="istio-proxy"
Jul 15 16:56:34.392650 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.392569    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="35570996-86b0-4743-b7a7-542a0763ab1c" containerName="maas-api"
Jul 15 16:56:34.392650 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.392576    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="733224f2-62f2-4d72-b03c-3116b5a836cd" containerName="istio-proxy"
Jul 15 16:56:34.395860 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.395839    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.399472 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.399452    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-00e709-openshift-default-dockercfg-m5n8g\""
Jul 15 16:56:34.412446 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.412423    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"]
Jul 15 16:56:34.524919 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.524879    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-workload-certs\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.524919 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.524912    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-workload-socket\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.525166 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.524935    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-token\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.525166 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.525036    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-data\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.525166 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.525065    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-envoy\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.525166 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.525091    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/595b4502-7715-4621-b2c5-d5590c7a63bb-istiod-ca-cert\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.525400 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.525185    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7lbn\" (UniqueName: \"kubernetes.io/projected/595b4502-7715-4621-b2c5-d5590c7a63bb-kube-api-access-p7lbn\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.525400 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.525244    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-podinfo\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.525400 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.525283    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-credential-socket\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.625961 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.625926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-data\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.625961 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.625964    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-envoy\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.626204 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.626091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/595b4502-7715-4621-b2c5-d5590c7a63bb-istiod-ca-cert\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.626204 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.626141    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7lbn\" (UniqueName: \"kubernetes.io/projected/595b4502-7715-4621-b2c5-d5590c7a63bb-kube-api-access-p7lbn\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.626204 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.626184    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-podinfo\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.626204 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.626203    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-credential-socket\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.626472 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.626254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-workload-certs\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.626472 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.626278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-workload-socket\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.626472 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.626304    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-token\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.626472 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.626308    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-data\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.626692 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.626587    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-workload-certs\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.626692 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.626659    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-credential-socket\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.626811 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.626731    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-workload-socket\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.626865 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.626846    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/595b4502-7715-4621-b2c5-d5590c7a63bb-istiod-ca-cert\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.628275 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.628254    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-envoy\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.628630 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.628613    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-podinfo\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.634598 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.634580    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7lbn\" (UniqueName: \"kubernetes.io/projected/595b4502-7715-4621-b2c5-d5590c7a63bb-kube-api-access-p7lbn\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.634687 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.634671    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-token\") pod \"e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") " pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.706723 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.706700    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:34.847531 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.847504    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"]
Jul 15 16:56:34.849245 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:56:34.849213    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod595b4502_7715_4621_b2c5_d5590c7a63bb.slice/crio-42fcc90b39527f62f49d7f1449c949ffae2e45e8c612204310bb7a17f710e8b3 WatchSource:0}: Error finding container 42fcc90b39527f62f49d7f1449c949ffae2e45e8c612204310bb7a17f710e8b3: Status 404 returned error can't find the container with id 42fcc90b39527f62f49d7f1449c949ffae2e45e8c612204310bb7a17f710e8b3
Jul 15 16:56:34.851380 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.851321    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:56:34.851492 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.851427    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:56:34.851568 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:34.851507    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:56:35.589227 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:35.589192    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj" event={"ID":"595b4502-7715-4621-b2c5-d5590c7a63bb","Type":"ContainerStarted","Data":"6767658986eb8c783feabf325de4b6df3d415de2f6430f80c015d00bb3a9c977"}
Jul 15 16:56:35.589730 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:35.589252    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj" event={"ID":"595b4502-7715-4621-b2c5-d5590c7a63bb","Type":"ContainerStarted","Data":"42fcc90b39527f62f49d7f1449c949ffae2e45e8c612204310bb7a17f710e8b3"}
Jul 15 16:56:35.613719 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:35.613673    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj" podStartSLOduration=1.6136596330000001 podStartE2EDuration="1.613659633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:56:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:56:35.611269739 +0000 UTC m=+2443.149095406" watchObservedRunningTime="2026-07-15 16:56:35.613659633 +0000 UTC m=+2443.151485289"
Jul 15 16:56:35.707585 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:35.707555    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:35.712488 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:35.712463    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:36.594177 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:36.594144    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:36.595023 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:36.595006    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:50.667309 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:50.667276    2582 generic.go:356] "Generic (PLEG): container finished" podID="595b4502-7715-4621-b2c5-d5590c7a63bb" containerID="6767658986eb8c783feabf325de4b6df3d415de2f6430f80c015d00bb3a9c977" exitCode=0
Jul 15 16:56:50.667723 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:50.667364    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj" event={"ID":"595b4502-7715-4621-b2c5-d5590c7a63bb","Type":"ContainerDied","Data":"6767658986eb8c783feabf325de4b6df3d415de2f6430f80c015d00bb3a9c977"}
Jul 15 16:56:50.667770 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:50.667753    2582 scope.go:117] "RemoveContainer" containerID="6767658986eb8c783feabf325de4b6df3d415de2f6430f80c015d00bb3a9c977"
Jul 15 16:56:50.668720 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:50.668694    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:56:50.668774 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:50.668757    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:56:50.668810 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:50.668790    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:56:51.594913 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:51.594878    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:51.681954 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:51.681918    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj" event={"ID":"595b4502-7715-4621-b2c5-d5590c7a63bb","Type":"ContainerStarted","Data":"90cb8f204848611be6e30e4030eb78d515334d12c5c725e99cfb9f23aa1a0978"}
Jul 15 16:56:51.709408 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:51.709364    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:51.712838 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:51.712802    2582 patch_prober.go:28] interesting pod/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 16:56:51.713111 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:51.713082    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj" podUID="595b4502-7715-4621-b2c5-d5590c7a63bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 16:56:52.707378 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:52.707318    2582 patch_prober.go:28] interesting pod/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 16:56:52.707774 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:52.707407    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj" podUID="595b4502-7715-4621-b2c5-d5590c7a63bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 16:56:53.707978 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:53.707942    2582 patch_prober.go:28] interesting pod/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 16:56:53.708392 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:53.707996    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj" podUID="595b4502-7715-4621-b2c5-d5590c7a63bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 16:56:54.708187 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:54.708156    2582 patch_prober.go:28] interesting pod/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 16:56:54.708574 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:54.708212    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj" podUID="595b4502-7715-4621-b2c5-d5590c7a63bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 16:56:55.707498 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:55.707463    2582 patch_prober.go:28] interesting pod/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 16:56:55.707688 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:55.707529    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj" podUID="595b4502-7715-4621-b2c5-d5590c7a63bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 16:56:56.711310 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:56.711278    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:56.711801 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:56.711684    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:56:56.712432 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:56:56.712408    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:57:24.788355 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:24.788308    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"]
Jul 15 16:57:24.788965 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:24.788653    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj" podUID="595b4502-7715-4621-b2c5-d5590c7a63bb" containerName="istio-proxy" containerID="cri-o://90cb8f204848611be6e30e4030eb78d515334d12c5c725e99cfb9f23aa1a0978" gracePeriod=30
Jul 15 16:57:26.714272 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:26.714237    2582 patch_prober.go:28] interesting pod/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 16:57:26.714654 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:26.714307    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj" podUID="595b4502-7715-4621-b2c5-d5590c7a63bb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:57:30.047454 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.047433    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:57:30.220406 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.220381    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-workload-certs\") pod \"595b4502-7715-4621-b2c5-d5590c7a63bb\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") "
Jul 15 16:57:30.220554 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.220435    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-credential-socket\") pod \"595b4502-7715-4621-b2c5-d5590c7a63bb\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") "
Jul 15 16:57:30.220554 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.220462    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-token\") pod \"595b4502-7715-4621-b2c5-d5590c7a63bb\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") "
Jul 15 16:57:30.220554 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.220482    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-data\") pod \"595b4502-7715-4621-b2c5-d5590c7a63bb\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") "
Jul 15 16:57:30.220554 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.220497    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7lbn\" (UniqueName: \"kubernetes.io/projected/595b4502-7715-4621-b2c5-d5590c7a63bb-kube-api-access-p7lbn\") pod \"595b4502-7715-4621-b2c5-d5590c7a63bb\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") "
Jul 15 16:57:30.220554 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.220523    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-podinfo\") pod \"595b4502-7715-4621-b2c5-d5590c7a63bb\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") "
Jul 15 16:57:30.220554 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.220555    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-workload-socket\") pod \"595b4502-7715-4621-b2c5-d5590c7a63bb\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") "
Jul 15 16:57:30.220875 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.220578    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-envoy\") pod \"595b4502-7715-4621-b2c5-d5590c7a63bb\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") "
Jul 15 16:57:30.220875 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.220603    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/595b4502-7715-4621-b2c5-d5590c7a63bb-istiod-ca-cert\") pod \"595b4502-7715-4621-b2c5-d5590c7a63bb\" (UID: \"595b4502-7715-4621-b2c5-d5590c7a63bb\") "
Jul 15 16:57:30.220875 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.220612    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "595b4502-7715-4621-b2c5-d5590c7a63bb" (UID: "595b4502-7715-4621-b2c5-d5590c7a63bb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:57:30.220875 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.220848    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "595b4502-7715-4621-b2c5-d5590c7a63bb" (UID: "595b4502-7715-4621-b2c5-d5590c7a63bb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:57:30.221088 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.220856    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-workload-certs\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:57:30.221175 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.221151    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/595b4502-7715-4621-b2c5-d5590c7a63bb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "595b4502-7715-4621-b2c5-d5590c7a63bb" (UID: "595b4502-7715-4621-b2c5-d5590c7a63bb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:57:30.221731 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.221698    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-data" (OuterVolumeSpecName: "istio-data") pod "595b4502-7715-4621-b2c5-d5590c7a63bb" (UID: "595b4502-7715-4621-b2c5-d5590c7a63bb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:57:30.221849 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.221025    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "595b4502-7715-4621-b2c5-d5590c7a63bb" (UID: "595b4502-7715-4621-b2c5-d5590c7a63bb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:57:30.222716 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.222689    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "595b4502-7715-4621-b2c5-d5590c7a63bb" (UID: "595b4502-7715-4621-b2c5-d5590c7a63bb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 16:57:30.222803 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.222776    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/595b4502-7715-4621-b2c5-d5590c7a63bb-kube-api-access-p7lbn" (OuterVolumeSpecName: "kube-api-access-p7lbn") pod "595b4502-7715-4621-b2c5-d5590c7a63bb" (UID: "595b4502-7715-4621-b2c5-d5590c7a63bb"). InnerVolumeSpecName "kube-api-access-p7lbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:57:30.222803 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.222789    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-token" (OuterVolumeSpecName: "istio-token") pod "595b4502-7715-4621-b2c5-d5590c7a63bb" (UID: "595b4502-7715-4621-b2c5-d5590c7a63bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:57:30.222874 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.222814    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "595b4502-7715-4621-b2c5-d5590c7a63bb" (UID: "595b4502-7715-4621-b2c5-d5590c7a63bb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:57:30.321537 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.321516    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-token\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:57:30.321537 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.321535    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-data\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:57:30.321668 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.321544    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7lbn\" (UniqueName: \"kubernetes.io/projected/595b4502-7715-4621-b2c5-d5590c7a63bb-kube-api-access-p7lbn\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:57:30.321668 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.321553    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-podinfo\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:57:30.321668 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.321561    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-workload-socket\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:57:30.321668 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.321570    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-istio-envoy\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:57:30.321668 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.321578    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/595b4502-7715-4621-b2c5-d5590c7a63bb-istiod-ca-cert\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:57:30.321668 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.321585    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/595b4502-7715-4621-b2c5-d5590c7a63bb-credential-socket\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 16:57:30.875283 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.875245    2582 generic.go:356] "Generic (PLEG): container finished" podID="595b4502-7715-4621-b2c5-d5590c7a63bb" containerID="90cb8f204848611be6e30e4030eb78d515334d12c5c725e99cfb9f23aa1a0978" exitCode=0
Jul 15 16:57:30.875466 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.875288    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj" event={"ID":"595b4502-7715-4621-b2c5-d5590c7a63bb","Type":"ContainerDied","Data":"90cb8f204848611be6e30e4030eb78d515334d12c5c725e99cfb9f23aa1a0978"}
Jul 15 16:57:30.875466 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.875296    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"
Jul 15 16:57:30.875466 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.875384    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj" event={"ID":"595b4502-7715-4621-b2c5-d5590c7a63bb","Type":"ContainerDied","Data":"42fcc90b39527f62f49d7f1449c949ffae2e45e8c612204310bb7a17f710e8b3"}
Jul 15 16:57:30.875466 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.875409    2582 scope.go:117] "RemoveContainer" containerID="90cb8f204848611be6e30e4030eb78d515334d12c5c725e99cfb9f23aa1a0978"
Jul 15 16:57:30.884761 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.884747    2582 scope.go:117] "RemoveContainer" containerID="6767658986eb8c783feabf325de4b6df3d415de2f6430f80c015d00bb3a9c977"
Jul 15 16:57:30.892429 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.892410    2582 scope.go:117] "RemoveContainer" containerID="90cb8f204848611be6e30e4030eb78d515334d12c5c725e99cfb9f23aa1a0978"
Jul 15 16:57:30.892662 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:57:30.892645    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90cb8f204848611be6e30e4030eb78d515334d12c5c725e99cfb9f23aa1a0978\": container with ID starting with 90cb8f204848611be6e30e4030eb78d515334d12c5c725e99cfb9f23aa1a0978 not found: ID does not exist" containerID="90cb8f204848611be6e30e4030eb78d515334d12c5c725e99cfb9f23aa1a0978"
Jul 15 16:57:30.892717 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.892670    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90cb8f204848611be6e30e4030eb78d515334d12c5c725e99cfb9f23aa1a0978"} err="failed to get container status \"90cb8f204848611be6e30e4030eb78d515334d12c5c725e99cfb9f23aa1a0978\": rpc error: code = NotFound desc = could not find container \"90cb8f204848611be6e30e4030eb78d515334d12c5c725e99cfb9f23aa1a0978\": container with ID starting with 90cb8f204848611be6e30e4030eb78d515334d12c5c725e99cfb9f23aa1a0978 not found: ID does not exist"
Jul 15 16:57:30.892717 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.892687    2582 scope.go:117] "RemoveContainer" containerID="6767658986eb8c783feabf325de4b6df3d415de2f6430f80c015d00bb3a9c977"
Jul 15 16:57:30.892910 ip-10-0-141-253 kubenswrapper[2582]: E0715 16:57:30.892893    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6767658986eb8c783feabf325de4b6df3d415de2f6430f80c015d00bb3a9c977\": container with ID starting with 6767658986eb8c783feabf325de4b6df3d415de2f6430f80c015d00bb3a9c977 not found: ID does not exist" containerID="6767658986eb8c783feabf325de4b6df3d415de2f6430f80c015d00bb3a9c977"
Jul 15 16:57:30.892967 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.892919    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6767658986eb8c783feabf325de4b6df3d415de2f6430f80c015d00bb3a9c977"} err="failed to get container status \"6767658986eb8c783feabf325de4b6df3d415de2f6430f80c015d00bb3a9c977\": rpc error: code = NotFound desc = could not find container \"6767658986eb8c783feabf325de4b6df3d415de2f6430f80c015d00bb3a9c977\": container with ID starting with 6767658986eb8c783feabf325de4b6df3d415de2f6430f80c015d00bb3a9c977 not found: ID does not exist"
Jul 15 16:57:30.898223 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.898205    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"]
Jul 15 16:57:30.902637 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.902616    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-00e709-openshift-default-d9f4cddd9-fkswj"]
Jul 15 16:57:30.977635 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:30.977614    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="595b4502-7715-4621-b2c5-d5590c7a63bb" path="/var/lib/kubelet/pods/595b4502-7715-4621-b2c5-d5590c7a63bb/volumes"
Jul 15 16:57:51.968292 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:51.968260    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"]
Jul 15 16:57:51.968699 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:51.968665    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="595b4502-7715-4621-b2c5-d5590c7a63bb" containerName="istio-proxy"
Jul 15 16:57:51.968699 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:51.968677    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="595b4502-7715-4621-b2c5-d5590c7a63bb" containerName="istio-proxy"
Jul 15 16:57:51.968699 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:51.968695    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="595b4502-7715-4621-b2c5-d5590c7a63bb" containerName="istio-proxy"
Jul 15 16:57:51.968801 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:51.968701    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="595b4502-7715-4621-b2c5-d5590c7a63bb" containerName="istio-proxy"
Jul 15 16:57:51.968801 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:51.968716    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733224f2-62f2-4d72-b03c-3116b5a836cd" containerName="istio-proxy"
Jul 15 16:57:51.968801 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:51.968722    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="733224f2-62f2-4d72-b03c-3116b5a836cd" containerName="istio-proxy"
Jul 15 16:57:51.968801 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:51.968791    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="595b4502-7715-4621-b2c5-d5590c7a63bb" containerName="istio-proxy"
Jul 15 16:57:51.973502 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:51.973477    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:51.976579 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:51.976558    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-8269b5-openshift-default-dockercfg-8fttj\""
Jul 15 16:57:51.987108 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:51.987083    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"]
Jul 15 16:57:52.001164 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.001129    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-credential-socket\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.001290 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.001233    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istiod-ca-cert\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.001369 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.001286    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-podinfo\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.001369 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.001313    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-workload-certs\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.001369 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.001361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-data\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.001531 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.001386    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-token\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.001531 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.001487    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-workload-socket\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.001645 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.001556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-envoy\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.001645 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.001591    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdrzb\" (UniqueName: \"kubernetes.io/projected/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-kube-api-access-pdrzb\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.102309 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.102278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-envoy\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.102309 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.102313    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdrzb\" (UniqueName: \"kubernetes.io/projected/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-kube-api-access-pdrzb\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.102595 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.102370    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-credential-socket\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.102595 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.102398    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istiod-ca-cert\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.102595 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.102437    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-podinfo\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.102595 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.102464    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-workload-certs\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.102595 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.102496    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-data\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.102595 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.102520    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-token\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.102595 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.102560    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-workload-socket\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.102936 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.102802    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-credential-socket\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.102994 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.102964    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-data\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.103146 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.103122    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-workload-socket\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.103215 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.103169    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istiod-ca-cert\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.103215 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.103201    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-workload-certs\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.104622 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.104603    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-envoy\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.105025 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.105008    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-podinfo\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.111720 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.111692    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdrzb\" (UniqueName: \"kubernetes.io/projected/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-kube-api-access-pdrzb\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.112234 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.112209    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-token\") pod \"e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") " pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.284805 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.284720    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:52.425004 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.424974    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"]
Jul 15 16:57:52.426526 ip-10-0-141-253 kubenswrapper[2582]: W0715 16:57:52.426502    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eb3010e_56f6_4396_af2a_014e6bd2c8ce.slice/crio-55a8b9315b8f89466fb79a72226a6e79a1a003004905feeed4f06085947c0790 WatchSource:0}: Error finding container 55a8b9315b8f89466fb79a72226a6e79a1a003004905feeed4f06085947c0790: Status 404 returned error can't find the container with id 55a8b9315b8f89466fb79a72226a6e79a1a003004905feeed4f06085947c0790
Jul 15 16:57:52.428538 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.428508    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:57:52.428607 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.428574    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:57:52.428607 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.428602    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:57:52.983674 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.983645    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx" event={"ID":"1eb3010e-56f6-4396-af2a-014e6bd2c8ce","Type":"ContainerStarted","Data":"d955d49efbc82d345cc618f9109f1d9fac3b28a613603807c49f53515d0d1506"}
Jul 15 16:57:52.984044 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:52.983692    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx" event={"ID":"1eb3010e-56f6-4396-af2a-014e6bd2c8ce","Type":"ContainerStarted","Data":"55a8b9315b8f89466fb79a72226a6e79a1a003004905feeed4f06085947c0790"}
Jul 15 16:57:53.007311 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:53.007264    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx" podStartSLOduration=2.007250534 podStartE2EDuration="2.007250534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:57:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:57:53.005112819 +0000 UTC m=+2520.542938476" watchObservedRunningTime="2026-07-15 16:57:53.007250534 +0000 UTC m=+2520.545076190"
Jul 15 16:57:53.263203 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:53.263127    2582 scope.go:117] "RemoveContainer" containerID="a8a28cd7be2564612dd075602319906dc323ee58fa280e851e75efbeb76c02ce"
Jul 15 16:57:53.285299 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:53.285283    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:53.290298 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:53.290278    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:53.988556 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:53.988521    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:57:53.989404 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:57:53.989382    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:58:08.053071 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:08.053039    2582 generic.go:356] "Generic (PLEG): container finished" podID="1eb3010e-56f6-4396-af2a-014e6bd2c8ce" containerID="d955d49efbc82d345cc618f9109f1d9fac3b28a613603807c49f53515d0d1506" exitCode=0
Jul 15 16:58:08.053610 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:08.053119    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx" event={"ID":"1eb3010e-56f6-4396-af2a-014e6bd2c8ce","Type":"ContainerDied","Data":"d955d49efbc82d345cc618f9109f1d9fac3b28a613603807c49f53515d0d1506"}
Jul 15 16:58:08.053610 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:08.053600    2582 scope.go:117] "RemoveContainer" containerID="d955d49efbc82d345cc618f9109f1d9fac3b28a613603807c49f53515d0d1506"
Jul 15 16:58:08.054619 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:08.054591    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:58:08.054727 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:08.054674    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:58:08.054791 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:08.054733    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 16:58:08.989387 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:08.989356    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:58:09.059964 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:09.059929    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx" event={"ID":"1eb3010e-56f6-4396-af2a-014e6bd2c8ce","Type":"ContainerStarted","Data":"ecdb9c1ab0f0b1bf00a68a0463f528af3e9bfd95087740ab289ab51252c608e5"}
Jul 15 16:58:09.285702 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:09.285595    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:58:09.286574 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:09.286548    2582 patch_prober.go:28] interesting pod/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 15 16:58:09.287094 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:09.286777    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx" podUID="1eb3010e-56f6-4396-af2a-014e6bd2c8ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 15 16:58:10.285933 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:10.285888    2582 patch_prober.go:28] interesting pod/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 15 16:58:10.286491 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:10.285956    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx" podUID="1eb3010e-56f6-4396-af2a-014e6bd2c8ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 15 16:58:11.289364 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:11.285723    2582 patch_prober.go:28] interesting pod/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 15 16:58:11.289364 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:11.285788    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx" podUID="1eb3010e-56f6-4396-af2a-014e6bd2c8ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 15 16:58:12.285815 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:12.285768    2582 patch_prober.go:28] interesting pod/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 15 16:58:12.286018 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:12.285852    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx" podUID="1eb3010e-56f6-4396-af2a-014e6bd2c8ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 15 16:58:13.289699 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:13.289666    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:58:13.290176 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:13.290063    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 16:58:13.290804 ip-10-0-141-253 kubenswrapper[2582]: I0715 16:58:13.290785    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 17:00:53.134490 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:00:53.134462    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 17:00:53.139743 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:00:53.139722    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 17:00:53.141151 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:00:53.141132    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 17:00:53.146383 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:00:53.146367    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcp65_e83119d2-cd50-4da7-8e8c-1ecfb586cdd6/ovn-acl-logging/0.log"
Jul 15 17:04:16.764526 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:16.764495    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"]
Jul 15 17:04:16.765060 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:16.764722    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx" podUID="1eb3010e-56f6-4396-af2a-014e6bd2c8ce" containerName="istio-proxy" containerID="cri-o://ecdb9c1ab0f0b1bf00a68a0463f528af3e9bfd95087740ab289ab51252c608e5" gracePeriod=30
Jul 15 17:04:22.027175 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.027108    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 17:04:22.165482 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.165451    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-data\") pod \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") "
Jul 15 17:04:22.165662 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.165493    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdrzb\" (UniqueName: \"kubernetes.io/projected/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-kube-api-access-pdrzb\") pod \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") "
Jul 15 17:04:22.165662 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.165519    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-token\") pod \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") "
Jul 15 17:04:22.165662 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.165539    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-credential-socket\") pod \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") "
Jul 15 17:04:22.165662 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.165591    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istiod-ca-cert\") pod \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") "
Jul 15 17:04:22.165662 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.165607    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-podinfo\") pod \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") "
Jul 15 17:04:22.165662 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.165627    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-workload-certs\") pod \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") "
Jul 15 17:04:22.165972 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.165673    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-envoy\") pod \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") "
Jul 15 17:04:22.165972 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.165734    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-workload-socket\") pod \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\" (UID: \"1eb3010e-56f6-4396-af2a-014e6bd2c8ce\") "
Jul 15 17:04:22.165972 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.165937    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1eb3010e-56f6-4396-af2a-014e6bd2c8ce" (UID: "1eb3010e-56f6-4396-af2a-014e6bd2c8ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:04:22.166183 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.166020    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-workload-certs\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 17:04:22.166183 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.166044    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1eb3010e-56f6-4396-af2a-014e6bd2c8ce" (UID: "1eb3010e-56f6-4396-af2a-014e6bd2c8ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:04:22.166183 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.166139    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1eb3010e-56f6-4396-af2a-014e6bd2c8ce" (UID: "1eb3010e-56f6-4396-af2a-014e6bd2c8ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:04:22.166372 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.166185    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1eb3010e-56f6-4396-af2a-014e6bd2c8ce" (UID: "1eb3010e-56f6-4396-af2a-014e6bd2c8ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:04:22.166439 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.166363    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "1eb3010e-56f6-4396-af2a-014e6bd2c8ce" (UID: "1eb3010e-56f6-4396-af2a-014e6bd2c8ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:04:22.167849 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.167822    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-kube-api-access-pdrzb" (OuterVolumeSpecName: "kube-api-access-pdrzb") pod "1eb3010e-56f6-4396-af2a-014e6bd2c8ce" (UID: "1eb3010e-56f6-4396-af2a-014e6bd2c8ce"). InnerVolumeSpecName "kube-api-access-pdrzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:04:22.167849 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.167842    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "1eb3010e-56f6-4396-af2a-014e6bd2c8ce" (UID: "1eb3010e-56f6-4396-af2a-014e6bd2c8ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:04:22.168011 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.167860    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1eb3010e-56f6-4396-af2a-014e6bd2c8ce" (UID: "1eb3010e-56f6-4396-af2a-014e6bd2c8ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 17:04:22.168051 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.168024    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1eb3010e-56f6-4396-af2a-014e6bd2c8ce" (UID: "1eb3010e-56f6-4396-af2a-014e6bd2c8ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:04:22.266734 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.266704    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-workload-socket\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 17:04:22.266734 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.266729    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-data\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 17:04:22.266734 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.266738    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdrzb\" (UniqueName: \"kubernetes.io/projected/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-kube-api-access-pdrzb\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 17:04:22.266953 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.266749    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-token\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 17:04:22.266953 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.266758    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-credential-socket\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 17:04:22.266953 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.266766    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istiod-ca-cert\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 17:04:22.266953 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.266774    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-podinfo\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 17:04:22.266953 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.266781    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1eb3010e-56f6-4396-af2a-014e6bd2c8ce-istio-envoy\") on node \"ip-10-0-141-253.ec2.internal\" DevicePath \"\""
Jul 15 17:04:22.849650 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.849616    2582 generic.go:356] "Generic (PLEG): container finished" podID="1eb3010e-56f6-4396-af2a-014e6bd2c8ce" containerID="ecdb9c1ab0f0b1bf00a68a0463f528af3e9bfd95087740ab289ab51252c608e5" exitCode=0
Jul 15 17:04:22.849813 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.849661    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"
Jul 15 17:04:22.849813 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.849701    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx" event={"ID":"1eb3010e-56f6-4396-af2a-014e6bd2c8ce","Type":"ContainerDied","Data":"ecdb9c1ab0f0b1bf00a68a0463f528af3e9bfd95087740ab289ab51252c608e5"}
Jul 15 17:04:22.849813 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.849755    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx" event={"ID":"1eb3010e-56f6-4396-af2a-014e6bd2c8ce","Type":"ContainerDied","Data":"55a8b9315b8f89466fb79a72226a6e79a1a003004905feeed4f06085947c0790"}
Jul 15 17:04:22.849813 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.849778    2582 scope.go:117] "RemoveContainer" containerID="ecdb9c1ab0f0b1bf00a68a0463f528af3e9bfd95087740ab289ab51252c608e5"
Jul 15 17:04:22.859183 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.859163    2582 scope.go:117] "RemoveContainer" containerID="d955d49efbc82d345cc618f9109f1d9fac3b28a613603807c49f53515d0d1506"
Jul 15 17:04:22.866673 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.866654    2582 scope.go:117] "RemoveContainer" containerID="ecdb9c1ab0f0b1bf00a68a0463f528af3e9bfd95087740ab289ab51252c608e5"
Jul 15 17:04:22.866935 ip-10-0-141-253 kubenswrapper[2582]: E0715 17:04:22.866918    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecdb9c1ab0f0b1bf00a68a0463f528af3e9bfd95087740ab289ab51252c608e5\": container with ID starting with ecdb9c1ab0f0b1bf00a68a0463f528af3e9bfd95087740ab289ab51252c608e5 not found: ID does not exist" containerID="ecdb9c1ab0f0b1bf00a68a0463f528af3e9bfd95087740ab289ab51252c608e5"
Jul 15 17:04:22.866985 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.866942    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecdb9c1ab0f0b1bf00a68a0463f528af3e9bfd95087740ab289ab51252c608e5"} err="failed to get container status \"ecdb9c1ab0f0b1bf00a68a0463f528af3e9bfd95087740ab289ab51252c608e5\": rpc error: code = NotFound desc = could not find container \"ecdb9c1ab0f0b1bf00a68a0463f528af3e9bfd95087740ab289ab51252c608e5\": container with ID starting with ecdb9c1ab0f0b1bf00a68a0463f528af3e9bfd95087740ab289ab51252c608e5 not found: ID does not exist"
Jul 15 17:04:22.866985 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.866961    2582 scope.go:117] "RemoveContainer" containerID="d955d49efbc82d345cc618f9109f1d9fac3b28a613603807c49f53515d0d1506"
Jul 15 17:04:22.867187 ip-10-0-141-253 kubenswrapper[2582]: E0715 17:04:22.867170    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d955d49efbc82d345cc618f9109f1d9fac3b28a613603807c49f53515d0d1506\": container with ID starting with d955d49efbc82d345cc618f9109f1d9fac3b28a613603807c49f53515d0d1506 not found: ID does not exist" containerID="d955d49efbc82d345cc618f9109f1d9fac3b28a613603807c49f53515d0d1506"
Jul 15 17:04:22.867228 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.867193    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d955d49efbc82d345cc618f9109f1d9fac3b28a613603807c49f53515d0d1506"} err="failed to get container status \"d955d49efbc82d345cc618f9109f1d9fac3b28a613603807c49f53515d0d1506\": rpc error: code = NotFound desc = could not find container \"d955d49efbc82d345cc618f9109f1d9fac3b28a613603807c49f53515d0d1506\": container with ID starting with d955d49efbc82d345cc618f9109f1d9fac3b28a613603807c49f53515d0d1506 not found: ID does not exist"
Jul 15 17:04:22.872364 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.872331    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"]
Jul 15 17:04:22.876196 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.876177    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-8269b5-openshift-default-5f98d96f7f-gwtsx"]
Jul 15 17:04:22.977930 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:22.977904    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1eb3010e-56f6-4396-af2a-014e6bd2c8ce" path="/var/lib/kubelet/pods/1eb3010e-56f6-4396-af2a-014e6bd2c8ce/volumes"
Jul 15 17:04:49.353900 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:49.353869    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dv5mc_ad418358-b34a-4f07-aa3d-76eeebdf1e0e/manager/0.log"
Jul 15 17:04:49.477606 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:49.477580    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-59ng9_2b96215f-59cb-4980-a61d-c082e3d457dc/manager/0.log"
Jul 15 17:04:49.606664 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:49.606593    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6cff9854fb-v77nm_1aefef03-b9c8-4c11-9388-a8e0c7f427da/manager/0.log"
Jul 15 17:04:50.125636 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:50.125605    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-599cdff4cb-qv2vn_53e5d08e-a974-475d-99c3-92e5a59e9197/copy-manifests/0.log"
Jul 15 17:04:50.144312 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:50.144286    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-599cdff4cb-qv2vn_53e5d08e-a974-475d-99c3-92e5a59e9197/manager/0.log"
Jul 15 17:04:50.669168 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:50.669139    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5484fd6ff-zcmzq_e103985d-2289-4b76-a324-320563a0c350/maas-api/0.log"
Jul 15 17:04:52.650039 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:52.650014    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-c4v28_8638902f-4521-46c2-b127-bb4819939999/postgres/0.log"
Jul 15 17:04:55.835543 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:55.835509    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-sh5pv_c067a8e3-b716-429b-bb35-796f8ef55d08/istio-proxy/1.log"
Jul 15 17:04:55.956658 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:55.956635    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-42ffq_5441e553-15ff-49c6-972e-ff3b423b44ed/payload-pre-processing/0.log"
Jul 15 17:04:56.085481 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:56.085453    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-m5plh_ce90b6a1-2e7e-4495-ab83-0bfa357aa683/payload-processing/0.log"
Jul 15 17:04:56.220574 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:56.220549    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fd46db8-vfcwl_0043fb1f-b142-46de-9dee-9e7f1c5dc853/router/0.log"
Jul 15 17:04:56.951633 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:56.951607    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjd44n_03b21b5e-0e5d-4a8c-b1e3-a826ebdad436/main/0.log"
Jul 15 17:04:57.074460 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:04:57.074422    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-5rfcx_a97018fa-fe9d-4fbf-9d3e-ed3c2691b6f4/main/0.log"
Jul 15 17:05:06.229676 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:06.229648    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-z7zbh_d0d24e92-1685-4d42-b291-4ceebc12c881/global-pull-secret-syncer/0.log"
Jul 15 17:05:06.360179 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:06.360151    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-th64x_9787ee82-eeaf-4476-9925-1aa7774e6f6d/konnectivity-agent/0.log"
Jul 15 17:05:06.428159 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:06.428134    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-253.ec2.internal_3aa295c57b47767de99fcd5136c816cd/haproxy/0.log"
Jul 15 17:05:14.151929 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:14.151901    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-jfkg2_3d43b990-0b96-40f5-a957-94e8914b0f81/cluster-monitoring-operator/0.log"
Jul 15 17:05:14.337615 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:14.337591    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5fkr5_57dbb7d5-b0b6-4753-9279-7fb0402e4393/node-exporter/0.log"
Jul 15 17:05:14.362238 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:14.362217    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5fkr5_57dbb7d5-b0b6-4753-9279-7fb0402e4393/kube-rbac-proxy/0.log"
Jul 15 17:05:14.383672 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:14.383655    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5fkr5_57dbb7d5-b0b6-4753-9279-7fb0402e4393/init-textfile/0.log"
Jul 15 17:05:14.871719 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:14.871649    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-2mcwd_6ed872cc-9c6b-45da-a3c9-0aae770f3972/prometheus-operator-admission-webhook/0.log"
Jul 15 17:05:16.019899 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.019865    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"]
Jul 15 17:05:16.020248 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.020223    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eb3010e-56f6-4396-af2a-014e6bd2c8ce" containerName="istio-proxy"
Jul 15 17:05:16.020248 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.020233    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eb3010e-56f6-4396-af2a-014e6bd2c8ce" containerName="istio-proxy"
Jul 15 17:05:16.020320 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.020297    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eb3010e-56f6-4396-af2a-014e6bd2c8ce" containerName="istio-proxy"
Jul 15 17:05:16.020320 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.020307    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eb3010e-56f6-4396-af2a-014e6bd2c8ce" containerName="istio-proxy"
Jul 15 17:05:16.020320 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.020317    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="595b4502-7715-4621-b2c5-d5590c7a63bb" containerName="istio-proxy"
Jul 15 17:05:16.023563 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.023544    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:16.026371 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.026313    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4vtsf\"/\"default-dockercfg-cgjtb\""
Jul 15 17:05:16.026476 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.026366    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4vtsf\"/\"kube-root-ca.crt\""
Jul 15 17:05:16.027349 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.027323    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4vtsf\"/\"openshift-service-ca.crt\""
Jul 15 17:05:16.034483 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.034465    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"]
Jul 15 17:05:16.118126 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.118099    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/04cc7918-897c-4617-8f7d-bb5fa3115c0a-proc\") pod \"perf-node-gather-daemonset-79kxb\" (UID: \"04cc7918-897c-4617-8f7d-bb5fa3115c0a\") " pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:16.118265 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.118139    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-464c7\" (UniqueName: \"kubernetes.io/projected/04cc7918-897c-4617-8f7d-bb5fa3115c0a-kube-api-access-464c7\") pod \"perf-node-gather-daemonset-79kxb\" (UID: \"04cc7918-897c-4617-8f7d-bb5fa3115c0a\") " pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:16.118265 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.118197    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/04cc7918-897c-4617-8f7d-bb5fa3115c0a-podres\") pod \"perf-node-gather-daemonset-79kxb\" (UID: \"04cc7918-897c-4617-8f7d-bb5fa3115c0a\") " pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:16.118265 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.118228    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04cc7918-897c-4617-8f7d-bb5fa3115c0a-sys\") pod \"perf-node-gather-daemonset-79kxb\" (UID: \"04cc7918-897c-4617-8f7d-bb5fa3115c0a\") " pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:16.118398 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.118374    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04cc7918-897c-4617-8f7d-bb5fa3115c0a-lib-modules\") pod \"perf-node-gather-daemonset-79kxb\" (UID: \"04cc7918-897c-4617-8f7d-bb5fa3115c0a\") " pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:16.218937 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.218906    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/04cc7918-897c-4617-8f7d-bb5fa3115c0a-proc\") pod \"perf-node-gather-daemonset-79kxb\" (UID: \"04cc7918-897c-4617-8f7d-bb5fa3115c0a\") " pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:16.219069 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.218947    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-464c7\" (UniqueName: \"kubernetes.io/projected/04cc7918-897c-4617-8f7d-bb5fa3115c0a-kube-api-access-464c7\") pod \"perf-node-gather-daemonset-79kxb\" (UID: \"04cc7918-897c-4617-8f7d-bb5fa3115c0a\") " pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:16.219069 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.218997    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/04cc7918-897c-4617-8f7d-bb5fa3115c0a-podres\") pod \"perf-node-gather-daemonset-79kxb\" (UID: \"04cc7918-897c-4617-8f7d-bb5fa3115c0a\") " pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:16.219069 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.219042    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04cc7918-897c-4617-8f7d-bb5fa3115c0a-sys\") pod \"perf-node-gather-daemonset-79kxb\" (UID: \"04cc7918-897c-4617-8f7d-bb5fa3115c0a\") " pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:16.219175 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.219078    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04cc7918-897c-4617-8f7d-bb5fa3115c0a-lib-modules\") pod \"perf-node-gather-daemonset-79kxb\" (UID: \"04cc7918-897c-4617-8f7d-bb5fa3115c0a\") " pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:16.219175 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.219088    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/04cc7918-897c-4617-8f7d-bb5fa3115c0a-proc\") pod \"perf-node-gather-daemonset-79kxb\" (UID: \"04cc7918-897c-4617-8f7d-bb5fa3115c0a\") " pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:16.219175 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.219126    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/04cc7918-897c-4617-8f7d-bb5fa3115c0a-podres\") pod \"perf-node-gather-daemonset-79kxb\" (UID: \"04cc7918-897c-4617-8f7d-bb5fa3115c0a\") " pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:16.219175 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.219160    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04cc7918-897c-4617-8f7d-bb5fa3115c0a-sys\") pod \"perf-node-gather-daemonset-79kxb\" (UID: \"04cc7918-897c-4617-8f7d-bb5fa3115c0a\") " pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:16.219304 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.219199    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04cc7918-897c-4617-8f7d-bb5fa3115c0a-lib-modules\") pod \"perf-node-gather-daemonset-79kxb\" (UID: \"04cc7918-897c-4617-8f7d-bb5fa3115c0a\") " pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:16.228344 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.228317    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-464c7\" (UniqueName: \"kubernetes.io/projected/04cc7918-897c-4617-8f7d-bb5fa3115c0a-kube-api-access-464c7\") pod \"perf-node-gather-daemonset-79kxb\" (UID: \"04cc7918-897c-4617-8f7d-bb5fa3115c0a\") " pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:16.322310 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.322247    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-4hfqq_5cd5bfcf-80f9-42d9-8e6a-62b518bbdaac/networking-console-plugin/0.log"
Jul 15 17:05:16.333987 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.333965    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:16.470091 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.470063    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"]
Jul 15 17:05:16.473077 ip-10-0-141-253 kubenswrapper[2582]: W0715 17:05:16.473051    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod04cc7918_897c_4617_8f7d_bb5fa3115c0a.slice/crio-a8b33898805a54a0584e6e503fc77a55f743e9bf58e18bf38ec57b459277a893 WatchSource:0}: Error finding container a8b33898805a54a0584e6e503fc77a55f743e9bf58e18bf38ec57b459277a893: Status 404 returned error can't find the container with id a8b33898805a54a0584e6e503fc77a55f743e9bf58e18bf38ec57b459277a893
Jul 15 17:05:16.936197 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.936112    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/2.log"
Jul 15 17:05:16.940581 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:16.940558    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-l9sbq_a65995fc-4690-4f8a-8cb6-222b26a0e514/console-operator/3.log"
Jul 15 17:05:17.093116 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:17.093084    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb" event={"ID":"04cc7918-897c-4617-8f7d-bb5fa3115c0a","Type":"ContainerStarted","Data":"a02d3c5d0474e68bf4574d99ce7a6332ca47636b81cb2f8425301afcfdd1c537"}
Jul 15 17:05:17.093607 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:17.093141    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb" event={"ID":"04cc7918-897c-4617-8f7d-bb5fa3115c0a","Type":"ContainerStarted","Data":"a8b33898805a54a0584e6e503fc77a55f743e9bf58e18bf38ec57b459277a893"}
Jul 15 17:05:17.093607 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:17.093220    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:17.122331 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:17.122280    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb" podStartSLOduration=1.12226522 podStartE2EDuration="1.12226522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 17:05:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:05:17.11924292 +0000 UTC m=+2964.657068575" watchObservedRunningTime="2026-07-15 17:05:17.12226522 +0000 UTC m=+2964.660090914"
Jul 15 17:05:18.055753 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:18.055721    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-lfhhc_4c0749fd-050f-4f8e-825d-4b87cadc2d15/volume-data-source-validator/0.log"
Jul 15 17:05:19.136312 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:19.136285    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mn7f2_ede18ab8-3e09-4aa9-ba0a-67fee4797267/dns/0.log"
Jul 15 17:05:19.159867 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:19.159847    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mn7f2_ede18ab8-3e09-4aa9-ba0a-67fee4797267/kube-rbac-proxy/0.log"
Jul 15 17:05:19.240505 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:19.240482    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-746j8_725f8d4f-c7db-452b-a0b8-bb292c501156/dns-node-resolver/0.log"
Jul 15 17:05:19.956470 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:19.956443    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f9v7g_f99fdc7b-743b-4fae-b826-c2bd4c75aadc/node-ca/0.log"
Jul 15 17:05:21.197870 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:21.197834    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-sh5pv_c067a8e3-b716-429b-bb35-796f8ef55d08/istio-proxy/0.log"
Jul 15 17:05:21.227909 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:21.227883    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-sh5pv_c067a8e3-b716-429b-bb35-796f8ef55d08/istio-proxy/1.log"
Jul 15 17:05:21.260557 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:21.260532    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-42ffq_5441e553-15ff-49c6-972e-ff3b423b44ed/payload-pre-processing/0.log"
Jul 15 17:05:21.290871 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:21.290840    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-m5plh_ce90b6a1-2e7e-4495-ab83-0bfa357aa683/payload-processing/0.log"
Jul 15 17:05:21.315462 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:21.315437    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fd46db8-vfcwl_0043fb1f-b142-46de-9dee-9e7f1c5dc853/router/0.log"
Jul 15 17:05:22.013213 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:22.013183    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b2p8p_1817aeb5-1f49-4a69-ba0d-75ca3f98fc07/serve-healthcheck-canary/0.log"
Jul 15 17:05:22.508826 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:22.508799    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-7cwq7_15477e9c-792a-45bf-98c1-ff1bc1378da7/insights-operator/0.log"
Jul 15 17:05:22.509371 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:22.509325    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-7cwq7_15477e9c-792a-45bf-98c1-ff1bc1378da7/insights-operator/1.log"
Jul 15 17:05:22.598867 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:22.598839    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m59sx_fabfebcc-b85e-4f6e-a103-a27175aa1fd2/kube-rbac-proxy/0.log"
Jul 15 17:05:22.620000 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:22.619972    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m59sx_fabfebcc-b85e-4f6e-a103-a27175aa1fd2/exporter/0.log"
Jul 15 17:05:22.642151 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:22.642132    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m59sx_fabfebcc-b85e-4f6e-a103-a27175aa1fd2/extractor/0.log"
Jul 15 17:05:23.108048 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:23.108016    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4vtsf/perf-node-gather-daemonset-79kxb"
Jul 15 17:05:24.967547 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:24.967516    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dv5mc_ad418358-b34a-4f07-aa3d-76eeebdf1e0e/manager/0.log"
Jul 15 17:05:25.105410 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:25.105366    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-59ng9_2b96215f-59cb-4980-a61d-c082e3d457dc/manager/0.log"
Jul 15 17:05:25.209602 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:25.209580    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6cff9854fb-v77nm_1aefef03-b9c8-4c11-9388-a8e0c7f427da/manager/0.log"
Jul 15 17:05:25.452493 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:25.452466    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-599cdff4cb-qv2vn_53e5d08e-a974-475d-99c3-92e5a59e9197/manager/0.log"
Jul 15 17:05:25.469603 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:25.469542    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-599cdff4cb-qv2vn_53e5d08e-a974-475d-99c3-92e5a59e9197/copy-manifests/0.log"
Jul 15 17:05:26.456010 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:26.455977    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-sh5pv_c067a8e3-b716-429b-bb35-796f8ef55d08/istio-proxy/0.log"
Jul 15 17:05:26.486824 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:26.486796    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-sh5pv_c067a8e3-b716-429b-bb35-796f8ef55d08/istio-proxy/1.log"
Jul 15 17:05:26.505929 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:26.505904    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-42ffq_5441e553-15ff-49c6-972e-ff3b423b44ed/payload-pre-processing/0.log"
Jul 15 17:05:26.532380 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:26.532360    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-m5plh_ce90b6a1-2e7e-4495-ab83-0bfa357aa683/payload-processing/0.log"
Jul 15 17:05:26.547490 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:26.547472    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fd46db8-vfcwl_0043fb1f-b142-46de-9dee-9e7f1c5dc853/router/0.log"
Jul 15 17:05:26.784119 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:26.784047    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5f875d5cd5-qbqll_480ea93e-822f-4796-bdde-fd5bd11d86be/manager/0.log"
Jul 15 17:05:28.013091 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:28.013062    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-sh5pv_c067a8e3-b716-429b-bb35-796f8ef55d08/istio-proxy/0.log"
Jul 15 17:05:28.039895 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:28.039864    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-sh5pv_c067a8e3-b716-429b-bb35-796f8ef55d08/istio-proxy/1.log"
Jul 15 17:05:28.064289 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:28.064261    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-42ffq_5441e553-15ff-49c6-972e-ff3b423b44ed/payload-pre-processing/0.log"
Jul 15 17:05:28.086454 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:28.086427    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-m5plh_ce90b6a1-2e7e-4495-ab83-0bfa357aa683/payload-processing/0.log"
Jul 15 17:05:28.109024 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:28.109003    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fd46db8-vfcwl_0043fb1f-b142-46de-9dee-9e7f1c5dc853/router/0.log"
Jul 15 17:05:31.850713 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:31.850686    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-8822c_a6caa983-90b5-4dbc-aead-3ccdae0b2c91/migrator/0.log"
Jul 15 17:05:31.875723 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:31.875695    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-8822c_a6caa983-90b5-4dbc-aead-3ccdae0b2c91/graceful-termination/0.log"
Jul 15 17:05:32.220636 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:32.220605    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-8g4mf_58b7a5fa-4cb2-4ff8-a94f-07abb5198153/kube-storage-version-migrator-operator/1.log"
Jul 15 17:05:32.221501 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:32.221482    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-8g4mf_58b7a5fa-4cb2-4ff8-a94f-07abb5198153/kube-storage-version-migrator-operator/0.log"
Jul 15 17:05:33.432915 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:33.432884    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tp94d_a0d9fd90-7de4-4f7e-bffc-f17eed184e8c/kube-multus-additional-cni-plugins/0.log"
Jul 15 17:05:33.455916 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:33.455891    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tp94d_a0d9fd90-7de4-4f7e-bffc-f17eed184e8c/egress-router-binary-copy/0.log"
Jul 15 17:05:33.490169 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:33.490143    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tp94d_a0d9fd90-7de4-4f7e-bffc-f17eed184e8c/cni-plugins/0.log"
Jul 15 17:05:33.517142 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:33.517117    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tp94d_a0d9fd90-7de4-4f7e-bffc-f17eed184e8c/bond-cni-plugin/0.log"
Jul 15 17:05:33.546962 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:33.546942    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tp94d_a0d9fd90-7de4-4f7e-bffc-f17eed184e8c/routeoverride-cni/0.log"
Jul 15 17:05:33.574683 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:33.574657    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tp94d_a0d9fd90-7de4-4f7e-bffc-f17eed184e8c/whereabouts-cni-bincopy/0.log"
Jul 15 17:05:33.598967 ip-10-0-141-253 kubenswrapper[2582]: I0715 17:05:33.598947    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tp94d_a0d9fd90-7de4-4f7e-bffc-f17eed184e8c/whereabouts-cni/0.log"