Jul 27 20:34:20.233529 ip-10-0-143-205 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 20:34:20.671020 ip-10-0-143-205 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:34:20.671020 ip-10-0-143-205 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 20:34:20.671020 ip-10-0-143-205 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:34:20.671020 ip-10-0-143-205 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 20:34:20.671020 ip-10-0-143-205 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:34:20.673958 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.673871    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 20:34:20.679815 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679795    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:34:20.679815 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679811    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:34:20.679815 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679816    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:34:20.679815 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679820    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679824    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679829    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679833    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679837    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679843    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679847    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679852    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679856    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679860    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679864    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679867    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679871    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679876    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679880    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679884    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679896    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679901    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679905    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679909    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:34:20.680057 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679913    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679919    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679926    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679932    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679936    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679942    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679946    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679951    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679955    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679959    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679965    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679969    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679976    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679983    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679988    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679993    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.679998    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680003    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680008    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:34:20.680894 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680012    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680017    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680022    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680028    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680033    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680038    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680043    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680048    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680052    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680056    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680062    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680069    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680074    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680079    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680084    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680088    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680092    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680097    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680101    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:34:20.681679 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680106    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680110    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680115    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680119    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680122    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680127    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680131    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680135    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680140    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680144    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680148    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680153    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680157    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680164    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680169    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680173    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680177    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680183    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680187    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680191    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:34:20.682514 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680195    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680200    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680204    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680208    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680214    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680218    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680223    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680227    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680232    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680236    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680240    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680245    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680249    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680253    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680257    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680262    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680266    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.680288    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681454    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681464    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:34:20.683378 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681469    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681474    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681478    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681484    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681488    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681492    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681497    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681501    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681505    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681509    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681514    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681518    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681522    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681527    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681531    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681535    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681540    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681544    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681548    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:34:20.684245 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681552    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681556    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681560    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681564    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681569    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681573    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681577    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681582    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681586    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681590    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681595    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681599    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681604    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681608    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681612    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681618    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681622    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681626    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681630    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681634    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:34:20.684935 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681637    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681641    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681646    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681650    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681654    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681660    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681664    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681668    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681672    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681676    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681683    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681689    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681694    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681700    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681705    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681711    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681718    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681723    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681728    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:34:20.685508 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681732    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681736    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681740    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681744    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681748    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681753    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681758    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681763    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681768    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681776    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681781    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681785    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681789    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681794    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681798    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681804    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681808    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681812    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681816    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681820    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:34:20.685967 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681825    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681829    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681833    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681837    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681841    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681845    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681849    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681853    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681857    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681861    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681866    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681870    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681874    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681878    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681883    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681887    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681891    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681895    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.681899    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682482    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:34:20.686674 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682491    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682497    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682501    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682509    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682514    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682519    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682523    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682528    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682532    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682536    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682541    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682545    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682550    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682554    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682558    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682563    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682567    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682571    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682576    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:34:20.687169 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682580    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682584    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682588    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682596    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682600    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682604    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682608    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682613    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682617    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682621    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682625    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682629    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682633    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682637    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682641    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682646    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682651    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682655    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682659    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682663    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:34:20.687678 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682667    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682671    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682678    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682685    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682689    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682693    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682697    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682702    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682705    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682709    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682713    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682718    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682722    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682726    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682730    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682736    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682740    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682744    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682748    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:34:20.688280 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682752    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682756    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682760    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682764    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682768    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682772    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682776    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682780    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682784    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682791    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682795    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682799    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682803    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682807    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682811    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682815    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682819    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682823    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682827    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682833    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:34:20.688783 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682837    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682841    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682844    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682848    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682852    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682856    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682861    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682865    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682871    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682875    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682879    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682885    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682891    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682896    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682900    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682905    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682909    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682914    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682917    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.682921    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:34:20.689246 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683020    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683038    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683048    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683054    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683060    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683065    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683072    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683078    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683083    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683088    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683094    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683099    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683104    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683109    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683113    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683118    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683122    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683127    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683134    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683139    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683145    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683150    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683155    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683161    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 20:34:20.689747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683166    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683171    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683177    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683181    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683186    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683190    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683195    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683200    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683207    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683213    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683217    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683223    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683228    2562 flags.go:64] FLAG: --enable-server="true"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683232    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683239    2562 flags.go:64] FLAG: --event-burst="100"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683244    2562 flags.go:64] FLAG: --event-qps="50"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683249    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683254    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683258    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683264    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683287    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683292    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683297    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683302    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683306    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 20:34:20.690323 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683311    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683316    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683321    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683327    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683332    2562 flags.go:64] FLAG: --feature-gates=""
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683338    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683342    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683347    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683352    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683357    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683362    2562 flags.go:64] FLAG: --help="false"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683367    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-143-205.ec2.internal"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683372    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683376    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683380    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683386    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683393    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683397    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683402    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683407    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683412    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683417    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683422    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683426    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 27 20:34:20.690909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683431    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683436    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683441    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683445    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683450    2562 flags.go:64] FLAG: --lock-file=""
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683454    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683459    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683464    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683473    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683478    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683482    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683487    2562 flags.go:64] FLAG: --logging-format="text"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683491    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683497    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683501    2562 flags.go:64] FLAG: --manifest-url=""
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683506    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683512    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683523    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683529    2562 flags.go:64] FLAG: --max-pods="110"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683533    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683538    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683542    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683547    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683570    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683577    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 20:34:20.691592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683581    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683592    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683597    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683603    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683608    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683613    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683622    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683627    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683632    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683637    2562 flags.go:64] FLAG: --port="10250"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683642    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683647    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00075589b519cd4be"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683652    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683657    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683662    2562 flags.go:64] FLAG: --register-node="true"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683666    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683672    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683677    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683682    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683687    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683693    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683698    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683703    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683708    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683712    2562 flags.go:64] FLAG: --runonce="false"
Jul 27 20:34:20.692238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683717    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683722    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683727    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683732    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683737    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683742    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683748    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683753    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683757    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683762    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683767    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683773    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683778    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683783    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683787    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683796    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683800    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683805    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683812    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683817    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683821    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683826    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683831    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683836    2562 flags.go:64] FLAG: --v="2"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683842    2562 flags.go:64] FLAG: --version="false"
Jul 27 20:34:20.692872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683849    2562 flags.go:64] FLAG: --vmodule=""
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683855    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.683860    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684063    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684070    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684074    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684079    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684083    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684088    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684092    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684096    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684101    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684105    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684112    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684116    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684120    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684124    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684128    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684133    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:34:20.693487 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684138    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684142    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684146    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684150    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684154    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684158    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684162    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684166    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684170    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684174    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684179    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684183    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684187    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684191    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684195    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684199    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684203    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684207    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684211    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684216    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:34:20.693941 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684220    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684224    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684229    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684233    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684237    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684241    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684247    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684251    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684255    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684259    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684265    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684286    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684291    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684297    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684301    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684305    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684310    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684314    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684318    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684322    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:34:20.694440 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684327    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684331    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684337    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684343    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684348    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684353    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684360    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684365    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684369    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684373    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684377    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684382    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684386    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684390    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684394    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684398    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684402    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684406    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684410    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:34:20.694908 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684414    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684418    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684422    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684426    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684429    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684434    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684439    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684444    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684448    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684452    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684456    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684460    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684464    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684468    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684472    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684478    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684483    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684488    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684493    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684501    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:34:20.695382 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684506    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:34:20.695880 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684510    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:34:20.695880 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684514    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:34:20.695880 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.684518    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:34:20.695880 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.685297    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:34:20.695880 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.692681    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 20:34:20.695880 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.692695    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 20:34:20.695880 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.692715    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 20:34:20.695880 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.692720    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 20:34:20.695880 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692786    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:34:20.695880 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692791    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:34:20.695880 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692795    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:34:20.695880 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692798    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:34:20.695880 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692800    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:34:20.695880 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692803    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:34:20.695880 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692806    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692809    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692811    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692814    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692818    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692820    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692823    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692827    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692832    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692834    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692837    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692840    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692843    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692845    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692848    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692851    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692853    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692856    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692858    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692861    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:34:20.696347 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692864    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692867    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692870    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692873    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692876    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692878    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692881    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692885    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692887    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692890    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692892    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692895    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692897    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692900    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692903    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692905    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692908    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692911    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692913    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692916    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:34:20.697099 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692919    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692921    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692924    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692926    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692929    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692931    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692933    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692936    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692938    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692941    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692943    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692946    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692950    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692953    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692956    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692959    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692962    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692965    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692967    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692970    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:34:20.697620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692972    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692975    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692978    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692980    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692983    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692986    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692988    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692991    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692993    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692996    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.692999    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693001    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693004    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693006    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693010    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693013    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693016    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693019    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693021    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:34:20.698166 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693024    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:34:20.698641 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693027    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:34:20.698641 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693029    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:34:20.698641 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693032    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:34:20.698641 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693035    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:34:20.698641 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693037    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:34:20.698641 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693040    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:34:20.698641 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693043    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:34:20.698641 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693046    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:34:20.698641 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693048    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:34:20.698641 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693051    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:34:20.698641 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693053    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:34:20.698641 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693056    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:34:20.698641 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693058    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:34:20.698641 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.693063    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:34:20.698641 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693168    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693172    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693176    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693180    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693182    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693185    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693188    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693191    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693193    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693196    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693199    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693201    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693204    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693206    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693209    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693211    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693214    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693216    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693219    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693222    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:34:20.699092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693224    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693227    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693230    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693232    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693235    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693237    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693240    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693243    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693245    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693248    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693250    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693253    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693256    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693258    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693260    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693263    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693265    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693287    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693292    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693295    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:34:20.699620 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693298    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693301    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693304    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693307    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693310    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693312    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693315    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693318    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693320    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693323    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693325    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693328    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693330    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693333    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693335    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693338    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693341    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693343    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693346    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693348    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:34:20.700139 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693351    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:34:20.700645 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693353    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:34:20.700645 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693356    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:34:20.700645 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693358    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:34:20.700645 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693361    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:34:20.700645 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693363    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:34:20.700645 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693366    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:34:20.700645 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693369    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:34:20.700645 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693372    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:34:20.700645 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693376    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:34:20.700645 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693379    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:34:20.700645 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693382    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:34:20.700645 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693384    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:34:20.700645 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693387    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:34:20.700645 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693390    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:34:20.700645 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693393    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:34:20.700645 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693395    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:34:20.700645 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693398    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:34:20.700645 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693400    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693403    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693405    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693408    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693413    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693416    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693419    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693421    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693423    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693426    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693429    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693432    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693434    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693437    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693440    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693442    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693445    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693448    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693450    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693453    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:34:20.701092 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:20.693455    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:34:20.701932 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.693460    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:34:20.701932 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.693558    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 20:34:20.701932 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.695912    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 20:34:20.701932 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.698943    2562 server.go:1019] "Starting client certificate rotation"
Jul 27 20:34:20.701932 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.699054    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 20:34:20.701932 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.699086    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 20:34:20.702183 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.701998    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 20:34:20.705120 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.705100    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 20:34:20.714184 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.714170    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 27 20:34:20.716448 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.716435    2562 log.go:25] "Validated CRI v1 image API"
Jul 27 20:34:20.717176 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.717153    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 20:34:20.719764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.719744    2562 fs.go:135] Filesystem UUIDs: map[5bd00525-f973-4e2c-82d5-e7955097ed66:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b6a6c886-d710-40b2-9f91-ee527c68e7be:/dev/nvme0n1p4]
Jul 27 20:34:20.719847 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.719763    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 20:34:20.725864 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.725761    2562 manager.go:216] Machine: {Timestamp:2026-07-27 20:34:20.72437813 +0000 UTC m=+0.364594560 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3196474 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec276d17f61439cd33432a8699c4733f SystemUUID:ec276d17-f614-39cd-3343-2a8699c4733f BootID:311d681d-d6fe-4957-a701-fb09c600553d Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:21:f5:7f:9b:ff Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:21:f5:7f:9b:ff Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:48:ee:fe:41:a8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 20:34:20.725864 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.725852    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 20:34:20.726001 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.725940    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 20:34:20.726783 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.726767    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 20:34:20.729601 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.729578    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 20:34:20.729765 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.729604    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-205.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 20:34:20.730555 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.730546    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 20:34:20.730593 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.730558    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 20:34:20.730593 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.730566    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 20:34:20.731431 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.731421    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 20:34:20.732692 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.732682    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 20:34:20.735543 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.735532    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 20:34:20.735685 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.735675    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 20:34:20.735715 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.735707    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 20:34:20.735748 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.735718    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 20:34:20.735748 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.735735    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 20:34:20.735800 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.735749    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 27 20:34:20.735800 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.735759    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 20:34:20.738717 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.738684    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 20:34:20.738717 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.738712    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 20:34:20.741991 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.741969    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 20:34:20.744390 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.744376    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 20:34:20.744449 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.744406    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 20:34:20.746462 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.746449    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 20:34:20.746462 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.746464    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 20:34:20.746560 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.746470    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 20:34:20.746560 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.746475    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 20:34:20.746560 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.746483    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 20:34:20.746560 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.746488    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 20:34:20.746560 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.746495    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 20:34:20.746560 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.746500    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 20:34:20.746560 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.746506    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 20:34:20.746560 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.746511    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 20:34:20.746560 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.746519    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 20:34:20.746560 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.746524    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 20:34:20.748143 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.748130    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 20:34:20.748143 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.748143    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 20:34:20.748918 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:20.748894    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 20:34:20.748918 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:20.748909    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 20:34:20.751110 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.751097    2562 server.go:1268] "Started kubelet"
Jul 27 20:34:20.751221 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.751176    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 20:34:20.751259 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.751242    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 20:34:20.751339 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.751180    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 20:34:20.752018 ip-10-0-143-205 systemd[1]: Started Kubernetes Kubelet.
Jul 27 20:34:20.753284 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.753253    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 20:34:20.754000 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.753982    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 20:34:20.756554 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:20.756535    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 20:34:20.758225 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.758211    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-205.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 20:34:20.759367 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:20.758207    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-205.ec2.internal.18c63fcf099d5c18  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-205.ec2.internal,UID:ip-10-0-143-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-205.ec2.internal,},FirstTimestamp:2026-07-27 20:34:20.751068184 +0000 UTC m=+0.391284669,LastTimestamp:2026-07-27 20:34:20.751068184 +0000 UTC m=+0.391284669,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-205.ec2.internal,}"
Jul 27 20:34:20.766346 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.766326    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 20:34:20.766346 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.766340    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 20:34:20.766758 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:20.766500    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 27 20:34:20.767021 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.767008    2562 factory.go:55] Registering systemd factory
Jul 27 20:34:20.767021 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.767022    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 27 20:34:20.767151 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.767135    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 20:34:20.767197 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.767185    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 20:34:20.767246 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.767200    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 20:34:20.767246 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.767239    2562 factory.go:153] Registering CRI-O factory
Jul 27 20:34:20.767356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.767253    2562 factory.go:223] Registration of the crio container factory successfully
Jul 27 20:34:20.767356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.767285    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 20:34:20.767356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.767293    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 20:34:20.767356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.767311    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 20:34:20.767356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.767335    2562 factory.go:103] Registering Raw factory
Jul 27 20:34:20.767356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.767348    2562 manager.go:1196] Started watching for new ooms in manager
Jul 27 20:34:20.767721 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.767707    2562 manager.go:349] Starting recovery of all containers
Jul 27 20:34:20.768067 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:20.768043    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 20:34:20.768235 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:20.768214    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 20:34:20.774724 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.774700    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6m5d5"
Jul 27 20:34:20.779966 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.779942    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6m5d5"
Jul 27 20:34:20.781213 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.781199    2562 manager.go:354] Recovery completed
Jul 27 20:34:20.785371 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.785357    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:34:20.787425 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.787409    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:34:20.787499 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.787440    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:34:20.787499 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.787456    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:34:20.787986 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.787971    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 20:34:20.787986 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.787978    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:34:20.787986 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.787985    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 20:34:20.788117 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.788003    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 20:34:20.789814 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.789799    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:34:20.789880 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.789823    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:34:20.789880 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.789833    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:34:20.790710 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.790697    2562 policy_none.go:49] "None policy: Start"
Jul 27 20:34:20.790710 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.790712    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 20:34:20.790816 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.790722    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 20:34:20.792630 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.792619    2562 policy_none.go:47] "Start"
Jul 27 20:34:20.861887 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.861861    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 20:34:20.864067 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.862985    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 20:34:20.864067 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.863022    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 20:34:20.864067 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.863043    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 20:34:20.864067 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:20.863079    2562 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 27 20:34:20.865352 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.865330    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:34:20.866576 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:20.866561    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 27 20:34:20.963848 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:20.963712    2562 kubelet.go:2472] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Jul 27 20:34:20.964853 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.964842    2562 manager.go:337] "Starting Device Plugin manager"
Jul 27 20:34:20.964926 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:20.964913    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 20:34:20.964963 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.964929    2562 server.go:87] "Starting device plugin registration server"
Jul 27 20:34:20.965161 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.965150    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 20:34:20.965205 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.965162    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 20:34:20.965340 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.965283    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 20:34:20.965432 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.965365    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 20:34:20.965432 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:20.965375    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 20:34:20.965919 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:20.965901    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 20:34:20.965983 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:20.965956    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 27 20:34:20.972885 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:20.972870    2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-205.ec2.internal\" not found" node="ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.066068 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.066027    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:34:21.067043 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.067023    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:34:21.067171 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.067054    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:34:21.067171 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.067064    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:34:21.067171 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.067094    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.077141 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.077122    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.077198 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.077143    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-205.ec2.internal\": node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 27 20:34:21.109122 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.109098    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 27 20:34:21.164879 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.164285    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"]
Jul 27 20:34:21.164933 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.164917    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:34:21.165872 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.165858    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:34:21.165936 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.165885    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:34:21.165936 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.165895    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:34:21.168267 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.168254    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:34:21.168384 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.168368    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.168431 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.168398    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:34:21.169136 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.169117    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:34:21.169222 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.169150    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:34:21.169222 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.169161    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:34:21.169222 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.169117    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:34:21.169339 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.169225    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:34:21.169339 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.169237    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:34:21.169438 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.169422    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1fa6b6eadd7d4ba3cc0e93e22fbf7fde-config\") pod \"kube-apiserver-proxy-ip-10-0-143-205.ec2.internal\" (UID: \"1fa6b6eadd7d4ba3cc0e93e22fbf7fde\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.171495 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.171479    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.171617 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.171501    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:34:21.172237 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.172222    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:34:21.172319 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.172250    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:34:21.172319 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.172260    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:34:21.192900 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.192846    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-205.ec2.internal\" not found" node="ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.197162 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.197146    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-205.ec2.internal\" not found" node="ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.209324 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.209308    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 27 20:34:21.269904 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.269870    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1af48ac1f6ebdc0ed481956d7c3d1e96-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal\" (UID: \"1af48ac1f6ebdc0ed481956d7c3d1e96\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.269904 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.269908    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1af48ac1f6ebdc0ed481956d7c3d1e96-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal\" (UID: \"1af48ac1f6ebdc0ed481956d7c3d1e96\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.270043 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.269937    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1fa6b6eadd7d4ba3cc0e93e22fbf7fde-config\") pod \"kube-apiserver-proxy-ip-10-0-143-205.ec2.internal\" (UID: \"1fa6b6eadd7d4ba3cc0e93e22fbf7fde\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.270043 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.269974    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1fa6b6eadd7d4ba3cc0e93e22fbf7fde-config\") pod \"kube-apiserver-proxy-ip-10-0-143-205.ec2.internal\" (UID: \"1fa6b6eadd7d4ba3cc0e93e22fbf7fde\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.310051 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.310007    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 27 20:34:21.370433 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.370400    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1af48ac1f6ebdc0ed481956d7c3d1e96-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal\" (UID: \"1af48ac1f6ebdc0ed481956d7c3d1e96\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.370512 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.370443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1af48ac1f6ebdc0ed481956d7c3d1e96-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal\" (UID: \"1af48ac1f6ebdc0ed481956d7c3d1e96\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.370512 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.370495    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1af48ac1f6ebdc0ed481956d7c3d1e96-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal\" (UID: \"1af48ac1f6ebdc0ed481956d7c3d1e96\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.370512 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.370497    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1af48ac1f6ebdc0ed481956d7c3d1e96-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal\" (UID: \"1af48ac1f6ebdc0ed481956d7c3d1e96\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.410548 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.410521    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 27 20:34:21.495022 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.494988    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.500252 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.499915    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.511268 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.511249    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 27 20:34:21.612050 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.612020    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 27 20:34:21.697982 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.697944    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 20:34:21.698447 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.698100    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 20:34:21.712813 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.712763    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 27 20:34:21.714251 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.714236    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:34:21.735264 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.735236    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:34:21.736230 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.736217    2562 apiserver.go:52] "Watching apiserver"
Jul 27 20:34:21.743716 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.743694    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 20:34:21.744081 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.744059    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-wgfxv","openshift-network-diagnostics/network-check-target-2hxvx","openshift-network-operator/iptables-alerter-pc76c","openshift-ovn-kubernetes/ovnkube-node-fphdr","kube-system/global-pull-secret-syncer-4z4nt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh","openshift-dns/node-resolver-r5m9z","openshift-multus/multus-additional-cni-plugins-kmgkx","openshift-multus/multus-p8r2d","openshift-multus/network-metrics-daemon-s8rhb","kube-system/konnectivity-agent-w7ctn","openshift-cluster-node-tuning-operator/tuned-8c66g"]
Jul 27 20:34:21.746634 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.746619    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wgfxv"
Jul 27 20:34:21.748775 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.748748    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:21.748859 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.748837    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hxvx" podUID="97208f7a-c966-4a7f-abee-d5732ca900c9"
Jul 27 20:34:21.749211 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.749193    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mx4h5\""
Jul 27 20:34:21.749312 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.749233    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 20:34:21.749563 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.749540    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 20:34:21.749709 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.749695    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 20:34:21.750935 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.750920    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pc76c"
Jul 27 20:34:21.753205 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.753188    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.754544 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.754522    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 20:34:21.754823 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.754583    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 20:34:21.755079 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.754586    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:34:21.756410 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.756367    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8jmkm\""
Jul 27 20:34:21.756508 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.756411    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 20:34:21.756508 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.756438    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 20:34:21.756508 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.756461    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 20:34:21.756899 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.756875    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 20:34:21.756995 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.756931    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:21.757055 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.757004    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4z4nt" podUID="d1006199-a395-4fef-b9a5-7abe2931fd07"
Jul 27 20:34:21.757116 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.757079    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 20:34:21.757116 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.757106    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b8bx6\""
Jul 27 20:34:21.757204 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.757125    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 20:34:21.760312 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.760286    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.762535 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.762518    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r5m9z"
Jul 27 20:34:21.762790 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.762775    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 20:34:21.762962 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.762942    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 20:34:21.763134 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.763117    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 20:34:21.763186 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.763127    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tnlvr\""
Jul 27 20:34:21.764694 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.764679    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 20:34:21.764909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.764894    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.765492 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.765466    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 20:34:21.765584 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.765571    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5pq2v\""
Jul 27 20:34:21.766434 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.766422    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 20:34:21.766487 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.766436    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.767236 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.767217    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.767398 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.767381    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 20:34:21.767723 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.767709    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 20:34:21.767961 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.767945    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sjvtx\""
Jul 27 20:34:21.768077 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.768065    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 20:34:21.769613 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.769599    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:21.769678 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.769661    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8rhb" podUID="28e5f501-0964-4435-b714-b53d1985c224"
Jul 27 20:34:21.770525 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.770511    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 20:34:21.771016 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.770999    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 20:34:21.771370 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.771357    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z2vk7\""
Jul 27 20:34:21.771584 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.771571    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 20:34:21.771889 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.771876    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w7ctn"
Jul 27 20:34:21.773390 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773372    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-multus-conf-dir\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.773472 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773397    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj4j2\" (UniqueName: \"kubernetes.io/projected/393fab17-1c8c-4507-93b6-33ebcbb23287-kube-api-access-tj4j2\") pod \"iptables-alerter-pc76c\" (UID: \"393fab17-1c8c-4507-93b6-33ebcbb23287\") " pod="openshift-network-operator/iptables-alerter-pc76c"
Jul 27 20:34:21.773472 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773414    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1006199-a395-4fef-b9a5-7abe2931fd07-dbus\") pod \"global-pull-secret-syncer-4z4nt\" (UID: \"d1006199-a395-4fef-b9a5-7abe2931fd07\") " pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:21.773472 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a126a0f5-431f-479f-ace8-cd614a94d066-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.773472 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-multus-socket-dir-parent\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.773472 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773472    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48-serviceca\") pod \"node-ca-wgfxv\" (UID: \"a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48\") " pod="openshift-image-registry/node-ca-wgfxv"
Jul 27 20:34:21.773686 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773486    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/393fab17-1c8c-4507-93b6-33ebcbb23287-host-slash\") pod \"iptables-alerter-pc76c\" (UID: \"393fab17-1c8c-4507-93b6-33ebcbb23287\") " pod="openshift-network-operator/iptables-alerter-pc76c"
Jul 27 20:34:21.773686 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773503    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-log-socket\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.773686 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773526    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a126a0f5-431f-479f-ace8-cd614a94d066-registration-dir\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.773686 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.773686 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773566    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-os-release\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.773686 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773587    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-host-run-k8s-cni-cncf-io\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.773686 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-host-var-lib-kubelet\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.773686 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c978n\" (UniqueName: \"kubernetes.io/projected/a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48-kube-api-access-c978n\") pod \"node-ca-wgfxv\" (UID: \"a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48\") " pod="openshift-image-registry/node-ca-wgfxv"
Jul 27 20:34:21.774016 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773700    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-env-overrides\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.774016 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773727    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgkrc\" (UniqueName: \"kubernetes.io/projected/28e5f501-0964-4435-b714-b53d1985c224-kube-api-access-mgkrc\") pod \"network-metrics-daemon-s8rhb\" (UID: \"28e5f501-0964-4435-b714-b53d1985c224\") " pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:21.774016 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773752    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/393fab17-1c8c-4507-93b6-33ebcbb23287-iptables-alerter-script\") pod \"iptables-alerter-pc76c\" (UID: \"393fab17-1c8c-4507-93b6-33ebcbb23287\") " pod="openshift-network-operator/iptables-alerter-pc76c"
Jul 27 20:34:21.774016 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773778    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-kubelet\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.774016 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773802    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-etc-openvswitch\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.774016 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773827    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-cni-bin\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.774016 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773852    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjnwc\" (UniqueName: \"kubernetes.io/projected/a126a0f5-431f-479f-ace8-cd614a94d066-kube-api-access-kjnwc\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.774016 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773909    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0832c487-7942-4557-8843-dc9246c59720-multus-daemon-config\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.774016 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773933    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-host-run-multus-certs\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.774016 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.773992    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-slash\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.774016 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.774506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774022    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48-host\") pod \"node-ca-wgfxv\" (UID: \"a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48\") " pod="openshift-image-registry/node-ca-wgfxv"
Jul 27 20:34:21.774506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774037    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-run-netns\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.774506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774052    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-ovn-node-metrics-cert\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.774506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774080    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36724fee-b20c-435b-a906-e9c098932706-tmp-dir\") pod \"node-resolver-r5m9z\" (UID: \"36724fee-b20c-435b-a906-e9c098932706\") " pod="openshift-dns/node-resolver-r5m9z"
Jul 27 20:34:21.774506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774085    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k5jnc\""
Jul 27 20:34:21.774506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774131    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-multus-cni-dir\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.774506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774158    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-run-ovn\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.774506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-cni-netd\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.774506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774208    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a126a0f5-431f-479f-ace8-cd614a94d066-sys-fs\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.774506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-ovnkube-script-lib\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.774506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774311    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-system-cni-dir\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.774506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.774506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-run-ovn-kubernetes\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.774506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774395    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.774506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774404    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97qrd\" (UniqueName: \"kubernetes.io/projected/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-kube-api-access-97qrd\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.774506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774415    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 20:34:21.774506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774427    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-cni-binary-copy\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.774506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774449    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-cnibin\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.775111 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774484    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-os-release\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.775111 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774520    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-var-lib-openvswitch\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.775111 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774542    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 20:34:21.775111 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774544    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a126a0f5-431f-479f-ace8-cd614a94d066-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.775111 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774568    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0832c487-7942-4557-8843-dc9246c59720-cni-binary-copy\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.775111 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774619    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1006199-a395-4fef-b9a5-7abe2931fd07-kubelet-config\") pod \"global-pull-secret-syncer-4z4nt\" (UID: \"d1006199-a395-4fef-b9a5-7abe2931fd07\") " pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:21.775111 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774640    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-cnibin\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.775111 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774667    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs\") pod \"network-metrics-daemon-s8rhb\" (UID: \"28e5f501-0964-4435-b714-b53d1985c224\") " pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:21.775111 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774689    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-system-cni-dir\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.775111 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774715    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-host-var-lib-cni-multus\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.775111 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774735    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-etc-kubernetes\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.775111 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774758    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-run-openvswitch\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.775111 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774776    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-ovnkube-config\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.775111 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.774792    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret\") pod \"global-pull-secret-syncer-4z4nt\" (UID: \"d1006199-a395-4fef-b9a5-7abe2931fd07\") " pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:21.775606 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.775198    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a126a0f5-431f-479f-ace8-cd614a94d066-socket-dir\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.775606 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.775229    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-host-run-netns\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.775606 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.775252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-hostroot\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.775606 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.775269    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a126a0f5-431f-479f-ace8-cd614a94d066-device-dir\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.775606 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.775301    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-host-var-lib-cni-bin\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.775606 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.775321    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4lzt\" (UniqueName: \"kubernetes.io/projected/0832c487-7942-4557-8843-dc9246c59720-kube-api-access-t4lzt\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.775606 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.775343    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8tdl\" (UniqueName: \"kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl\") pod \"network-check-target-2hxvx\" (UID: \"97208f7a-c966-4a7f-abee-d5732ca900c9\") " pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:21.775606 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.775361    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-run-systemd\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.775606 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.775374    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-node-log\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.775606 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.775389    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cxwt\" (UniqueName: \"kubernetes.io/projected/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-kube-api-access-9cxwt\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.775606 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.775404    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/36724fee-b20c-435b-a906-e9c098932706-hosts-file\") pod \"node-resolver-r5m9z\" (UID: \"36724fee-b20c-435b-a906-e9c098932706\") " pod="openshift-dns/node-resolver-r5m9z"
Jul 27 20:34:21.775606 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.775428    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-systemd-units\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.775606 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.775448    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.775606 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.775489    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j5sb\" (UniqueName: \"kubernetes.io/projected/36724fee-b20c-435b-a906-e9c098932706-kube-api-access-7j5sb\") pod \"node-resolver-r5m9z\" (UID: \"36724fee-b20c-435b-a906-e9c098932706\") " pod="openshift-dns/node-resolver-r5m9z"
Jul 27 20:34:21.776631 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.776609    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 20:34:21.776904 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.776876    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-465t8\""
Jul 27 20:34:21.777000 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.776921    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:34:21.781776 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.781761    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"]
Jul 27 20:34:21.782250 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.782235    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 20:34:21.782346 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.782305    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 27 20:34:21.785170 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.785155    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 20:34:21.786887 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.786827    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 20:29:20 +0000 UTC" deadline="2028-05-07 13:47:43.971901732 +0000 UTC"
Jul 27 20:34:21.786887 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.786882    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15593h13m22.185022579s"
Jul 27 20:34:21.795358 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.795345    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 20:34:21.795538 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.795524    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"]
Jul 27 20:34:21.816301 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.816265    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kvqxz"
Jul 27 20:34:21.823124 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.823105    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kvqxz"
Jul 27 20:34:21.868192 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.868176    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 20:34:21.875951 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.875930    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-sys\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.876018 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.875965    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0832c487-7942-4557-8843-dc9246c59720-multus-daemon-config\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.876018 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.875985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-host-run-multus-certs\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.876018 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.875999    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-slash\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.876018 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876015    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.876213 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876033    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-tmp\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.876213 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876048    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-slash\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.876213 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876084    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48-host\") pod \"node-ca-wgfxv\" (UID: \"a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48\") " pod="openshift-image-registry/node-ca-wgfxv"
Jul 27 20:34:21.876213 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876053    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48-host\") pod \"node-ca-wgfxv\" (UID: \"a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48\") " pod="openshift-image-registry/node-ca-wgfxv"
Jul 27 20:34:21.876213 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876117    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-run-netns\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.876213 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876122    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-host-run-multus-certs\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.876213 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876140    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-ovn-node-metrics-cert\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.876213 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876166    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36724fee-b20c-435b-a906-e9c098932706-tmp-dir\") pod \"node-resolver-r5m9z\" (UID: \"36724fee-b20c-435b-a906-e9c098932706\") " pod="openshift-dns/node-resolver-r5m9z"
Jul 27 20:34:21.876213 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876184    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-multus-cni-dir\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.876213 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876211    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-run-ovn\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.876703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876244    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-cni-netd\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.876703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876284    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a126a0f5-431f-479f-ace8-cd614a94d066-sys-fs\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.876703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876311    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-ovnkube-script-lib\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.876703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876322    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-run-netns\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.876703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-system-cni-dir\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.876703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876362    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.876703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876389    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-multus-cni-dir\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.876703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876427    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-run-ovn\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.876703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876395    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471-agent-certs\") pod \"konnectivity-agent-w7ctn\" (UID: \"6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471\") " pod="kube-system/konnectivity-agent-w7ctn"
Jul 27 20:34:21.876703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876479    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 20:34:21.876703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-run-ovn-kubernetes\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.876703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876489    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36724fee-b20c-435b-a906-e9c098932706-tmp-dir\") pod \"node-resolver-r5m9z\" (UID: \"36724fee-b20c-435b-a906-e9c098932706\") " pod="openshift-dns/node-resolver-r5m9z"
Jul 27 20:34:21.876703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876512    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97qrd\" (UniqueName: \"kubernetes.io/projected/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-kube-api-access-97qrd\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.876703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-cni-binary-copy\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.876703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876581    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-var-lib-kubelet\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.876703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876605    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-cnibin\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.876703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876627    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-os-release\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.877509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876637    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.877509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876652    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-var-lib-openvswitch\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.877509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876656    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0832c487-7942-4557-8843-dc9246c59720-multus-daemon-config\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.877509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876678    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a126a0f5-431f-479f-ace8-cd614a94d066-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.877509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876453    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a126a0f5-431f-479f-ace8-cd614a94d066-sys-fs\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.877509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876716    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0832c487-7942-4557-8843-dc9246c59720-cni-binary-copy\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.877509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876724    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a126a0f5-431f-479f-ace8-cd614a94d066-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.877509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876729    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-run-ovn-kubernetes\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.877509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876490    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-system-cni-dir\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.877509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876745    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1006199-a395-4fef-b9a5-7abe2931fd07-kubelet-config\") pod \"global-pull-secret-syncer-4z4nt\" (UID: \"d1006199-a395-4fef-b9a5-7abe2931fd07\") " pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:21.877509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876773    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-cnibin\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.877509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876830    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-cnibin\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.877509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876833    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-cnibin\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.877509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876872    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs\") pod \"network-metrics-daemon-s8rhb\" (UID: \"28e5f501-0964-4435-b714-b53d1985c224\") " pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:21.877509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876889    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1006199-a395-4fef-b9a5-7abe2931fd07-kubelet-config\") pod \"global-pull-secret-syncer-4z4nt\" (UID: \"d1006199-a395-4fef-b9a5-7abe2931fd07\") " pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:21.877509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876903    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-lib-modules\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.877509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876936    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-system-cni-dir\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.878218 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876964    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-host-var-lib-cni-multus\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.878218 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876983    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-ovnkube-script-lib\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.878218 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876991    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-etc-kubernetes\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.878218 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.877015    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:34:21.878218 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877073    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-etc-kubernetes\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.878218 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877032    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-run-openvswitch\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.878218 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877086    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-run-openvswitch\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.878218 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877083    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-host-var-lib-cni-multus\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.878218 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877033    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-var-lib-openvswitch\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.878218 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-ovnkube-config\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.878218 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877122    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-system-cni-dir\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.878218 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877027    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.878218 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877158    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-os-release\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.878218 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.877173    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs podName:28e5f501-0964-4435-b714-b53d1985c224 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:22.377141132 +0000 UTC m=+2.017357580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs") pod "network-metrics-daemon-s8rhb" (UID: "28e5f501-0964-4435-b714-b53d1985c224") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:34:21.878218 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877186    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0832c487-7942-4557-8843-dc9246c59720-cni-binary-copy\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.878218 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877193    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret\") pod \"global-pull-secret-syncer-4z4nt\" (UID: \"d1006199-a395-4fef-b9a5-7abe2931fd07\") " pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:21.878218 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877199    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-cni-binary-copy\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.879006 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a126a0f5-431f-479f-ace8-cd614a94d066-socket-dir\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.879006 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.876395    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-cni-netd\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.879006 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.877321    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:34:21.879006 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877336    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a126a0f5-431f-479f-ace8-cd614a94d066-socket-dir\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.879006 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877349    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-modprobe-d\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.879006 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.877387    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret podName:d1006199-a395-4fef-b9a5-7abe2931fd07 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:22.377373227 +0000 UTC m=+2.017589656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret") pod "global-pull-secret-syncer-4z4nt" (UID: "d1006199-a395-4fef-b9a5-7abe2931fd07") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:34:21.879006 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877401    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-host-run-netns\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.879006 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877422    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-hostroot\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.879006 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877453    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-host-run-netns\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.879006 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877470    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a126a0f5-431f-479f-ace8-cd614a94d066-device-dir\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.879006 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877493    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-hostroot\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.879006 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877496    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-kubernetes\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.879006 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877517    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-run\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.879006 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877554    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqg59\" (UniqueName: \"kubernetes.io/projected/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-kube-api-access-qqg59\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.879006 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877559    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a126a0f5-431f-479f-ace8-cd614a94d066-device-dir\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.879006 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877584    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-host-var-lib-cni-bin\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.879006 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877613    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4lzt\" (UniqueName: \"kubernetes.io/projected/0832c487-7942-4557-8843-dc9246c59720-kube-api-access-t4lzt\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.879647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877621    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-host-var-lib-cni-bin\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.879647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877649    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8tdl\" (UniqueName: \"kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl\") pod \"network-check-target-2hxvx\" (UID: \"97208f7a-c966-4a7f-abee-d5732ca900c9\") " pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:21.879647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877661    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-ovnkube-config\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.879647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877728    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-run-systemd\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.879647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877833    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-run-systemd\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.879647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-node-log\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.879647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877864    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-node-log\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.879647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877886    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cxwt\" (UniqueName: \"kubernetes.io/projected/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-kube-api-access-9cxwt\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.879647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/36724fee-b20c-435b-a906-e9c098932706-hosts-file\") pod \"node-resolver-r5m9z\" (UID: \"36724fee-b20c-435b-a906-e9c098932706\") " pod="openshift-dns/node-resolver-r5m9z"
Jul 27 20:34:21.879647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471-konnectivity-ca\") pod \"konnectivity-agent-w7ctn\" (UID: \"6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471\") " pod="kube-system/konnectivity-agent-w7ctn"
Jul 27 20:34:21.879647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877962    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-systemd-units\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.879647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877969    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/36724fee-b20c-435b-a906-e9c098932706-hosts-file\") pod \"node-resolver-r5m9z\" (UID: \"36724fee-b20c-435b-a906-e9c098932706\") " pod="openshift-dns/node-resolver-r5m9z"
Jul 27 20:34:21.879647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.877987    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.879647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878011    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j5sb\" (UniqueName: \"kubernetes.io/projected/36724fee-b20c-435b-a906-e9c098932706-kube-api-access-7j5sb\") pod \"node-resolver-r5m9z\" (UID: \"36724fee-b20c-435b-a906-e9c098932706\") " pod="openshift-dns/node-resolver-r5m9z"
Jul 27 20:34:21.879647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878019    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-systemd-units\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.879647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878033    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-host\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.879647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878108    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.880182 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878134    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-multus-conf-dir\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.880182 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878170    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj4j2\" (UniqueName: \"kubernetes.io/projected/393fab17-1c8c-4507-93b6-33ebcbb23287-kube-api-access-tj4j2\") pod \"iptables-alerter-pc76c\" (UID: \"393fab17-1c8c-4507-93b6-33ebcbb23287\") " pod="openshift-network-operator/iptables-alerter-pc76c"
Jul 27 20:34:21.880182 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878194    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1006199-a395-4fef-b9a5-7abe2931fd07-dbus\") pod \"global-pull-secret-syncer-4z4nt\" (UID: \"d1006199-a395-4fef-b9a5-7abe2931fd07\") " pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:21.880182 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878226    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-multus-conf-dir\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.880182 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878250    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1006199-a395-4fef-b9a5-7abe2931fd07-dbus\") pod \"global-pull-secret-syncer-4z4nt\" (UID: \"d1006199-a395-4fef-b9a5-7abe2931fd07\") " pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:21.880182 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878295    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a126a0f5-431f-479f-ace8-cd614a94d066-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.880182 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878318    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-sysconfig\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.880182 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878333    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-systemd\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.880182 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878349    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-multus-socket-dir-parent\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.880182 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878369    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48-serviceca\") pod \"node-ca-wgfxv\" (UID: \"a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48\") " pod="openshift-image-registry/node-ca-wgfxv"
Jul 27 20:34:21.880182 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878410    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-multus-socket-dir-parent\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.880182 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878439    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a126a0f5-431f-479f-ace8-cd614a94d066-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.880182 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/393fab17-1c8c-4507-93b6-33ebcbb23287-host-slash\") pod \"iptables-alerter-pc76c\" (UID: \"393fab17-1c8c-4507-93b6-33ebcbb23287\") " pod="openshift-network-operator/iptables-alerter-pc76c"
Jul 27 20:34:21.880182 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-log-socket\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.880182 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878485    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/393fab17-1c8c-4507-93b6-33ebcbb23287-host-slash\") pod \"iptables-alerter-pc76c\" (UID: \"393fab17-1c8c-4507-93b6-33ebcbb23287\") " pod="openshift-network-operator/iptables-alerter-pc76c"
Jul 27 20:34:21.880182 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878511    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a126a0f5-431f-479f-ace8-cd614a94d066-registration-dir\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.880182 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878524    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-log-socket\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.880701 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878541    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-tuned\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.880701 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878568    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a126a0f5-431f-479f-ace8-cd614a94d066-registration-dir\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.880701 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878568    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.880701 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878608    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.880701 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878616    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-os-release\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.880701 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878647    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-sysctl-d\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.880701 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878671    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-host-run-k8s-cni-cncf-io\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.880701 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878686    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-os-release\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.880701 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878712    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-host-var-lib-kubelet\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.880701 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878723    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-host-run-k8s-cni-cncf-io\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.880701 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878741    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c978n\" (UniqueName: \"kubernetes.io/projected/a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48-kube-api-access-c978n\") pod \"node-ca-wgfxv\" (UID: \"a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48\") " pod="openshift-image-registry/node-ca-wgfxv"
Jul 27 20:34:21.880701 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878763    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0832c487-7942-4557-8843-dc9246c59720-host-var-lib-kubelet\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.880701 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878764    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-env-overrides\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.880701 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878776    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48-serviceca\") pod \"node-ca-wgfxv\" (UID: \"a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48\") " pod="openshift-image-registry/node-ca-wgfxv"
Jul 27 20:34:21.880701 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878800    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgkrc\" (UniqueName: \"kubernetes.io/projected/28e5f501-0964-4435-b714-b53d1985c224-kube-api-access-mgkrc\") pod \"network-metrics-daemon-s8rhb\" (UID: \"28e5f501-0964-4435-b714-b53d1985c224\") " pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:21.880701 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878826    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/393fab17-1c8c-4507-93b6-33ebcbb23287-iptables-alerter-script\") pod \"iptables-alerter-pc76c\" (UID: \"393fab17-1c8c-4507-93b6-33ebcbb23287\") " pod="openshift-network-operator/iptables-alerter-pc76c"
Jul 27 20:34:21.880701 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878948    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-kubelet\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.881233 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.878976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-etc-openvswitch\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.881233 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.879018    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-etc-openvswitch\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.881233 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.879054    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-env-overrides\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.881233 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.879054    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-kubelet\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.881233 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.879082    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-cni-bin\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.881233 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.879099    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnwc\" (UniqueName: \"kubernetes.io/projected/a126a0f5-431f-479f-ace8-cd614a94d066-kube-api-access-kjnwc\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.881233 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.879116    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-host-cni-bin\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.881233 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.879119    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-sysctl-conf\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.881233 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.879330    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/393fab17-1c8c-4507-93b6-33ebcbb23287-iptables-alerter-script\") pod \"iptables-alerter-pc76c\" (UID: \"393fab17-1c8c-4507-93b6-33ebcbb23287\") " pod="openshift-network-operator/iptables-alerter-pc76c"
Jul 27 20:34:21.881233 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.879960    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-ovn-node-metrics-cert\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.886652 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.886632    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97qrd\" (UniqueName: \"kubernetes.io/projected/70668bca-b3aa-4da9-a1a5-49c08d8abf0b-kube-api-access-97qrd\") pod \"ovnkube-node-fphdr\" (UID: \"70668bca-b3aa-4da9-a1a5-49c08d8abf0b\") " pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:21.891359 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.891343    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:34:21.891425 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.891362    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:34:21.891425 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.891371    2562 projected.go:196] Error preparing data for projected volume kube-api-access-r8tdl for pod openshift-network-diagnostics/network-check-target-2hxvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:34:21.891425 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:21.891411    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl podName:97208f7a-c966-4a7f-abee-d5732ca900c9 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:22.391400067 +0000 UTC m=+2.031616486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r8tdl" (UniqueName: "kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl") pod "network-check-target-2hxvx" (UID: "97208f7a-c966-4a7f-abee-d5732ca900c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:34:21.894601 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.893658    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj4j2\" (UniqueName: \"kubernetes.io/projected/393fab17-1c8c-4507-93b6-33ebcbb23287-kube-api-access-tj4j2\") pod \"iptables-alerter-pc76c\" (UID: \"393fab17-1c8c-4507-93b6-33ebcbb23287\") " pod="openshift-network-operator/iptables-alerter-pc76c"
Jul 27 20:34:21.894601 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.893955    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgkrc\" (UniqueName: \"kubernetes.io/projected/28e5f501-0964-4435-b714-b53d1985c224-kube-api-access-mgkrc\") pod \"network-metrics-daemon-s8rhb\" (UID: \"28e5f501-0964-4435-b714-b53d1985c224\") " pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:21.894601 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.894524    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cxwt\" (UniqueName: \"kubernetes.io/projected/9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad-kube-api-access-9cxwt\") pod \"multus-additional-cni-plugins-kmgkx\" (UID: \"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad\") " pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:21.894994 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.894972    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c978n\" (UniqueName: \"kubernetes.io/projected/a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48-kube-api-access-c978n\") pod \"node-ca-wgfxv\" (UID: \"a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48\") " pod="openshift-image-registry/node-ca-wgfxv"
Jul 27 20:34:21.895098 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.895060    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjnwc\" (UniqueName: \"kubernetes.io/projected/a126a0f5-431f-479f-ace8-cd614a94d066-kube-api-access-kjnwc\") pod \"aws-ebs-csi-driver-node-xgdnh\" (UID: \"a126a0f5-431f-479f-ace8-cd614a94d066\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:21.895625 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.895608    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4lzt\" (UniqueName: \"kubernetes.io/projected/0832c487-7942-4557-8843-dc9246c59720-kube-api-access-t4lzt\") pod \"multus-p8r2d\" (UID: \"0832c487-7942-4557-8843-dc9246c59720\") " pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:21.895789 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.895773    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j5sb\" (UniqueName: \"kubernetes.io/projected/36724fee-b20c-435b-a906-e9c098932706-kube-api-access-7j5sb\") pod \"node-resolver-r5m9z\" (UID: \"36724fee-b20c-435b-a906-e9c098932706\") " pod="openshift-dns/node-resolver-r5m9z"
Jul 27 20:34:21.979897 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.979834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-lib-modules\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.979897 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.979869    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-modprobe-d\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.979897 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.979885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-kubernetes\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.979897 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.979898    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-run\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980179 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.979922    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqg59\" (UniqueName: \"kubernetes.io/projected/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-kube-api-access-qqg59\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980179 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.979970    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-run\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980179 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.979985    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-lib-modules\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980179 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980004    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-kubernetes\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980179 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980134    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-modprobe-d\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980460 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980216    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471-konnectivity-ca\") pod \"konnectivity-agent-w7ctn\" (UID: \"6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471\") " pod="kube-system/konnectivity-agent-w7ctn"
Jul 27 20:34:21.980460 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980257    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-host\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980460 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980310    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-sysconfig\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980460 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980334    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-systemd\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980460 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980359    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-tuned\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980460 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980383    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-sysctl-d\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980460 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980397    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-sysconfig\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980460 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980409    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-systemd\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980460 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-sysctl-conf\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980460 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980406    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-host\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980460 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-sys\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980901 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980488    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-sysctl-d\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980901 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980499    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-tmp\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980901 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980504    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-sys\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980901 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471-agent-certs\") pod \"konnectivity-agent-w7ctn\" (UID: \"6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471\") " pod="kube-system/konnectivity-agent-w7ctn"
Jul 27 20:34:21.980901 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980507    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-sysctl-conf\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980901 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980582    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-var-lib-kubelet\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.980901 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.980661    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-var-lib-kubelet\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.981519 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.981501    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471-konnectivity-ca\") pod \"konnectivity-agent-w7ctn\" (UID: \"6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471\") " pod="kube-system/konnectivity-agent-w7ctn"
Jul 27 20:34:21.982268 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.982245    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-etc-tuned\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.982757 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.982738    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-tmp\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:21.982899 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.982883    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471-agent-certs\") pod \"konnectivity-agent-w7ctn\" (UID: \"6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471\") " pod="kube-system/konnectivity-agent-w7ctn"
Jul 27 20:34:21.987704 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:21.987681    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqg59\" (UniqueName: \"kubernetes.io/projected/8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7-kube-api-access-qqg59\") pod \"tuned-8c66g\" (UID: \"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7\") " pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:22.028506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.028485    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:34:22.074962 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.074929    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wgfxv"
Jul 27 20:34:22.089770 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.089754    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pc76c"
Jul 27 20:34:22.108193 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.108171    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:22.118470 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.118450    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh"
Jul 27 20:34:22.125542 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.125524    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r5m9z"
Jul 27 20:34:22.133384 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:22.133359    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa6b6eadd7d4ba3cc0e93e22fbf7fde.slice/crio-68324d9f77ada6836f2278400cf63bae37b6ac553c0e978ad0e2fb1aa674181f WatchSource:0}: Error finding container 68324d9f77ada6836f2278400cf63bae37b6ac553c0e978ad0e2fb1aa674181f: Status 404 returned error can't find the container with id 68324d9f77ada6836f2278400cf63bae37b6ac553c0e978ad0e2fb1aa674181f
Jul 27 20:34:22.133731 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:22.133704    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af48ac1f6ebdc0ed481956d7c3d1e96.slice/crio-8b2fdc6c7fbf5f5046e153d7c01910dbd4d575abbacaae80cdf9466ef1bbfd01 WatchSource:0}: Error finding container 8b2fdc6c7fbf5f5046e153d7c01910dbd4d575abbacaae80cdf9466ef1bbfd01: Status 404 returned error can't find the container with id 8b2fdc6c7fbf5f5046e153d7c01910dbd4d575abbacaae80cdf9466ef1bbfd01
Jul 27 20:34:22.134603 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:22.134583    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda126a0f5_431f_479f_ace8_cd614a94d066.slice/crio-169be57562fe832f8fdb4ede227d60676be1a60ebb77e5d83c9422f2f2417651 WatchSource:0}: Error finding container 169be57562fe832f8fdb4ede227d60676be1a60ebb77e5d83c9422f2f2417651: Status 404 returned error can't find the container with id 169be57562fe832f8fdb4ede227d60676be1a60ebb77e5d83c9422f2f2417651
Jul 27 20:34:22.135213 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:22.135195    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70668bca_b3aa_4da9_a1a5_49c08d8abf0b.slice/crio-369a5f813dfbd2f29acfa3ea90506cb73358073a4473468a75dbb1e96641c80a WatchSource:0}: Error finding container 369a5f813dfbd2f29acfa3ea90506cb73358073a4473468a75dbb1e96641c80a: Status 404 returned error can't find the container with id 369a5f813dfbd2f29acfa3ea90506cb73358073a4473468a75dbb1e96641c80a
Jul 27 20:34:22.135853 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:22.135839    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36724fee_b20c_435b_a906_e9c098932706.slice/crio-20508e569a5fbf8448a0f1e11231385ffa08a58d01573ed2baa8478f16dfcc89 WatchSource:0}: Error finding container 20508e569a5fbf8448a0f1e11231385ffa08a58d01573ed2baa8478f16dfcc89: Status 404 returned error can't find the container with id 20508e569a5fbf8448a0f1e11231385ffa08a58d01573ed2baa8478f16dfcc89
Jul 27 20:34:22.139894 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.139677    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kmgkx"
Jul 27 20:34:22.142079 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.141919    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:34:22.143505 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.143487    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p8r2d"
Jul 27 20:34:22.149643 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:22.149621    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9602f4d4_e0d1_48fb_99cb_1e133c5fc4ad.slice/crio-ddfc2696023a49a05353dffa73e8813dcc450077e7d34ab28bbdddce60eedfbc WatchSource:0}: Error finding container ddfc2696023a49a05353dffa73e8813dcc450077e7d34ab28bbdddce60eedfbc: Status 404 returned error can't find the container with id ddfc2696023a49a05353dffa73e8813dcc450077e7d34ab28bbdddce60eedfbc
Jul 27 20:34:22.151855 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:22.151809    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0832c487_7942_4557_8843_dc9246c59720.slice/crio-7756823b20c8a535aa13b1a8044fde0a4348745c8c48570bbe53517bfbe0898e WatchSource:0}: Error finding container 7756823b20c8a535aa13b1a8044fde0a4348745c8c48570bbe53517bfbe0898e: Status 404 returned error can't find the container with id 7756823b20c8a535aa13b1a8044fde0a4348745c8c48570bbe53517bfbe0898e
Jul 27 20:34:22.159381 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.159361    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w7ctn"
Jul 27 20:34:22.163733 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.163710    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8c66g"
Jul 27 20:34:22.168069 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:22.168049    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee6d38d_2dd3_41cf_90e0_d6e9d22a8471.slice/crio-587541cff64f4e6a5a0189230573232199dad1a9760b59e95afe57c30e37ef0c WatchSource:0}: Error finding container 587541cff64f4e6a5a0189230573232199dad1a9760b59e95afe57c30e37ef0c: Status 404 returned error can't find the container with id 587541cff64f4e6a5a0189230573232199dad1a9760b59e95afe57c30e37ef0c
Jul 27 20:34:22.171513 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:22.171495    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba6e3cb_0cc0_4e32_8c5d_edac65d70ac7.slice/crio-cdccba2fa57cffa8cb29aa53c3a6bb597da6d649b3bb6b6a6d39466447f2e010 WatchSource:0}: Error finding container cdccba2fa57cffa8cb29aa53c3a6bb597da6d649b3bb6b6a6d39466447f2e010: Status 404 returned error can't find the container with id cdccba2fa57cffa8cb29aa53c3a6bb597da6d649b3bb6b6a6d39466447f2e010
Jul 27 20:34:22.384018 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.383937    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs\") pod \"network-metrics-daemon-s8rhb\" (UID: \"28e5f501-0964-4435-b714-b53d1985c224\") " pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:22.384018 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.383970    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret\") pod \"global-pull-secret-syncer-4z4nt\" (UID: \"d1006199-a395-4fef-b9a5-7abe2931fd07\") " pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:22.384179 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:22.384089    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:34:22.384179 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:22.384132    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:34:22.384179 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:22.384154    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs podName:28e5f501-0964-4435-b714-b53d1985c224 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:23.384134706 +0000 UTC m=+3.024351133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs") pod "network-metrics-daemon-s8rhb" (UID: "28e5f501-0964-4435-b714-b53d1985c224") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:34:22.384179 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:22.384168    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret podName:d1006199-a395-4fef-b9a5-7abe2931fd07 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:23.384162028 +0000 UTC m=+3.024378445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret") pod "global-pull-secret-syncer-4z4nt" (UID: "d1006199-a395-4fef-b9a5-7abe2931fd07") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:34:22.440387 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:22.440356    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod393fab17_1c8c_4507_93b6_33ebcbb23287.slice/crio-34571d3c1ee2f9e96768f45635a05424ff603670d29999bbdbab3f96c90e54cb WatchSource:0}: Error finding container 34571d3c1ee2f9e96768f45635a05424ff603670d29999bbdbab3f96c90e54cb: Status 404 returned error can't find the container with id 34571d3c1ee2f9e96768f45635a05424ff603670d29999bbdbab3f96c90e54cb
Jul 27 20:34:22.463497 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:22.463465    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0f1489a_628e_4cc0_b2aa_fecc3bfa2e48.slice/crio-4e73e41e9016d162ebb6a13a295ae85f7cbc86cad4c9c412284df48ab08d45e5 WatchSource:0}: Error finding container 4e73e41e9016d162ebb6a13a295ae85f7cbc86cad4c9c412284df48ab08d45e5: Status 404 returned error can't find the container with id 4e73e41e9016d162ebb6a13a295ae85f7cbc86cad4c9c412284df48ab08d45e5
Jul 27 20:34:22.485074 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.485054    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8tdl\" (UniqueName: \"kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl\") pod \"network-check-target-2hxvx\" (UID: \"97208f7a-c966-4a7f-abee-d5732ca900c9\") " pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:22.485165 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:22.485154    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:34:22.485209 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:22.485171    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:34:22.485209 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:22.485179    2562 projected.go:196] Error preparing data for projected volume kube-api-access-r8tdl for pod openshift-network-diagnostics/network-check-target-2hxvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:34:22.485283 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:22.485216    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl podName:97208f7a-c966-4a7f-abee-d5732ca900c9 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:23.485204245 +0000 UTC m=+3.125420662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8tdl" (UniqueName: "kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl") pod "network-check-target-2hxvx" (UID: "97208f7a-c966-4a7f-abee-d5732ca900c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:34:22.780406 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.780332    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:34:22.826106 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.826009    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:29:21 +0000 UTC" deadline="2028-03-02 23:06:47.020286468 +0000 UTC"
Jul 27 20:34:22.826106 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.826049    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14018h32m24.194242052s"
Jul 27 20:34:22.866728 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.866688    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:22.866884 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:22.866853    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8rhb" podUID="28e5f501-0964-4435-b714-b53d1985c224"
Jul 27 20:34:22.887520 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.887451    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wgfxv" event={"ID":"a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48","Type":"ContainerStarted","Data":"4e73e41e9016d162ebb6a13a295ae85f7cbc86cad4c9c412284df48ab08d45e5"}
Jul 27 20:34:22.896398 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.896325    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8c66g" event={"ID":"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7","Type":"ContainerStarted","Data":"cdccba2fa57cffa8cb29aa53c3a6bb597da6d649b3bb6b6a6d39466447f2e010"}
Jul 27 20:34:22.913202 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.913164    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmgkx" event={"ID":"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad","Type":"ContainerStarted","Data":"ddfc2696023a49a05353dffa73e8813dcc450077e7d34ab28bbdddce60eedfbc"}
Jul 27 20:34:22.916753 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.916699    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r5m9z" event={"ID":"36724fee-b20c-435b-a906-e9c098932706","Type":"ContainerStarted","Data":"20508e569a5fbf8448a0f1e11231385ffa08a58d01573ed2baa8478f16dfcc89"}
Jul 27 20:34:22.929305 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.928100    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh" event={"ID":"a126a0f5-431f-479f-ace8-cd614a94d066","Type":"ContainerStarted","Data":"169be57562fe832f8fdb4ede227d60676be1a60ebb77e5d83c9422f2f2417651"}
Jul 27 20:34:22.931197 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.930820    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal" event={"ID":"1fa6b6eadd7d4ba3cc0e93e22fbf7fde","Type":"ContainerStarted","Data":"68324d9f77ada6836f2278400cf63bae37b6ac553c0e978ad0e2fb1aa674181f"}
Jul 27 20:34:22.947729 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.947698    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pc76c" event={"ID":"393fab17-1c8c-4507-93b6-33ebcbb23287","Type":"ContainerStarted","Data":"34571d3c1ee2f9e96768f45635a05424ff603670d29999bbdbab3f96c90e54cb"}
Jul 27 20:34:22.959350 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.959323    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w7ctn" event={"ID":"6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471","Type":"ContainerStarted","Data":"587541cff64f4e6a5a0189230573232199dad1a9760b59e95afe57c30e37ef0c"}
Jul 27 20:34:22.963037 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.963011    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p8r2d" event={"ID":"0832c487-7942-4557-8843-dc9246c59720","Type":"ContainerStarted","Data":"7756823b20c8a535aa13b1a8044fde0a4348745c8c48570bbe53517bfbe0898e"}
Jul 27 20:34:22.977556 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.977387    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr" event={"ID":"70668bca-b3aa-4da9-a1a5-49c08d8abf0b","Type":"ContainerStarted","Data":"369a5f813dfbd2f29acfa3ea90506cb73358073a4473468a75dbb1e96641c80a"}
Jul 27 20:34:22.992059 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:22.992030    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal" event={"ID":"1af48ac1f6ebdc0ed481956d7c3d1e96","Type":"ContainerStarted","Data":"8b2fdc6c7fbf5f5046e153d7c01910dbd4d575abbacaae80cdf9466ef1bbfd01"}
Jul 27 20:34:23.392223 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:23.392186    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs\") pod \"network-metrics-daemon-s8rhb\" (UID: \"28e5f501-0964-4435-b714-b53d1985c224\") " pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:23.392424 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:23.392243    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret\") pod \"global-pull-secret-syncer-4z4nt\" (UID: \"d1006199-a395-4fef-b9a5-7abe2931fd07\") " pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:23.392424 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:23.392375    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:34:23.392543 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:23.392436    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:34:23.392543 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:23.392449    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs podName:28e5f501-0964-4435-b714-b53d1985c224 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:25.392430112 +0000 UTC m=+5.032646532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs") pod "network-metrics-daemon-s8rhb" (UID: "28e5f501-0964-4435-b714-b53d1985c224") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:34:23.392543 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:23.392496    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret podName:d1006199-a395-4fef-b9a5-7abe2931fd07 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:25.392480499 +0000 UTC m=+5.032696921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret") pod "global-pull-secret-syncer-4z4nt" (UID: "d1006199-a395-4fef-b9a5-7abe2931fd07") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:34:23.493329 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:23.493293    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8tdl\" (UniqueName: \"kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl\") pod \"network-check-target-2hxvx\" (UID: \"97208f7a-c966-4a7f-abee-d5732ca900c9\") " pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:23.493568 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:23.493539    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:34:23.493634 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:23.493581    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:34:23.493634 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:23.493595    2562 projected.go:196] Error preparing data for projected volume kube-api-access-r8tdl for pod openshift-network-diagnostics/network-check-target-2hxvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:34:23.493744 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:23.493652    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl podName:97208f7a-c966-4a7f-abee-d5732ca900c9 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:25.493634488 +0000 UTC m=+5.133850907 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8tdl" (UniqueName: "kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl") pod "network-check-target-2hxvx" (UID: "97208f7a-c966-4a7f-abee-d5732ca900c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:34:23.827279 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:23.827082    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:29:21 +0000 UTC" deadline="2028-02-23 22:35:42.751321129 +0000 UTC"
Jul 27 20:34:23.827279 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:23.827139    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13826h1m18.924185621s"
Jul 27 20:34:23.863431 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:23.863309    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:23.863603 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:23.863452    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4z4nt" podUID="d1006199-a395-4fef-b9a5-7abe2931fd07"
Jul 27 20:34:23.863853 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:23.863832    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:23.863957 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:23.863932    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hxvx" podUID="97208f7a-c966-4a7f-abee-d5732ca900c9"
Jul 27 20:34:24.866664 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:24.866146    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:24.866664 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:24.866301    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8rhb" podUID="28e5f501-0964-4435-b714-b53d1985c224"
Jul 27 20:34:25.410733 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:25.409958    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs\") pod \"network-metrics-daemon-s8rhb\" (UID: \"28e5f501-0964-4435-b714-b53d1985c224\") " pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:25.410733 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:25.410010    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret\") pod \"global-pull-secret-syncer-4z4nt\" (UID: \"d1006199-a395-4fef-b9a5-7abe2931fd07\") " pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:25.410733 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:25.410168    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:34:25.410733 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:25.410237    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret podName:d1006199-a395-4fef-b9a5-7abe2931fd07 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:29.410213465 +0000 UTC m=+9.050429907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret") pod "global-pull-secret-syncer-4z4nt" (UID: "d1006199-a395-4fef-b9a5-7abe2931fd07") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:34:25.410733 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:25.410641    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:34:25.410733 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:25.410702    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs podName:28e5f501-0964-4435-b714-b53d1985c224 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:29.410687804 +0000 UTC m=+9.050904233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs") pod "network-metrics-daemon-s8rhb" (UID: "28e5f501-0964-4435-b714-b53d1985c224") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:34:25.511627 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:25.510992    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8tdl\" (UniqueName: \"kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl\") pod \"network-check-target-2hxvx\" (UID: \"97208f7a-c966-4a7f-abee-d5732ca900c9\") " pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:25.511627 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:25.511147    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:34:25.511627 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:25.511166    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:34:25.511627 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:25.511178    2562 projected.go:196] Error preparing data for projected volume kube-api-access-r8tdl for pod openshift-network-diagnostics/network-check-target-2hxvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:34:25.511627 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:25.511233    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl podName:97208f7a-c966-4a7f-abee-d5732ca900c9 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:29.511216322 +0000 UTC m=+9.151432739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8tdl" (UniqueName: "kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl") pod "network-check-target-2hxvx" (UID: "97208f7a-c966-4a7f-abee-d5732ca900c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:34:25.864084 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:25.864002    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:25.864241 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:25.864169    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4z4nt" podUID="d1006199-a395-4fef-b9a5-7abe2931fd07"
Jul 27 20:34:25.864241 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:25.864217    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:25.864380 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:25.864313    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hxvx" podUID="97208f7a-c966-4a7f-abee-d5732ca900c9"
Jul 27 20:34:26.864576 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:26.864539    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:26.865108 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:26.864698    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8rhb" podUID="28e5f501-0964-4435-b714-b53d1985c224"
Jul 27 20:34:27.863499 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:27.863427    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:27.863675 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:27.863599    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4z4nt" podUID="d1006199-a395-4fef-b9a5-7abe2931fd07"
Jul 27 20:34:27.863890 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:27.863473    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:27.863890 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:27.863856    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hxvx" podUID="97208f7a-c966-4a7f-abee-d5732ca900c9"
Jul 27 20:34:28.863584 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:28.863529    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:28.864007 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:28.863675    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8rhb" podUID="28e5f501-0964-4435-b714-b53d1985c224"
Jul 27 20:34:29.444558 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:29.444520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs\") pod \"network-metrics-daemon-s8rhb\" (UID: \"28e5f501-0964-4435-b714-b53d1985c224\") " pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:29.444730 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:29.444569    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret\") pod \"global-pull-secret-syncer-4z4nt\" (UID: \"d1006199-a395-4fef-b9a5-7abe2931fd07\") " pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:29.444730 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:29.444693    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:34:29.444730 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:29.444719    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:34:29.444890 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:29.444749    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret podName:d1006199-a395-4fef-b9a5-7abe2931fd07 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:37.444731816 +0000 UTC m=+17.084948248 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret") pod "global-pull-secret-syncer-4z4nt" (UID: "d1006199-a395-4fef-b9a5-7abe2931fd07") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:34:29.444890 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:29.444784    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs podName:28e5f501-0964-4435-b714-b53d1985c224 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:37.444766508 +0000 UTC m=+17.084982946 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs") pod "network-metrics-daemon-s8rhb" (UID: "28e5f501-0964-4435-b714-b53d1985c224") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:34:29.545755 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:29.545720    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8tdl\" (UniqueName: \"kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl\") pod \"network-check-target-2hxvx\" (UID: \"97208f7a-c966-4a7f-abee-d5732ca900c9\") " pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:29.545905 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:29.545874    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:34:29.545905 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:29.545896    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:34:29.546027 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:29.545908    2562 projected.go:196] Error preparing data for projected volume kube-api-access-r8tdl for pod openshift-network-diagnostics/network-check-target-2hxvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:34:29.546027 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:29.545974    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl podName:97208f7a-c966-4a7f-abee-d5732ca900c9 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:37.545954285 +0000 UTC m=+17.186170725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8tdl" (UniqueName: "kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl") pod "network-check-target-2hxvx" (UID: "97208f7a-c966-4a7f-abee-d5732ca900c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:34:29.863961 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:29.863885    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:29.864414 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:29.864014    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:29.864414 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:29.864114    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4z4nt" podUID="d1006199-a395-4fef-b9a5-7abe2931fd07"
Jul 27 20:34:29.864414 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:29.864010    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hxvx" podUID="97208f7a-c966-4a7f-abee-d5732ca900c9"
Jul 27 20:34:30.866067 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:30.866030    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:30.866544 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:30.866178    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8rhb" podUID="28e5f501-0964-4435-b714-b53d1985c224"
Jul 27 20:34:31.864335 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:31.864296    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:31.864510 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:31.864421    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4z4nt" podUID="d1006199-a395-4fef-b9a5-7abe2931fd07"
Jul 27 20:34:31.864510 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:31.864444    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:31.864600 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:31.864540    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hxvx" podUID="97208f7a-c966-4a7f-abee-d5732ca900c9"
Jul 27 20:34:32.864117 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:32.864083    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:32.864659 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:32.864237    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8rhb" podUID="28e5f501-0964-4435-b714-b53d1985c224"
Jul 27 20:34:33.863776 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:33.863737    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:33.863776 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:33.863769    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:33.864013 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:33.863864    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hxvx" podUID="97208f7a-c966-4a7f-abee-d5732ca900c9"
Jul 27 20:34:33.864013 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:33.864001    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4z4nt" podUID="d1006199-a395-4fef-b9a5-7abe2931fd07"
Jul 27 20:34:34.864201 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:34.864163    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:34.864639 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:34.864312    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8rhb" podUID="28e5f501-0964-4435-b714-b53d1985c224"
Jul 27 20:34:35.863821 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:35.863786    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:35.863996 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:35.863902    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4z4nt" podUID="d1006199-a395-4fef-b9a5-7abe2931fd07"
Jul 27 20:34:35.863996 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:35.863967    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:35.864089 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:35.864065    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hxvx" podUID="97208f7a-c966-4a7f-abee-d5732ca900c9"
Jul 27 20:34:36.863305 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:36.863258    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:36.863748 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:36.863414    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8rhb" podUID="28e5f501-0964-4435-b714-b53d1985c224"
Jul 27 20:34:37.506451 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:37.506419    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs\") pod \"network-metrics-daemon-s8rhb\" (UID: \"28e5f501-0964-4435-b714-b53d1985c224\") " pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:37.506451 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:37.506458    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret\") pod \"global-pull-secret-syncer-4z4nt\" (UID: \"d1006199-a395-4fef-b9a5-7abe2931fd07\") " pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:37.506718 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:37.506574    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:34:37.506718 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:37.506577    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:34:37.506718 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:37.506635    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret podName:d1006199-a395-4fef-b9a5-7abe2931fd07 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:53.506616924 +0000 UTC m=+33.146833341 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret") pod "global-pull-secret-syncer-4z4nt" (UID: "d1006199-a395-4fef-b9a5-7abe2931fd07") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:34:37.506718 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:37.506652    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs podName:28e5f501-0964-4435-b714-b53d1985c224 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:53.506645083 +0000 UTC m=+33.146861501 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs") pod "network-metrics-daemon-s8rhb" (UID: "28e5f501-0964-4435-b714-b53d1985c224") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:34:37.607724 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:37.607689    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8tdl\" (UniqueName: \"kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl\") pod \"network-check-target-2hxvx\" (UID: \"97208f7a-c966-4a7f-abee-d5732ca900c9\") " pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:37.607890 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:37.607873    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:34:37.607940 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:37.607900    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:34:37.607940 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:37.607914    2562 projected.go:196] Error preparing data for projected volume kube-api-access-r8tdl for pod openshift-network-diagnostics/network-check-target-2hxvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:34:37.608013 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:37.607972    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl podName:97208f7a-c966-4a7f-abee-d5732ca900c9 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:53.607955823 +0000 UTC m=+33.248172257 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8tdl" (UniqueName: "kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl") pod "network-check-target-2hxvx" (UID: "97208f7a-c966-4a7f-abee-d5732ca900c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:34:37.864009 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:37.863980    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:37.864423 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:37.863983    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:37.864423 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:37.864088    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hxvx" podUID="97208f7a-c966-4a7f-abee-d5732ca900c9"
Jul 27 20:34:37.864423 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:37.864203    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4z4nt" podUID="d1006199-a395-4fef-b9a5-7abe2931fd07"
Jul 27 20:34:38.863412 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:38.863368    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:38.863589 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:38.863517    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8rhb" podUID="28e5f501-0964-4435-b714-b53d1985c224"
Jul 27 20:34:39.863926 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:39.863888    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:39.864339 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:39.863902    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:39.864339 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:39.864023    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4z4nt" podUID="d1006199-a395-4fef-b9a5-7abe2931fd07"
Jul 27 20:34:39.864339 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:39.864090    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hxvx" podUID="97208f7a-c966-4a7f-abee-d5732ca900c9"
Jul 27 20:34:40.864441 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:40.864404    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:40.864889 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:40.864490    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8rhb" podUID="28e5f501-0964-4435-b714-b53d1985c224"
Jul 27 20:34:41.863655 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:41.863394    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:41.863749 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:41.863389    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:41.863749 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:41.863707    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hxvx" podUID="97208f7a-c966-4a7f-abee-d5732ca900c9"
Jul 27 20:34:41.863852 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:41.863826    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4z4nt" podUID="d1006199-a395-4fef-b9a5-7abe2931fd07"
Jul 27 20:34:42.048160 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.048127    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wgfxv" event={"ID":"a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48","Type":"ContainerStarted","Data":"010e2df6036c24e877339a40c14abac8ecfa32009d6ef9f910b160adbf6ce91d"}
Jul 27 20:34:42.050195 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.050150    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8c66g" event={"ID":"8ba6e3cb-0cc0-4e32-8c5d-edac65d70ac7","Type":"ContainerStarted","Data":"a56bfa6f8b0aca1a48cf9b9effbf6a9e96607c9f2ac60fc49871d1bf027f2699"}
Jul 27 20:34:42.052041 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.051774    2562 generic.go:356] "Generic (PLEG): container finished" podID="9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad" containerID="de45d998113ab651fc823e29b46cfd6a248cdced58551a412c4bc1c676b5234b" exitCode=0
Jul 27 20:34:42.052041 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.051968    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmgkx" event={"ID":"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad","Type":"ContainerDied","Data":"de45d998113ab651fc823e29b46cfd6a248cdced58551a412c4bc1c676b5234b"}
Jul 27 20:34:42.053826 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.053801    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r5m9z" event={"ID":"36724fee-b20c-435b-a906-e9c098932706","Type":"ContainerStarted","Data":"da461aa93fac3a04ad539ae5f04f718fadcd211e223bc15efa81c1e8f5c83a65"}
Jul 27 20:34:42.055391 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.055368    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh" event={"ID":"a126a0f5-431f-479f-ace8-cd614a94d066","Type":"ContainerStarted","Data":"54dde4ca7878d7535e0d7e12186fb92ec2e2bee688ec7e4df8d080c98d8f63c3"}
Jul 27 20:34:42.057167 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.057138    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal" event={"ID":"1fa6b6eadd7d4ba3cc0e93e22fbf7fde","Type":"ContainerStarted","Data":"e4b090e69e8177a7714852a507cd697b6be474125c27c80d8dc935b824efddb7"}
Jul 27 20:34:42.058591 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.058571    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w7ctn" event={"ID":"6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471","Type":"ContainerStarted","Data":"db31374a9a3874519f7b81d0796c76f597353288772920190d012036a1d46834"}
Jul 27 20:34:42.060211 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.060191    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p8r2d" event={"ID":"0832c487-7942-4557-8843-dc9246c59720","Type":"ContainerStarted","Data":"9ea8a3a73a46a89bcd6540fbf630a537ca6237b21a975fd2c2e843d68230067c"}
Jul 27 20:34:42.063196 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.063171    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 20:34:42.063602 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.063581    2562 generic.go:356] "Generic (PLEG): container finished" podID="70668bca-b3aa-4da9-a1a5-49c08d8abf0b" containerID="7f0d1624459f35ee7bca2263ec076b2a0b9ee51325334dfbf18a15e3bc7113f7" exitCode=1
Jul 27 20:34:42.063687 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.063649    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr" event={"ID":"70668bca-b3aa-4da9-a1a5-49c08d8abf0b","Type":"ContainerStarted","Data":"f096fa6c938a0b817b5243321e370fde59fa5afe999a6c9ac739b7cfbb7e620d"}
Jul 27 20:34:42.063746 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.063725    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr" event={"ID":"70668bca-b3aa-4da9-a1a5-49c08d8abf0b","Type":"ContainerStarted","Data":"414b3ee3f613eee1b5cb8334704aef81543d6afcbc0ac9f2e63d3f74877cfa27"}
Jul 27 20:34:42.063798 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.063776    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr" event={"ID":"70668bca-b3aa-4da9-a1a5-49c08d8abf0b","Type":"ContainerStarted","Data":"b7fd0d111f364812a88b539a85fee327bbc7d477957dbb95672cc313d47c05e7"}
Jul 27 20:34:42.063848 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.063827    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr" event={"ID":"70668bca-b3aa-4da9-a1a5-49c08d8abf0b","Type":"ContainerStarted","Data":"0858a7a6cf1474eebf491c158955aeaf471f6f1ed54b95d4f0188ad72b4b1edd"}
Jul 27 20:34:42.063895 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.063878    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr" event={"ID":"70668bca-b3aa-4da9-a1a5-49c08d8abf0b","Type":"ContainerDied","Data":"7f0d1624459f35ee7bca2263ec076b2a0b9ee51325334dfbf18a15e3bc7113f7"}
Jul 27 20:34:42.063951 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.063928    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr" event={"ID":"70668bca-b3aa-4da9-a1a5-49c08d8abf0b","Type":"ContainerStarted","Data":"2237e3b1d2543f582ee284dc94f47072d644d3717c6727ed0eee0eff5a8c5bef"}
Jul 27 20:34:42.065264 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.065240    2562 generic.go:356] "Generic (PLEG): container finished" podID="1af48ac1f6ebdc0ed481956d7c3d1e96" containerID="58e30e818547bafc4067056108c35625028f521febd0a7c705c97127c68c3abd" exitCode=0
Jul 27 20:34:42.065356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.065286    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal" event={"ID":"1af48ac1f6ebdc0ed481956d7c3d1e96","Type":"ContainerDied","Data":"58e30e818547bafc4067056108c35625028f521febd0a7c705c97127c68c3abd"}
Jul 27 20:34:42.081643 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.081589    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wgfxv" podStartSLOduration=2.286699993 podStartE2EDuration="21.081570147s" totalImagesPullingTime="18.794870154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:42.065690068 +0000 UTC m=+21.705906520" watchObservedRunningTime="2026-07-27 20:34:42.081570147 +0000 UTC m=+21.721786587"
Jul 27 20:34:42.095189 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.095134    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-r5m9z" podStartSLOduration=1.954217168 podStartE2EDuration="21.095113454s" totalImagesPullingTime="19.140896286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:42.094462897 +0000 UTC m=+21.734679416" watchObservedRunningTime="2026-07-27 20:34:42.095113454 +0000 UTC m=+21.735329894"
Jul 27 20:34:42.114159 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.114105    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p8r2d" podStartSLOduration=1.467972647 podStartE2EDuration="21.114087254s" totalImagesPullingTime="19.646114607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:42.113261375 +0000 UTC m=+21.753477828" watchObservedRunningTime="2026-07-27 20:34:42.114087254 +0000 UTC m=+21.754303693"
Jul 27 20:34:42.131725 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.131678    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8c66g" podStartSLOduration=2.020941297 podStartE2EDuration="21.131662948s" totalImagesPullingTime="19.110721651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:42.131135174 +0000 UTC m=+21.771351630" watchObservedRunningTime="2026-07-27 20:34:42.131662948 +0000 UTC m=+21.771879386"
Jul 27 20:34:42.146300 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.146115    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal" podStartSLOduration=21.146100582 podStartE2EDuration="21.146100582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:42.145162914 +0000 UTC m=+21.785379364" watchObservedRunningTime="2026-07-27 20:34:42.146100582 +0000 UTC m=+21.786317021"
Jul 27 20:34:42.205470 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.205409    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w7ctn" podStartSLOduration=2.134349398 podStartE2EDuration="21.205385619s" totalImagesPullingTime="19.071036221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:42.204929076 +0000 UTC m=+21.845145535" watchObservedRunningTime="2026-07-27 20:34:42.205385619 +0000 UTC m=+21.845602057"
Jul 27 20:34:42.863852 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:42.863822    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:42.864017 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:42.863955    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8rhb" podUID="28e5f501-0964-4435-b714-b53d1985c224"
Jul 27 20:34:43.068862 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:43.068827    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pc76c" event={"ID":"393fab17-1c8c-4507-93b6-33ebcbb23287","Type":"ContainerStarted","Data":"94fedc6e192ccf47139f95df7ade09d617f3b055cae3a25a5598673de576a7cd"}
Jul 27 20:34:43.072023 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:43.071994    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal" event={"ID":"1af48ac1f6ebdc0ed481956d7c3d1e96","Type":"ContainerStarted","Data":"9088679708e217a6a43ca0ba90dd0d1d1c1733848cc809cb0e429c5e4f8f88f4"}
Jul 27 20:34:43.096825 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:43.096774    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pc76c" podStartSLOduration=7.449492106 podStartE2EDuration="22.096758705s" totalImagesPullingTime="14.647266599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:43.082906324 +0000 UTC m=+22.723122786" watchObservedRunningTime="2026-07-27 20:34:43.096758705 +0000 UTC m=+22.736975143"
Jul 27 20:34:43.097432 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:43.097395    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal" podStartSLOduration=22.09738934 podStartE2EDuration="22.09738934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:43.096537865 +0000 UTC m=+22.736754306" watchObservedRunningTime="2026-07-27 20:34:43.09738934 +0000 UTC m=+22.737605777"
Jul 27 20:34:43.163453 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:43.163407    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 20:34:43.863245 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:43.863212    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:43.863578 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:43.863212    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:43.863578 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:43.863360    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hxvx" podUID="97208f7a-c966-4a7f-abee-d5732ca900c9"
Jul 27 20:34:43.863578 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:43.863389    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4z4nt" podUID="d1006199-a395-4fef-b9a5-7abe2931fd07"
Jul 27 20:34:43.980736 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:43.980625    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T20:34:43.1634257Z","UUID":"87a010b1-d1ef-40f9-a735-80fca3db6311","Handler":null,"Name":"","Endpoint":""}
Jul 27 20:34:43.982862 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:43.982839    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 20:34:43.982994 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:43.982883    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 20:34:44.076103 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:44.076072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh" event={"ID":"a126a0f5-431f-479f-ace8-cd614a94d066","Type":"ContainerStarted","Data":"204912c28c7c71ed18232f97bebbf67036ed3ad7c5e1f4d39b25e6f2bd9599f1"}
Jul 27 20:34:44.864203 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:44.864169    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:44.864423 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:44.864326    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8rhb" podUID="28e5f501-0964-4435-b714-b53d1985c224"
Jul 27 20:34:45.083477 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:45.083443    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 20:34:45.083858 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:45.083816    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr" event={"ID":"70668bca-b3aa-4da9-a1a5-49c08d8abf0b","Type":"ContainerStarted","Data":"6b6da669cb011a6931fc622d628a37f74cfe61f3476fd6cb660ee6baa31d941a"}
Jul 27 20:34:45.086157 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:45.086132    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh" event={"ID":"a126a0f5-431f-479f-ace8-cd614a94d066","Type":"ContainerStarted","Data":"4f0db9f7ae545c54f525b0cf144e9a53988d97c290c073a946875627bf52bb7b"}
Jul 27 20:34:45.101958 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:45.101906    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdnh" podStartSLOduration=2.7092151270000002 podStartE2EDuration="24.101887306s" totalImagesPullingTime="21.392672179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:45.101376225 +0000 UTC m=+24.741592663" watchObservedRunningTime="2026-07-27 20:34:45.101887306 +0000 UTC m=+24.742103747"
Jul 27 20:34:45.566463 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:45.566429    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w7ctn"
Jul 27 20:34:45.566957 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:45.566934    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w7ctn"
Jul 27 20:34:45.863854 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:45.863812    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:45.863854 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:45.863836    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:45.864068 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:45.863943    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hxvx" podUID="97208f7a-c966-4a7f-abee-d5732ca900c9"
Jul 27 20:34:45.864125 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:45.864065    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4z4nt" podUID="d1006199-a395-4fef-b9a5-7abe2931fd07"
Jul 27 20:34:46.864476 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:46.864312    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:46.864906 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:46.864577    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8rhb" podUID="28e5f501-0964-4435-b714-b53d1985c224"
Jul 27 20:34:47.092092 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:47.092051    2562 generic.go:356] "Generic (PLEG): container finished" podID="9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad" containerID="6f35be92f0a8ee5404b84132a8f897d986c744c76c40aec8c739625bb39160db" exitCode=0
Jul 27 20:34:47.092236 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:47.092131    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmgkx" event={"ID":"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad","Type":"ContainerDied","Data":"6f35be92f0a8ee5404b84132a8f897d986c744c76c40aec8c739625bb39160db"}
Jul 27 20:34:47.095589 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:47.095572    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 20:34:47.095972 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:47.095954    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr" event={"ID":"70668bca-b3aa-4da9-a1a5-49c08d8abf0b","Type":"ContainerStarted","Data":"f8f03c1c20f93fcb6ae6b8f7974864a47085cab867ec8bd2aa4465144b8565e3"}
Jul 27 20:34:47.096195 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:47.096180    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:47.096285 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:47.096227    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:47.096341 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:47.096291    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:47.096397 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:47.096380    2562 scope.go:117] "RemoveContainer" containerID="7f0d1624459f35ee7bca2263ec076b2a0b9ee51325334dfbf18a15e3bc7113f7"
Jul 27 20:34:47.111243 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:47.111223    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:47.111460 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:47.111444    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:34:47.863604 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:47.863577    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:47.863604 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:47.863616    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:47.863807 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:47.863711    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hxvx" podUID="97208f7a-c966-4a7f-abee-d5732ca900c9"
Jul 27 20:34:47.863885 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:47.863837    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4z4nt" podUID="d1006199-a395-4fef-b9a5-7abe2931fd07"
Jul 27 20:34:48.101927 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:48.101901    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 20:34:48.102484 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:48.102382    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr" event={"ID":"70668bca-b3aa-4da9-a1a5-49c08d8abf0b","Type":"ContainerStarted","Data":"ecb6c0e4bbbf6d3e87bce52a2e0f185b3426243461d8f5c2e8f406211f84f9dd"}
Jul 27 20:34:48.128733 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:48.128647    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr" podStartSLOduration=7.948448107 podStartE2EDuration="27.128630672s" totalImagesPullingTime="19.180182565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:48.127532239 +0000 UTC m=+27.767748689" watchObservedRunningTime="2026-07-27 20:34:48.128630672 +0000 UTC m=+27.768847107"
Jul 27 20:34:48.589540 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:48.589336    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4z4nt"]
Jul 27 20:34:48.589733 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:48.589644    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:48.589782 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:48.589740    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4z4nt" podUID="d1006199-a395-4fef-b9a5-7abe2931fd07"
Jul 27 20:34:48.592641 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:48.592615    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2hxvx"]
Jul 27 20:34:48.592776 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:48.592707    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:48.592827 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:48.592790    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hxvx" podUID="97208f7a-c966-4a7f-abee-d5732ca900c9"
Jul 27 20:34:48.598798 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:48.598772    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s8rhb"]
Jul 27 20:34:48.598915 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:48.598883    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:48.599014 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:48.598982    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8rhb" podUID="28e5f501-0964-4435-b714-b53d1985c224"
Jul 27 20:34:49.106356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:49.106325    2562 generic.go:356] "Generic (PLEG): container finished" podID="9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad" containerID="f261823a19853f8b6ee8d6a5baae3a3021737fc22e46fe442b83e430c9a16ae4" exitCode=0
Jul 27 20:34:49.106844 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:49.106410    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmgkx" event={"ID":"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad","Type":"ContainerDied","Data":"f261823a19853f8b6ee8d6a5baae3a3021737fc22e46fe442b83e430c9a16ae4"}
Jul 27 20:34:49.149164 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:49.149135    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w7ctn"
Jul 27 20:34:49.149260 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:49.149245    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 27 20:34:49.149766 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:49.149747    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w7ctn"
Jul 27 20:34:49.863769 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:49.863735    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:49.863953 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:49.863858    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8rhb" podUID="28e5f501-0964-4435-b714-b53d1985c224"
Jul 27 20:34:50.868030 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:50.867366    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:50.868030 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:50.867514    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hxvx" podUID="97208f7a-c966-4a7f-abee-d5732ca900c9"
Jul 27 20:34:50.868030 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:50.868023    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:50.868660 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:50.868634    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4z4nt" podUID="d1006199-a395-4fef-b9a5-7abe2931fd07"
Jul 27 20:34:51.111915 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:51.111886    2562 generic.go:356] "Generic (PLEG): container finished" podID="9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad" containerID="b03a1df16733fb2ff2024a8c5c75f465ad53587bae0e0a57fc7552f2ccadc62e" exitCode=0
Jul 27 20:34:51.112068 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:51.111921    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmgkx" event={"ID":"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad","Type":"ContainerDied","Data":"b03a1df16733fb2ff2024a8c5c75f465ad53587bae0e0a57fc7552f2ccadc62e"}
Jul 27 20:34:51.863803 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:51.863770    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:51.863951 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:51.863865    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s8rhb" podUID="28e5f501-0964-4435-b714-b53d1985c224"
Jul 27 20:34:52.867400 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:52.867373    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:52.867813 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:52.867376    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:52.867813 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:52.867472    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4z4nt" podUID="d1006199-a395-4fef-b9a5-7abe2931fd07"
Jul 27 20:34:52.867813 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:52.867569    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hxvx" podUID="97208f7a-c966-4a7f-abee-d5732ca900c9"
Jul 27 20:34:53.519436 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.519399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs\") pod \"network-metrics-daemon-s8rhb\" (UID: \"28e5f501-0964-4435-b714-b53d1985c224\") " pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:53.519436 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.519441    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret\") pod \"global-pull-secret-syncer-4z4nt\" (UID: \"d1006199-a395-4fef-b9a5-7abe2931fd07\") " pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:53.519680 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:53.519539    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:34:53.519680 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:53.519555    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:34:53.519680 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:53.519593    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret podName:d1006199-a395-4fef-b9a5-7abe2931fd07 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:25.519575416 +0000 UTC m=+65.159791834 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret") pod "global-pull-secret-syncer-4z4nt" (UID: "d1006199-a395-4fef-b9a5-7abe2931fd07") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:34:53.519680 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:53.519613    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs podName:28e5f501-0964-4435-b714-b53d1985c224 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:25.519603057 +0000 UTC m=+65.159819477 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs") pod "network-metrics-daemon-s8rhb" (UID: "28e5f501-0964-4435-b714-b53d1985c224") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:34:53.620678 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.620598    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8tdl\" (UniqueName: \"kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl\") pod \"network-check-target-2hxvx\" (UID: \"97208f7a-c966-4a7f-abee-d5732ca900c9\") " pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:53.620843 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:53.620778    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:34:53.620843 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:53.620802    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:34:53.620843 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:53.620814    2562 projected.go:196] Error preparing data for projected volume kube-api-access-r8tdl for pod openshift-network-diagnostics/network-check-target-2hxvx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:34:53.620990 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:53.620887    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl podName:97208f7a-c966-4a7f-abee-d5732ca900c9 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:25.620858353 +0000 UTC m=+65.261074788 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8tdl" (UniqueName: "kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl") pod "network-check-target-2hxvx" (UID: "97208f7a-c966-4a7f-abee-d5732ca900c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:34:53.716252 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.715942    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeReady"
Jul 27 20:34:53.716252 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.716099    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 20:34:53.751543 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.751499    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75674f955c-kp8sl"]
Jul 27 20:34:53.765322 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.765006    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:53.766756 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.765924    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6rjrr"]
Jul 27 20:34:53.767346 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.767308    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 20:34:53.767687 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.767513    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8k9nx\""
Jul 27 20:34:53.767687 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.767678    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 20:34:53.768018 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.767998    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 20:34:53.768426 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.768406    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75674f955c-kp8sl"]
Jul 27 20:34:53.768525 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.768442    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gb2sz"]
Jul 27 20:34:53.768525 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.768486    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:34:53.770779 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.770763    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gb2sz"
Jul 27 20:34:53.771285 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.771245    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 20:34:53.771680 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.771662    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hgqwx\""
Jul 27 20:34:53.771767 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.771728    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 20:34:53.772802 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.772777    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 20:34:53.773207 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.773047    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 20:34:53.773712 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.773373    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 20:34:53.773712 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.773470    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mlcnn\""
Jul 27 20:34:53.774188 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.774161    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 20:34:53.778495 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.778474    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6rjrr"]
Jul 27 20:34:53.781359 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.781339    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gb2sz"]
Jul 27 20:34:53.863223 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.863191    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:34:53.865659 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.865636    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kqrvq\""
Jul 27 20:34:53.865788 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.865681    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:34:53.923399 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.923332    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-certificates\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:53.923399 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.923377    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cc698af-ec70-45f5-8212-2ae3213eaf83-installation-pull-secrets\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:53.923812 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.923427    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c2578b4-d3fa-4263-a604-3800a3e85f49-tmp-dir\") pod \"dns-default-6rjrr\" (UID: \"2c2578b4-d3fa-4263-a604-3800a3e85f49\") " pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:34:53.923812 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.923454    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swp2v\" (UniqueName: \"kubernetes.io/projected/2c2578b4-d3fa-4263-a604-3800a3e85f49-kube-api-access-swp2v\") pod \"dns-default-6rjrr\" (UID: \"2c2578b4-d3fa-4263-a604-3800a3e85f49\") " pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:34:53.923812 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.923477    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2twlw\" (UniqueName: \"kubernetes.io/projected/e7eade65-21e0-49d0-9f9b-cd7400161efb-kube-api-access-2twlw\") pod \"ingress-canary-gb2sz\" (UID: \"e7eade65-21e0-49d0-9f9b-cd7400161efb\") " pod="openshift-ingress-canary/ingress-canary-gb2sz"
Jul 27 20:34:53.923812 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.923506    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:53.923812 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.923529    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls\") pod \"dns-default-6rjrr\" (UID: \"2c2578b4-d3fa-4263-a604-3800a3e85f49\") " pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:34:53.923812 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.923564    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-bound-sa-token\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:53.923812 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.923620    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cc698af-ec70-45f5-8212-2ae3213eaf83-trusted-ca\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:53.923812 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.923680    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2c2578b4-d3fa-4263-a604-3800a3e85f49-config-volume\") pod \"dns-default-6rjrr\" (UID: \"2c2578b4-d3fa-4263-a604-3800a3e85f49\") " pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:34:53.923812 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.923723    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cc698af-ec70-45f5-8212-2ae3213eaf83-ca-trust-extracted\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:53.923812 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.923763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cc698af-ec70-45f5-8212-2ae3213eaf83-image-registry-private-configuration\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:53.923812 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.923804    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn7vp\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-kube-api-access-qn7vp\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:53.924184 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:53.923835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7eade65-21e0-49d0-9f9b-cd7400161efb-cert\") pod \"ingress-canary-gb2sz\" (UID: \"e7eade65-21e0-49d0-9f9b-cd7400161efb\") " pod="openshift-ingress-canary/ingress-canary-gb2sz"
Jul 27 20:34:54.024776 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.024726    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-bound-sa-token\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:54.024955 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.024783    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cc698af-ec70-45f5-8212-2ae3213eaf83-trusted-ca\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:54.024955 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.024820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2c2578b4-d3fa-4263-a604-3800a3e85f49-config-volume\") pod \"dns-default-6rjrr\" (UID: \"2c2578b4-d3fa-4263-a604-3800a3e85f49\") " pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:34:54.024955 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.024846    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cc698af-ec70-45f5-8212-2ae3213eaf83-ca-trust-extracted\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:54.024955 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.024877    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cc698af-ec70-45f5-8212-2ae3213eaf83-image-registry-private-configuration\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:54.024955 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.024902    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn7vp\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-kube-api-access-qn7vp\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:54.024955 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.024942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7eade65-21e0-49d0-9f9b-cd7400161efb-cert\") pod \"ingress-canary-gb2sz\" (UID: \"e7eade65-21e0-49d0-9f9b-cd7400161efb\") " pod="openshift-ingress-canary/ingress-canary-gb2sz"
Jul 27 20:34:54.025300 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.024987    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-certificates\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:54.025300 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.025009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cc698af-ec70-45f5-8212-2ae3213eaf83-installation-pull-secrets\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:54.025300 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.025047    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c2578b4-d3fa-4263-a604-3800a3e85f49-tmp-dir\") pod \"dns-default-6rjrr\" (UID: \"2c2578b4-d3fa-4263-a604-3800a3e85f49\") " pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:34:54.025300 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.025070    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swp2v\" (UniqueName: \"kubernetes.io/projected/2c2578b4-d3fa-4263-a604-3800a3e85f49-kube-api-access-swp2v\") pod \"dns-default-6rjrr\" (UID: \"2c2578b4-d3fa-4263-a604-3800a3e85f49\") " pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:34:54.025300 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.025095    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2twlw\" (UniqueName: \"kubernetes.io/projected/e7eade65-21e0-49d0-9f9b-cd7400161efb-kube-api-access-2twlw\") pod \"ingress-canary-gb2sz\" (UID: \"e7eade65-21e0-49d0-9f9b-cd7400161efb\") " pod="openshift-ingress-canary/ingress-canary-gb2sz"
Jul 27 20:34:54.025300 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.025125    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:54.025300 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.025149    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls\") pod \"dns-default-6rjrr\" (UID: \"2c2578b4-d3fa-4263-a604-3800a3e85f49\") " pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:34:54.025300 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:54.025252    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:34:54.025674 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:54.025340    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls podName:2c2578b4-d3fa-4263-a604-3800a3e85f49 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:54.525316923 +0000 UTC m=+34.165533352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls") pod "dns-default-6rjrr" (UID: "2c2578b4-d3fa-4263-a604-3800a3e85f49") : secret "dns-default-metrics-tls" not found
Jul 27 20:34:54.025674 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:54.025667    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:34:54.025785 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:54.025684    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75674f955c-kp8sl: secret "image-registry-tls" not found
Jul 27 20:34:54.025785 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:54.025737    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls podName:0cc698af-ec70-45f5-8212-2ae3213eaf83 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:54.525720211 +0000 UTC m=+34.165936634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls") pod "image-registry-75674f955c-kp8sl" (UID: "0cc698af-ec70-45f5-8212-2ae3213eaf83") : secret "image-registry-tls" not found
Jul 27 20:34:54.025785 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.025755    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cc698af-ec70-45f5-8212-2ae3213eaf83-ca-trust-extracted\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:54.025931 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.025818    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2c2578b4-d3fa-4263-a604-3800a3e85f49-config-volume\") pod \"dns-default-6rjrr\" (UID: \"2c2578b4-d3fa-4263-a604-3800a3e85f49\") " pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:34:54.025931 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.025913    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cc698af-ec70-45f5-8212-2ae3213eaf83-trusted-ca\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:54.026154 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.026120    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c2578b4-d3fa-4263-a604-3800a3e85f49-tmp-dir\") pod \"dns-default-6rjrr\" (UID: \"2c2578b4-d3fa-4263-a604-3800a3e85f49\") " pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:34:54.026373 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.026341    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-certificates\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:54.030039 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.030018    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cc698af-ec70-45f5-8212-2ae3213eaf83-installation-pull-secrets\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:54.030148 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.030040    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7eade65-21e0-49d0-9f9b-cd7400161efb-cert\") pod \"ingress-canary-gb2sz\" (UID: \"e7eade65-21e0-49d0-9f9b-cd7400161efb\") " pod="openshift-ingress-canary/ingress-canary-gb2sz"
Jul 27 20:34:54.030148 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.030117    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cc698af-ec70-45f5-8212-2ae3213eaf83-image-registry-private-configuration\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:54.035743 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.035701    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2twlw\" (UniqueName: \"kubernetes.io/projected/e7eade65-21e0-49d0-9f9b-cd7400161efb-kube-api-access-2twlw\") pod \"ingress-canary-gb2sz\" (UID: \"e7eade65-21e0-49d0-9f9b-cd7400161efb\") " pod="openshift-ingress-canary/ingress-canary-gb2sz"
Jul 27 20:34:54.035866 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.035836    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn7vp\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-kube-api-access-qn7vp\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:54.036519 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.036496    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swp2v\" (UniqueName: \"kubernetes.io/projected/2c2578b4-d3fa-4263-a604-3800a3e85f49-kube-api-access-swp2v\") pod \"dns-default-6rjrr\" (UID: \"2c2578b4-d3fa-4263-a604-3800a3e85f49\") " pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:34:54.036848 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.036832    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-bound-sa-token\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:54.095164 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.095130    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gb2sz"
Jul 27 20:34:54.529166 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.528944    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:54.529353 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.529180    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls\") pod \"dns-default-6rjrr\" (UID: \"2c2578b4-d3fa-4263-a604-3800a3e85f49\") " pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:34:54.529353 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:54.529100    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:34:54.529353 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:54.529246    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75674f955c-kp8sl: secret "image-registry-tls" not found
Jul 27 20:34:54.529353 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:54.529319    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:34:54.529353 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:54.529328    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls podName:0cc698af-ec70-45f5-8212-2ae3213eaf83 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:55.529308804 +0000 UTC m=+35.169525226 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls") pod "image-registry-75674f955c-kp8sl" (UID: "0cc698af-ec70-45f5-8212-2ae3213eaf83") : secret "image-registry-tls" not found
Jul 27 20:34:54.529598 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:54.529368    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls podName:2c2578b4-d3fa-4263-a604-3800a3e85f49 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:55.529352767 +0000 UTC m=+35.169569190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls") pod "dns-default-6rjrr" (UID: "2c2578b4-d3fa-4263-a604-3800a3e85f49") : secret "dns-default-metrics-tls" not found
Jul 27 20:34:54.863685 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.863650    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:34:54.863854 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.863651    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:34:54.866177 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.866158    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:34:54.866319 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.866156    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 20:34:54.867230 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.867193    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pl2wx\""
Jul 27 20:34:54.867347 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:54.867229    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 20:34:55.135490 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:55.135464    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gb2sz"]
Jul 27 20:34:55.139444 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:34:55.139417    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7eade65_21e0_49d0_9f9b_cd7400161efb.slice/crio-7baa30491ea23ebde728ca8a3a63222de8eac5b1f316dfd7de9f97bbc6c94b01 WatchSource:0}: Error finding container 7baa30491ea23ebde728ca8a3a63222de8eac5b1f316dfd7de9f97bbc6c94b01: Status 404 returned error can't find the container with id 7baa30491ea23ebde728ca8a3a63222de8eac5b1f316dfd7de9f97bbc6c94b01
Jul 27 20:34:55.536804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:55.536725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:55.536804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:55.536761    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls\") pod \"dns-default-6rjrr\" (UID: \"2c2578b4-d3fa-4263-a604-3800a3e85f49\") " pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:34:55.536981 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:55.536869    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:34:55.536981 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:55.536874    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:34:55.536981 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:55.536889    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75674f955c-kp8sl: secret "image-registry-tls" not found
Jul 27 20:34:55.536981 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:55.536933    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls podName:2c2578b4-d3fa-4263-a604-3800a3e85f49 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:57.536915593 +0000 UTC m=+37.177132023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls") pod "dns-default-6rjrr" (UID: "2c2578b4-d3fa-4263-a604-3800a3e85f49") : secret "dns-default-metrics-tls" not found
Jul 27 20:34:55.536981 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:55.536947    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls podName:0cc698af-ec70-45f5-8212-2ae3213eaf83 nodeName:}" failed. No retries permitted until 2026-07-27 20:34:57.536941472 +0000 UTC m=+37.177157889 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls") pod "image-registry-75674f955c-kp8sl" (UID: "0cc698af-ec70-45f5-8212-2ae3213eaf83") : secret "image-registry-tls" not found
Jul 27 20:34:56.126362 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:56.126325    2562 generic.go:356] "Generic (PLEG): container finished" podID="9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad" containerID="815e32d60cefdfbfdf8b37683d2efd473570d8fc012d797f6ba601d0f0b0f960" exitCode=0
Jul 27 20:34:56.126550 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:56.126407    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmgkx" event={"ID":"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad","Type":"ContainerDied","Data":"815e32d60cefdfbfdf8b37683d2efd473570d8fc012d797f6ba601d0f0b0f960"}
Jul 27 20:34:56.127802 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:56.127775    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gb2sz" event={"ID":"e7eade65-21e0-49d0-9f9b-cd7400161efb","Type":"ContainerStarted","Data":"7baa30491ea23ebde728ca8a3a63222de8eac5b1f316dfd7de9f97bbc6c94b01"}
Jul 27 20:34:57.132817 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:57.132790    2562 generic.go:356] "Generic (PLEG): container finished" podID="9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad" containerID="55ffab7c803788303c72d31ff70af64c0fc1592d0dbf1e7a85d62db0b15a8228" exitCode=0
Jul 27 20:34:57.133259 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:57.132851    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmgkx" event={"ID":"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad","Type":"ContainerDied","Data":"55ffab7c803788303c72d31ff70af64c0fc1592d0dbf1e7a85d62db0b15a8228"}
Jul 27 20:34:57.552492 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:57.552378    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:34:57.552492 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:57.552418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls\") pod \"dns-default-6rjrr\" (UID: \"2c2578b4-d3fa-4263-a604-3800a3e85f49\") " pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:34:57.552731 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:57.552556    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:34:57.552731 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:57.552621    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls podName:2c2578b4-d3fa-4263-a604-3800a3e85f49 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:01.552601859 +0000 UTC m=+41.192818275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls") pod "dns-default-6rjrr" (UID: "2c2578b4-d3fa-4263-a604-3800a3e85f49") : secret "dns-default-metrics-tls" not found
Jul 27 20:34:57.553095 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:57.552986    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:34:57.553095 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:57.553009    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75674f955c-kp8sl: secret "image-registry-tls" not found
Jul 27 20:34:57.553095 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:34:57.553064    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls podName:0cc698af-ec70-45f5-8212-2ae3213eaf83 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:01.553047389 +0000 UTC m=+41.193263825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls") pod "image-registry-75674f955c-kp8sl" (UID: "0cc698af-ec70-45f5-8212-2ae3213eaf83") : secret "image-registry-tls" not found
Jul 27 20:34:58.139680 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:58.139644    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmgkx" event={"ID":"9602f4d4-e0d1-48fb-99cb-1e133c5fc4ad","Type":"ContainerStarted","Data":"35fc6aa298b13c07224c27e8ec36731674ca14b99d0e79b5aa8d783ad1b4eabf"}
Jul 27 20:34:58.142058 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:58.141979    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gb2sz" event={"ID":"e7eade65-21e0-49d0-9f9b-cd7400161efb","Type":"ContainerStarted","Data":"c806a25db5e1e2c11c58d1229dff881f248a49ebfbbd0b9b91d4caa87825bd24"}
Jul 27 20:34:58.163347 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:58.163290    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kmgkx" podStartSLOduration=7.836939054 podStartE2EDuration="37.163241804s" totalImagesPullingTime="29.32630275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:58.162087571 +0000 UTC m=+37.802304011" watchObservedRunningTime="2026-07-27 20:34:58.163241804 +0000 UTC m=+37.803458242"
Jul 27 20:34:58.176425 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:58.176373    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gb2sz" podStartSLOduration=2.376614288 podStartE2EDuration="5.176357875s" totalImagesPullingTime="2.799743587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:34:58.175531255 +0000 UTC m=+37.815747714" watchObservedRunningTime="2026-07-27 20:34:58.176357875 +0000 UTC m=+37.816574313"
Jul 27 20:34:58.277816 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:58.277787    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:34:58.363653 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:58.363623    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:34:58.750295 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:34:58.750246    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:01.585709 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:01.585669    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:35:01.585709 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:01.585712    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls\") pod \"dns-default-6rjrr\" (UID: \"2c2578b4-d3fa-4263-a604-3800a3e85f49\") " pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:35:01.586254 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:01.585818    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:35:01.586254 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:01.585828    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:35:01.586254 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:01.585837    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75674f955c-kp8sl: secret "image-registry-tls" not found
Jul 27 20:35:01.586254 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:01.585889    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls podName:0cc698af-ec70-45f5-8212-2ae3213eaf83 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:09.585873836 +0000 UTC m=+49.226090253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls") pod "image-registry-75674f955c-kp8sl" (UID: "0cc698af-ec70-45f5-8212-2ae3213eaf83") : secret "image-registry-tls" not found
Jul 27 20:35:01.586254 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:01.585930    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls podName:2c2578b4-d3fa-4263-a604-3800a3e85f49 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:09.585914232 +0000 UTC m=+49.226130661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls") pod "dns-default-6rjrr" (UID: "2c2578b4-d3fa-4263-a604-3800a3e85f49") : secret "dns-default-metrics-tls" not found
Jul 27 20:35:02.528781 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:02.528747    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:02.628891 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:02.628858    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:02.728046 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:02.728011    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:02.792042 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:02.791973    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:02.867756 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:02.867723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:02.965812 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:02.965777    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:03.052814 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.052740    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gc2v7"]
Jul 27 20:35:03.082735 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.082705    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm"]
Jul 27 20:35:03.082874 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.082811    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gc2v7"
Jul 27 20:35:03.085655 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.085636    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 27 20:35:03.085799 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.085754    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6j6jl\""
Jul 27 20:35:03.086050 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.086030    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:35:03.102647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.102615    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm"
Jul 27 20:35:03.102647 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.102639    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gc2v7"]
Jul 27 20:35:03.102768 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.102680    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"]
Jul 27 20:35:03.106446 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.106425    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 27 20:35:03.107265 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.107242    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 27 20:35:03.107413 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.107385    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gdqp8\""
Jul 27 20:35:03.107413 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.107400    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:35:03.107841 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.107828    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 27 20:35:03.128769 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.128744    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-tnq84"]
Jul 27 20:35:03.128874 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.128858    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"
Jul 27 20:35:03.131598 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.131580    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 27 20:35:03.131598 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.131596    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 20:35:03.131851 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.131835    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 20:35:03.132833 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.132816    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t7c5q\""
Jul 27 20:35:03.132905 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.132891    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 27 20:35:03.152907 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.152890    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm"]
Jul 27 20:35:03.153005 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.152923    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"]
Jul 27 20:35:03.153005 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.152942    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-tnq84"]
Jul 27 20:35:03.153103 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.153031    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.155883 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.155829    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 20:35:03.155988 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.155849    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 27 20:35:03.156052 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.155988    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 20:35:03.156236 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.156222    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 27 20:35:03.156329 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.156316    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dwzcd\""
Jul 27 20:35:03.156697 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.156674    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-hspwk"]
Jul 27 20:35:03.163687 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.163668    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 27 20:35:03.173025 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.172988    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-bdpxl"]
Jul 27 20:35:03.173187 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.173171    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-hspwk"
Jul 27 20:35:03.175771 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.175750    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-f6p2p\""
Jul 27 20:35:03.187036 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.187008    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj"]
Jul 27 20:35:03.187194 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.187176    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:03.189842 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.189823    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 27 20:35:03.190053 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.190039    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ltd6n\""
Jul 27 20:35:03.190393 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.190371    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 27 20:35:03.190393 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.190381    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:35:03.190531 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.190382    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 27 20:35:03.195866 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.195846    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 27 20:35:03.200018 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.199998    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/040c8c6c-43fc-4c1a-865b-d6f74fb008ec-serving-cert\") pod \"service-ca-operator-5d6c75f84f-mwvdm\" (UID: \"040c8c6c-43fc-4c1a-865b-d6f74fb008ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm"
Jul 27 20:35:03.200127 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.200108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgvvq\" (UniqueName: \"kubernetes.io/projected/969b572a-ba5c-4ec1-b671-9d14627a4967-kube-api-access-vgvvq\") pod \"volume-data-source-validator-549c6d54cf-gc2v7\" (UID: \"969b572a-ba5c-4ec1-b671-9d14627a4967\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gc2v7"
Jul 27 20:35:03.200174 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.200151    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/040c8c6c-43fc-4c1a-865b-d6f74fb008ec-config\") pod \"service-ca-operator-5d6c75f84f-mwvdm\" (UID: \"040c8c6c-43fc-4c1a-865b-d6f74fb008ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm"
Jul 27 20:35:03.200217 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.200184    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pz68\" (UniqueName: \"kubernetes.io/projected/040c8c6c-43fc-4c1a-865b-d6f74fb008ec-kube-api-access-7pz68\") pod \"service-ca-operator-5d6c75f84f-mwvdm\" (UID: \"040c8c6c-43fc-4c1a-865b-d6f74fb008ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm"
Jul 27 20:35:03.205204 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.205187    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9"]
Jul 27 20:35:03.205317 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.205304    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj"
Jul 27 20:35:03.207624 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.207605    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ndx4b\""
Jul 27 20:35:03.207878 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.207862    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 27 20:35:03.207951 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.207896    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:35:03.208008 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.207897    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 27 20:35:03.208157 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.208142    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 27 20:35:03.229505 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.229483    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-84bfbc884c-qvrvp"]
Jul 27 20:35:03.229505 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.229488    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9"
Jul 27 20:35:03.232043 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.232025    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:35:03.232188 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.232141    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 27 20:35:03.232188 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.232162    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2p8xj\""
Jul 27 20:35:03.232319 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.232207    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 27 20:35:03.251377 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.251356    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-hspwk"]
Jul 27 20:35:03.251467 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.251387    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-bdpxl"]
Jul 27 20:35:03.251467 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.251400    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9"]
Jul 27 20:35:03.251467 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.251417    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj"]
Jul 27 20:35:03.251467 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.251430    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-84bfbc884c-qvrvp"]
Jul 27 20:35:03.251598 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.251469    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:03.253684 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.253669    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 27 20:35:03.253937 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.253919    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 27 20:35:03.254030 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.253979    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 20:35:03.254030 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.253923    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cgfst\""
Jul 27 20:35:03.254030 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.253922    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 27 20:35:03.254030 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.254005    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 20:35:03.254265 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.253931    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 27 20:35:03.300551 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.300515    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4113dabe-2d35-48f3-bb94-b377ee920246-service-ca-bundle\") pod \"insights-operator-5885fdb759-tnq84\" (UID: \"4113dabe-2d35-48f3-bb94-b377ee920246\") " pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.300551 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.300555    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-vghz8\" (UID: \"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"
Jul 27 20:35:03.300749 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.300572    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6c193d5-281f-4d93-b21a-5adedf4bf8d8-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj\" (UID: \"a6c193d5-281f-4d93-b21a-5adedf4bf8d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj"
Jul 27 20:35:03.300749 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.300590    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/efafc91f-4c5f-47e5-8350-fdf66054226c-trusted-ca\") pod \"console-operator-584dcb6b54-bdpxl\" (UID: \"efafc91f-4c5f-47e5-8350-fdf66054226c\") " pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:03.300749 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.300613    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/040c8c6c-43fc-4c1a-865b-d6f74fb008ec-serving-cert\") pod \"service-ca-operator-5d6c75f84f-mwvdm\" (UID: \"040c8c6c-43fc-4c1a-865b-d6f74fb008ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm"
Jul 27 20:35:03.300749 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.300629    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4113dabe-2d35-48f3-bb94-b377ee920246-snapshots\") pod \"insights-operator-5885fdb759-tnq84\" (UID: \"4113dabe-2d35-48f3-bb94-b377ee920246\") " pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.300749 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.300643    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4113dabe-2d35-48f3-bb94-b377ee920246-serving-cert\") pod \"insights-operator-5885fdb759-tnq84\" (UID: \"4113dabe-2d35-48f3-bb94-b377ee920246\") " pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.300749 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.300659    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwl94\" (UniqueName: \"kubernetes.io/projected/4113dabe-2d35-48f3-bb94-b377ee920246-kube-api-access-qwl94\") pod \"insights-operator-5885fdb759-tnq84\" (UID: \"4113dabe-2d35-48f3-bb94-b377ee920246\") " pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.300749 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.300721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/efafc91f-4c5f-47e5-8350-fdf66054226c-serving-cert\") pod \"console-operator-584dcb6b54-bdpxl\" (UID: \"efafc91f-4c5f-47e5-8350-fdf66054226c\") " pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:03.300989 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.300809    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2bj8\" (UniqueName: \"kubernetes.io/projected/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-kube-api-access-r2bj8\") pod \"cluster-monitoring-operator-548b489cb8-vghz8\" (UID: \"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"
Jul 27 20:35:03.300989 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.300835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46pz5\" (UniqueName: \"kubernetes.io/projected/a6c193d5-281f-4d93-b21a-5adedf4bf8d8-kube-api-access-46pz5\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj\" (UID: \"a6c193d5-281f-4d93-b21a-5adedf4bf8d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj"
Jul 27 20:35:03.300989 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.300857    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pz68\" (UniqueName: \"kubernetes.io/projected/040c8c6c-43fc-4c1a-865b-d6f74fb008ec-kube-api-access-7pz68\") pod \"service-ca-operator-5d6c75f84f-mwvdm\" (UID: \"040c8c6c-43fc-4c1a-865b-d6f74fb008ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm"
Jul 27 20:35:03.300989 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.300874    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/efafc91f-4c5f-47e5-8350-fdf66054226c-config\") pod \"console-operator-584dcb6b54-bdpxl\" (UID: \"efafc91f-4c5f-47e5-8350-fdf66054226c\") " pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:03.300989 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.300889    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-vghz8\" (UID: \"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"
Jul 27 20:35:03.300989 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.300929    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg8kg\" (UniqueName: \"kubernetes.io/projected/b4143d92-6f7e-496c-ac2d-d0bbd35c011d-kube-api-access-vg8kg\") pod \"network-check-source-7d88cb55d8-hspwk\" (UID: \"b4143d92-6f7e-496c-ac2d-d0bbd35c011d\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-hspwk"
Jul 27 20:35:03.300989 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.300956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj2lg\" (UniqueName: \"kubernetes.io/projected/efafc91f-4c5f-47e5-8350-fdf66054226c-kube-api-access-kj2lg\") pod \"console-operator-584dcb6b54-bdpxl\" (UID: \"efafc91f-4c5f-47e5-8350-fdf66054226c\") " pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:03.300989 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.300978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4113dabe-2d35-48f3-bb94-b377ee920246-tmp\") pod \"insights-operator-5885fdb759-tnq84\" (UID: \"4113dabe-2d35-48f3-bb94-b377ee920246\") " pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.301309 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.300994    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/040c8c6c-43fc-4c1a-865b-d6f74fb008ec-config\") pod \"service-ca-operator-5d6c75f84f-mwvdm\" (UID: \"040c8c6c-43fc-4c1a-865b-d6f74fb008ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm"
Jul 27 20:35:03.301309 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.301016    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4113dabe-2d35-48f3-bb94-b377ee920246-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-tnq84\" (UID: \"4113dabe-2d35-48f3-bb94-b377ee920246\") " pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.301309 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.301042    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6c193d5-281f-4d93-b21a-5adedf4bf8d8-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj\" (UID: \"a6c193d5-281f-4d93-b21a-5adedf4bf8d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj"
Jul 27 20:35:03.301309 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.301077    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgvvq\" (UniqueName: \"kubernetes.io/projected/969b572a-ba5c-4ec1-b671-9d14627a4967-kube-api-access-vgvvq\") pod \"volume-data-source-validator-549c6d54cf-gc2v7\" (UID: \"969b572a-ba5c-4ec1-b671-9d14627a4967\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gc2v7"
Jul 27 20:35:03.301583 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.301566    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/040c8c6c-43fc-4c1a-865b-d6f74fb008ec-config\") pod \"service-ca-operator-5d6c75f84f-mwvdm\" (UID: \"040c8c6c-43fc-4c1a-865b-d6f74fb008ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm"
Jul 27 20:35:03.304095 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.304053    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/040c8c6c-43fc-4c1a-865b-d6f74fb008ec-serving-cert\") pod \"service-ca-operator-5d6c75f84f-mwvdm\" (UID: \"040c8c6c-43fc-4c1a-865b-d6f74fb008ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm"
Jul 27 20:35:03.309549 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.309521    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pz68\" (UniqueName: \"kubernetes.io/projected/040c8c6c-43fc-4c1a-865b-d6f74fb008ec-kube-api-access-7pz68\") pod \"service-ca-operator-5d6c75f84f-mwvdm\" (UID: \"040c8c6c-43fc-4c1a-865b-d6f74fb008ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm"
Jul 27 20:35:03.309773 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.309752    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgvvq\" (UniqueName: \"kubernetes.io/projected/969b572a-ba5c-4ec1-b671-9d14627a4967-kube-api-access-vgvvq\") pod \"volume-data-source-validator-549c6d54cf-gc2v7\" (UID: \"969b572a-ba5c-4ec1-b671-9d14627a4967\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gc2v7"
Jul 27 20:35:03.320721 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.320689    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:03.379987 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.379942    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:03.392981 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.392957    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gc2v7"
Jul 27 20:35:03.402261 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.402240    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwl94\" (UniqueName: \"kubernetes.io/projected/4113dabe-2d35-48f3-bb94-b377ee920246-kube-api-access-qwl94\") pod \"insights-operator-5885fdb759-tnq84\" (UID: \"4113dabe-2d35-48f3-bb94-b377ee920246\") " pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.402343 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.402283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-default-certificate\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:03.402343 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.402338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/efafc91f-4c5f-47e5-8350-fdf66054226c-serving-cert\") pod \"console-operator-584dcb6b54-bdpxl\" (UID: \"efafc91f-4c5f-47e5-8350-fdf66054226c\") " pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:03.402419 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.402360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a233ebd-9e71-4709-825a-2e80a4ab50d3-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jzvk9\" (UID: \"4a233ebd-9e71-4709-825a-2e80a4ab50d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9"
Jul 27 20:35:03.402464 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.402420    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qscm2\" (UniqueName: \"kubernetes.io/projected/1a26fdaf-9d7e-4108-b8b1-f028188d2922-kube-api-access-qscm2\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:03.402464 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.402447    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2bj8\" (UniqueName: \"kubernetes.io/projected/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-kube-api-access-r2bj8\") pod \"cluster-monitoring-operator-548b489cb8-vghz8\" (UID: \"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"
Jul 27 20:35:03.402529 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.402467    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:03.402529 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.402493    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46pz5\" (UniqueName: \"kubernetes.io/projected/a6c193d5-281f-4d93-b21a-5adedf4bf8d8-kube-api-access-46pz5\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj\" (UID: \"a6c193d5-281f-4d93-b21a-5adedf4bf8d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj"
Jul 27 20:35:03.402619 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.402603    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/efafc91f-4c5f-47e5-8350-fdf66054226c-config\") pod \"console-operator-584dcb6b54-bdpxl\" (UID: \"efafc91f-4c5f-47e5-8350-fdf66054226c\") " pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:03.402683 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.402632    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-vghz8\" (UID: \"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"
Jul 27 20:35:03.402683 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.402662    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg8kg\" (UniqueName: \"kubernetes.io/projected/b4143d92-6f7e-496c-ac2d-d0bbd35c011d-kube-api-access-vg8kg\") pod \"network-check-source-7d88cb55d8-hspwk\" (UID: \"b4143d92-6f7e-496c-ac2d-d0bbd35c011d\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-hspwk"
Jul 27 20:35:03.402767 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.402700    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj2lg\" (UniqueName: \"kubernetes.io/projected/efafc91f-4c5f-47e5-8350-fdf66054226c-kube-api-access-kj2lg\") pod \"console-operator-584dcb6b54-bdpxl\" (UID: \"efafc91f-4c5f-47e5-8350-fdf66054226c\") " pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:03.402767 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.402739    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4113dabe-2d35-48f3-bb94-b377ee920246-tmp\") pod \"insights-operator-5885fdb759-tnq84\" (UID: \"4113dabe-2d35-48f3-bb94-b377ee920246\") " pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.402918 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.402894    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4113dabe-2d35-48f3-bb94-b377ee920246-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-tnq84\" (UID: \"4113dabe-2d35-48f3-bb94-b377ee920246\") " pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.402994 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.402943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txfkr\" (UniqueName: \"kubernetes.io/projected/4a233ebd-9e71-4709-825a-2e80a4ab50d3-kube-api-access-txfkr\") pod \"cluster-samples-operator-6748489656-jzvk9\" (UID: \"4a233ebd-9e71-4709-825a-2e80a4ab50d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9"
Jul 27 20:35:03.402994 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.402985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6c193d5-281f-4d93-b21a-5adedf4bf8d8-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj\" (UID: \"a6c193d5-281f-4d93-b21a-5adedf4bf8d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj"
Jul 27 20:35:03.403093 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.403015    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4113dabe-2d35-48f3-bb94-b377ee920246-service-ca-bundle\") pod \"insights-operator-5885fdb759-tnq84\" (UID: \"4113dabe-2d35-48f3-bb94-b377ee920246\") " pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.403093 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.403042    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-vghz8\" (UID: \"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"
Jul 27 20:35:03.403093 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.403046    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4113dabe-2d35-48f3-bb94-b377ee920246-tmp\") pod \"insights-operator-5885fdb759-tnq84\" (UID: \"4113dabe-2d35-48f3-bb94-b377ee920246\") " pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.403093 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.403065    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6c193d5-281f-4d93-b21a-5adedf4bf8d8-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj\" (UID: \"a6c193d5-281f-4d93-b21a-5adedf4bf8d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj"
Jul 27 20:35:03.403299 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.403094    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/efafc91f-4c5f-47e5-8350-fdf66054226c-trusted-ca\") pod \"console-operator-584dcb6b54-bdpxl\" (UID: \"efafc91f-4c5f-47e5-8350-fdf66054226c\") " pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:03.403299 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.403116    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:03.403299 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.403142    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-stats-auth\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:03.403299 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.403168    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4113dabe-2d35-48f3-bb94-b377ee920246-snapshots\") pod \"insights-operator-5885fdb759-tnq84\" (UID: \"4113dabe-2d35-48f3-bb94-b377ee920246\") " pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.403299 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.403191    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4113dabe-2d35-48f3-bb94-b377ee920246-serving-cert\") pod \"insights-operator-5885fdb759-tnq84\" (UID: \"4113dabe-2d35-48f3-bb94-b377ee920246\") " pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.403538 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.403359    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/efafc91f-4c5f-47e5-8350-fdf66054226c-config\") pod \"console-operator-584dcb6b54-bdpxl\" (UID: \"efafc91f-4c5f-47e5-8350-fdf66054226c\") " pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:03.403538 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.403519    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-vghz8\" (UID: \"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"
Jul 27 20:35:03.403641 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.403581    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4113dabe-2d35-48f3-bb94-b377ee920246-service-ca-bundle\") pod \"insights-operator-5885fdb759-tnq84\" (UID: \"4113dabe-2d35-48f3-bb94-b377ee920246\") " pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.403641 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:03.403615    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:35:03.403782 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:03.403701    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls podName:5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f nodeName:}" failed. No retries permitted until 2026-07-27 20:35:03.90368197 +0000 UTC m=+43.543898386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-vghz8" (UID: "5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:35:03.404062 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.404040    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4113dabe-2d35-48f3-bb94-b377ee920246-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-tnq84\" (UID: \"4113dabe-2d35-48f3-bb94-b377ee920246\") " pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.404163 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.404141    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/efafc91f-4c5f-47e5-8350-fdf66054226c-trusted-ca\") pod \"console-operator-584dcb6b54-bdpxl\" (UID: \"efafc91f-4c5f-47e5-8350-fdf66054226c\") " pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:03.404205 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.404153    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6c193d5-281f-4d93-b21a-5adedf4bf8d8-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj\" (UID: \"a6c193d5-281f-4d93-b21a-5adedf4bf8d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj"
Jul 27 20:35:03.404445 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.404425    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4113dabe-2d35-48f3-bb94-b377ee920246-snapshots\") pod \"insights-operator-5885fdb759-tnq84\" (UID: \"4113dabe-2d35-48f3-bb94-b377ee920246\") " pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.404991 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.404973    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/efafc91f-4c5f-47e5-8350-fdf66054226c-serving-cert\") pod \"console-operator-584dcb6b54-bdpxl\" (UID: \"efafc91f-4c5f-47e5-8350-fdf66054226c\") " pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:03.405592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.405571    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6c193d5-281f-4d93-b21a-5adedf4bf8d8-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj\" (UID: \"a6c193d5-281f-4d93-b21a-5adedf4bf8d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj"
Jul 27 20:35:03.405651 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.405637    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4113dabe-2d35-48f3-bb94-b377ee920246-serving-cert\") pod \"insights-operator-5885fdb759-tnq84\" (UID: \"4113dabe-2d35-48f3-bb94-b377ee920246\") " pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.410244 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.410223    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm"
Jul 27 20:35:03.411264 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.411242    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj2lg\" (UniqueName: \"kubernetes.io/projected/efafc91f-4c5f-47e5-8350-fdf66054226c-kube-api-access-kj2lg\") pod \"console-operator-584dcb6b54-bdpxl\" (UID: \"efafc91f-4c5f-47e5-8350-fdf66054226c\") " pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:03.411566 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.411537    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwl94\" (UniqueName: \"kubernetes.io/projected/4113dabe-2d35-48f3-bb94-b377ee920246-kube-api-access-qwl94\") pod \"insights-operator-5885fdb759-tnq84\" (UID: \"4113dabe-2d35-48f3-bb94-b377ee920246\") " pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.411674 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.411659    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46pz5\" (UniqueName: \"kubernetes.io/projected/a6c193d5-281f-4d93-b21a-5adedf4bf8d8-kube-api-access-46pz5\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj\" (UID: \"a6c193d5-281f-4d93-b21a-5adedf4bf8d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj"
Jul 27 20:35:03.412073 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.412056    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2bj8\" (UniqueName: \"kubernetes.io/projected/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-kube-api-access-r2bj8\") pod \"cluster-monitoring-operator-548b489cb8-vghz8\" (UID: \"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"
Jul 27 20:35:03.412167 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.412146    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg8kg\" (UniqueName: \"kubernetes.io/projected/b4143d92-6f7e-496c-ac2d-d0bbd35c011d-kube-api-access-vg8kg\") pod \"network-check-source-7d88cb55d8-hspwk\" (UID: \"b4143d92-6f7e-496c-ac2d-d0bbd35c011d\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-hspwk"
Jul 27 20:35:03.462069 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.462044    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-tnq84"
Jul 27 20:35:03.481807 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.481768    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-hspwk"
Jul 27 20:35:03.498008 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.497983    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:03.503981 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.503953    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txfkr\" (UniqueName: \"kubernetes.io/projected/4a233ebd-9e71-4709-825a-2e80a4ab50d3-kube-api-access-txfkr\") pod \"cluster-samples-operator-6748489656-jzvk9\" (UID: \"4a233ebd-9e71-4709-825a-2e80a4ab50d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9"
Jul 27 20:35:03.504065 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.504031    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:03.504119 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:03.504103    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:35:03.504177 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:03.504166    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs podName:1a26fdaf-9d7e-4108-b8b1-f028188d2922 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:04.004148156 +0000 UTC m=+43.644364587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs") pod "router-default-84bfbc884c-qvrvp" (UID: "1a26fdaf-9d7e-4108-b8b1-f028188d2922") : secret "router-metrics-certs-default" not found
Jul 27 20:35:03.504264 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.504241    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-stats-auth\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:03.504718 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.504339    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-default-certificate\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:03.504718 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.504400    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a233ebd-9e71-4709-825a-2e80a4ab50d3-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jzvk9\" (UID: \"4a233ebd-9e71-4709-825a-2e80a4ab50d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9"
Jul 27 20:35:03.504718 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.504443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qscm2\" (UniqueName: \"kubernetes.io/projected/1a26fdaf-9d7e-4108-b8b1-f028188d2922-kube-api-access-qscm2\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:03.504718 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.504491    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:03.504718 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:03.504535    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 20:35:03.504718 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:03.504599    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a233ebd-9e71-4709-825a-2e80a4ab50d3-samples-operator-tls podName:4a233ebd-9e71-4709-825a-2e80a4ab50d3 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:04.004582016 +0000 UTC m=+43.644798438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4a233ebd-9e71-4709-825a-2e80a4ab50d3-samples-operator-tls") pod "cluster-samples-operator-6748489656-jzvk9" (UID: "4a233ebd-9e71-4709-825a-2e80a4ab50d3") : secret "samples-operator-tls" not found
Jul 27 20:35:03.504718 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:03.504687    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle podName:1a26fdaf-9d7e-4108-b8b1-f028188d2922 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:04.004670318 +0000 UTC m=+43.644886758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle") pod "router-default-84bfbc884c-qvrvp" (UID: "1a26fdaf-9d7e-4108-b8b1-f028188d2922") : configmap references non-existent config key: service-ca.crt
Jul 27 20:35:03.507073 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.507052    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-stats-auth\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:03.507135 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.507087    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-default-certificate\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:03.512907 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.512858    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj"
Jul 27 20:35:03.516372 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.516348    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txfkr\" (UniqueName: \"kubernetes.io/projected/4a233ebd-9e71-4709-825a-2e80a4ab50d3-kube-api-access-txfkr\") pod \"cluster-samples-operator-6748489656-jzvk9\" (UID: \"4a233ebd-9e71-4709-825a-2e80a4ab50d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9"
Jul 27 20:35:03.516372 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.516367    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qscm2\" (UniqueName: \"kubernetes.io/projected/1a26fdaf-9d7e-4108-b8b1-f028188d2922-kube-api-access-qscm2\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:03.562285 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.562230    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gc2v7"]
Jul 27 20:35:03.637055 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.636952    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:03.655369 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.655173    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm"]
Jul 27 20:35:03.660732 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:35:03.660684    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040c8c6c_43fc_4c1a_865b_d6f74fb008ec.slice/crio-2a68db6d6ebc55a30b38c8ad7fcf31c36a4534663523e70e94b9580aae067a58 WatchSource:0}: Error finding container 2a68db6d6ebc55a30b38c8ad7fcf31c36a4534663523e70e94b9580aae067a58: Status 404 returned error can't find the container with id 2a68db6d6ebc55a30b38c8ad7fcf31c36a4534663523e70e94b9580aae067a58
Jul 27 20:35:03.684143 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.684117    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-tnq84"]
Jul 27 20:35:03.689870 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:35:03.689835    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4113dabe_2d35_48f3_bb94_b377ee920246.slice/crio-15f9cd433be77ffa272235d0d9e1326ef9c5bb6add4b6f60963233e89483cb38 WatchSource:0}: Error finding container 15f9cd433be77ffa272235d0d9e1326ef9c5bb6add4b6f60963233e89483cb38: Status 404 returned error can't find the container with id 15f9cd433be77ffa272235d0d9e1326ef9c5bb6add4b6f60963233e89483cb38
Jul 27 20:35:03.694822 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.694660    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:03.711917 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.711849    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-hspwk"]
Jul 27 20:35:03.715747 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:35:03.715720    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4143d92_6f7e_496c_ac2d_d0bbd35c011d.slice/crio-8fb1c4754028956349921027f795dd51f866a760004d004fa475144701738e0f WatchSource:0}: Error finding container 8fb1c4754028956349921027f795dd51f866a760004d004fa475144701738e0f: Status 404 returned error can't find the container with id 8fb1c4754028956349921027f795dd51f866a760004d004fa475144701738e0f
Jul 27 20:35:03.740383 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.740357    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj"]
Jul 27 20:35:03.743320 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:35:03.743287    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c193d5_281f_4d93_b21a_5adedf4bf8d8.slice/crio-40bf7ade04b521d6ddc55873bdbb5a4eea896828dce898d3409357306f71191d WatchSource:0}: Error finding container 40bf7ade04b521d6ddc55873bdbb5a4eea896828dce898d3409357306f71191d: Status 404 returned error can't find the container with id 40bf7ade04b521d6ddc55873bdbb5a4eea896828dce898d3409357306f71191d
Jul 27 20:35:03.764132 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.764112    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-bdpxl"]
Jul 27 20:35:03.766586 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:35:03.766565    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefafc91f_4c5f_47e5_8350_fdf66054226c.slice/crio-537e576e6932eb60c9d317df2d93e9a7a2ae13959dace2badf39cfbeacabd8e5 WatchSource:0}: Error finding container 537e576e6932eb60c9d317df2d93e9a7a2ae13959dace2badf39cfbeacabd8e5: Status 404 returned error can't find the container with id 537e576e6932eb60c9d317df2d93e9a7a2ae13959dace2badf39cfbeacabd8e5
Jul 27 20:35:03.912154 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:03.912127    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-vghz8\" (UID: \"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"
Jul 27 20:35:03.912352 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:03.912311    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:35:03.912414 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:03.912387    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls podName:5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f nodeName:}" failed. No retries permitted until 2026-07-27 20:35:04.912367428 +0000 UTC m=+44.552583868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-vghz8" (UID: "5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:35:04.013545 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:04.013512    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:04.013678 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:04.013572    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a233ebd-9e71-4709-825a-2e80a4ab50d3-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jzvk9\" (UID: \"4a233ebd-9e71-4709-825a-2e80a4ab50d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9"
Jul 27 20:35:04.013678 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:04.013621    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:04.013678 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:04.013666    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 20:35:04.013834 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:04.013674    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:35:04.013834 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:04.013724    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a233ebd-9e71-4709-825a-2e80a4ab50d3-samples-operator-tls podName:4a233ebd-9e71-4709-825a-2e80a4ab50d3 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:05.013710551 +0000 UTC m=+44.653926971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4a233ebd-9e71-4709-825a-2e80a4ab50d3-samples-operator-tls") pod "cluster-samples-operator-6748489656-jzvk9" (UID: "4a233ebd-9e71-4709-825a-2e80a4ab50d3") : secret "samples-operator-tls" not found
Jul 27 20:35:04.013834 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:04.013765    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs podName:1a26fdaf-9d7e-4108-b8b1-f028188d2922 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:05.013747856 +0000 UTC m=+44.653964288 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs") pod "router-default-84bfbc884c-qvrvp" (UID: "1a26fdaf-9d7e-4108-b8b1-f028188d2922") : secret "router-metrics-certs-default" not found
Jul 27 20:35:04.013834 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:04.013785    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle podName:1a26fdaf-9d7e-4108-b8b1-f028188d2922 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:05.013774043 +0000 UTC m=+44.653990462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle") pod "router-default-84bfbc884c-qvrvp" (UID: "1a26fdaf-9d7e-4108-b8b1-f028188d2922") : configmap references non-existent config key: service-ca.crt
Jul 27 20:35:04.036020 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:04.035995    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:04.140043 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:04.140010    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:04.157186 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:04.157150    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj" event={"ID":"a6c193d5-281f-4d93-b21a-5adedf4bf8d8","Type":"ContainerStarted","Data":"40bf7ade04b521d6ddc55873bdbb5a4eea896828dce898d3409357306f71191d"}
Jul 27 20:35:04.158512 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:04.158481    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-hspwk" event={"ID":"b4143d92-6f7e-496c-ac2d-d0bbd35c011d","Type":"ContainerStarted","Data":"8fb1c4754028956349921027f795dd51f866a760004d004fa475144701738e0f"}
Jul 27 20:35:04.159669 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:04.159643    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl" event={"ID":"efafc91f-4c5f-47e5-8350-fdf66054226c","Type":"ContainerStarted","Data":"537e576e6932eb60c9d317df2d93e9a7a2ae13959dace2badf39cfbeacabd8e5"}
Jul 27 20:35:04.161293 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:04.161227    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-tnq84" event={"ID":"4113dabe-2d35-48f3-bb94-b377ee920246","Type":"ContainerStarted","Data":"15f9cd433be77ffa272235d0d9e1326ef9c5bb6add4b6f60963233e89483cb38"}
Jul 27 20:35:04.162531 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:04.162470    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm" event={"ID":"040c8c6c-43fc-4c1a-865b-d6f74fb008ec","Type":"ContainerStarted","Data":"2a68db6d6ebc55a30b38c8ad7fcf31c36a4534663523e70e94b9580aae067a58"}
Jul 27 20:35:04.163582 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:04.163559    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gc2v7" event={"ID":"969b572a-ba5c-4ec1-b671-9d14627a4967","Type":"ContainerStarted","Data":"70d799542a06efec2d29424584ee7476d47784c0104ec303ef889ee098e3f80f"}
Jul 27 20:35:04.922507 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:04.922468    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-vghz8\" (UID: \"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"
Jul 27 20:35:04.923150 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:04.922816    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:35:04.923150 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:04.922885    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls podName:5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f nodeName:}" failed. No retries permitted until 2026-07-27 20:35:06.922865715 +0000 UTC m=+46.563082136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-vghz8" (UID: "5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:35:05.023454 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:05.023361    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:05.023454 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:05.023443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a233ebd-9e71-4709-825a-2e80a4ab50d3-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jzvk9\" (UID: \"4a233ebd-9e71-4709-825a-2e80a4ab50d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9"
Jul 27 20:35:05.023682 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:05.023488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:05.023738 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:05.023689    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle podName:1a26fdaf-9d7e-4108-b8b1-f028188d2922 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:07.023670817 +0000 UTC m=+46.663887235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle") pod "router-default-84bfbc884c-qvrvp" (UID: "1a26fdaf-9d7e-4108-b8b1-f028188d2922") : configmap references non-existent config key: service-ca.crt
Jul 27 20:35:05.023851 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:05.023805    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:35:05.023919 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:05.023878    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs podName:1a26fdaf-9d7e-4108-b8b1-f028188d2922 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:07.023861405 +0000 UTC m=+46.664077838 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs") pod "router-default-84bfbc884c-qvrvp" (UID: "1a26fdaf-9d7e-4108-b8b1-f028188d2922") : secret "router-metrics-certs-default" not found
Jul 27 20:35:05.023982 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:05.023947    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 20:35:05.024037 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:05.023985    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a233ebd-9e71-4709-825a-2e80a4ab50d3-samples-operator-tls podName:4a233ebd-9e71-4709-825a-2e80a4ab50d3 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:07.023973542 +0000 UTC m=+46.664189961 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4a233ebd-9e71-4709-825a-2e80a4ab50d3-samples-operator-tls") pod "cluster-samples-operator-6748489656-jzvk9" (UID: "4a233ebd-9e71-4709-825a-2e80a4ab50d3") : secret "samples-operator-tls" not found
Jul 27 20:35:06.156663 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:06.156621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:06.171433 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:06.171401    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gc2v7" event={"ID":"969b572a-ba5c-4ec1-b671-9d14627a4967","Type":"ContainerStarted","Data":"6f3022fe0596a36c0efefb4313282575168a1415d83f6c02fc290f5765f48792"}
Jul 27 20:35:06.186929 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:06.186871    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gc2v7" podStartSLOduration=1.275528235 podStartE2EDuration="3.186850965s" totalImagesPullingTime="1.91132273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:06.185628908 +0000 UTC m=+45.825845360" watchObservedRunningTime="2026-07-27 20:35:06.186850965 +0000 UTC m=+45.827067404"
Jul 27 20:35:06.261015 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:06.260983    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:06.358037 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:06.358002    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:06.773809 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:06.773772    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:06.900987 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:06.900956    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:06.943853 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:06.943823    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-vghz8\" (UID: \"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"
Jul 27 20:35:06.943976 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:06.943964    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:35:06.944031 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:06.944021    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls podName:5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f nodeName:}" failed. No retries permitted until 2026-07-27 20:35:10.944004646 +0000 UTC m=+50.584221071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-vghz8" (UID: "5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:35:07.000485 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:07.000451    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:07.044690 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:07.044618    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a233ebd-9e71-4709-825a-2e80a4ab50d3-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jzvk9\" (UID: \"4a233ebd-9e71-4709-825a-2e80a4ab50d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9"
Jul 27 20:35:07.044690 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:07.044672    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:07.044871 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:07.044780    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 20:35:07.044871 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:07.044803    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:07.044871 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:07.044836    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle podName:1a26fdaf-9d7e-4108-b8b1-f028188d2922 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:11.044816172 +0000 UTC m=+50.685032589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle") pod "router-default-84bfbc884c-qvrvp" (UID: "1a26fdaf-9d7e-4108-b8b1-f028188d2922") : configmap references non-existent config key: service-ca.crt
Jul 27 20:35:07.044871 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:07.044867    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a233ebd-9e71-4709-825a-2e80a4ab50d3-samples-operator-tls podName:4a233ebd-9e71-4709-825a-2e80a4ab50d3 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:11.044857673 +0000 UTC m=+50.685074089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4a233ebd-9e71-4709-825a-2e80a4ab50d3-samples-operator-tls") pod "cluster-samples-operator-6748489656-jzvk9" (UID: "4a233ebd-9e71-4709-825a-2e80a4ab50d3") : secret "samples-operator-tls" not found
Jul 27 20:35:07.045121 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:07.044913    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:35:07.045121 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:07.044967    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs podName:1a26fdaf-9d7e-4108-b8b1-f028188d2922 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:11.044952449 +0000 UTC m=+50.685168866 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs") pod "router-default-84bfbc884c-qvrvp" (UID: "1a26fdaf-9d7e-4108-b8b1-f028188d2922") : secret "router-metrics-certs-default" not found
Jul 27 20:35:07.102009 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:07.101952    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:07.157126 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:07.157075    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:09.666326 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:09.666289    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:35:09.666700 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:09.666433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls\") pod \"dns-default-6rjrr\" (UID: \"2c2578b4-d3fa-4263-a604-3800a3e85f49\") " pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:35:09.666700 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:09.666436    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:35:09.666700 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:09.666472    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75674f955c-kp8sl: secret "image-registry-tls" not found
Jul 27 20:35:09.666700 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:09.666483    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:35:09.666700 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:09.666529    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls podName:0cc698af-ec70-45f5-8212-2ae3213eaf83 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:25.666514113 +0000 UTC m=+65.306730535 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls") pod "image-registry-75674f955c-kp8sl" (UID: "0cc698af-ec70-45f5-8212-2ae3213eaf83") : secret "image-registry-tls" not found
Jul 27 20:35:09.666700 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:09.666543    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls podName:2c2578b4-d3fa-4263-a604-3800a3e85f49 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:25.666536725 +0000 UTC m=+65.306753142 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls") pod "dns-default-6rjrr" (UID: "2c2578b4-d3fa-4263-a604-3800a3e85f49") : secret "dns-default-metrics-tls" not found
Jul 27 20:35:10.194358 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.193998    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj" event={"ID":"a6c193d5-281f-4d93-b21a-5adedf4bf8d8","Type":"ContainerStarted","Data":"03015cc7d83c502990fb66c7b53a978c8f0a98f45cf3f7f6a7687154b6c440e7"}
Jul 27 20:35:10.195794 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.195758    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-hspwk" event={"ID":"b4143d92-6f7e-496c-ac2d-d0bbd35c011d","Type":"ContainerStarted","Data":"101975e30aca6d30a3bd7973c6f3c702fbc830adfd2ef473d4875fe59f1f7ba1"}
Jul 27 20:35:10.198369 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.198286    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl" event={"ID":"efafc91f-4c5f-47e5-8350-fdf66054226c","Type":"ContainerStarted","Data":"2d69488bf219287742ca46a78dd5994f2ba1d7949efff67370503e66f2c46e3d"}
Jul 27 20:35:10.199861 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.199058    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:10.200428 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.200311    2562 patch_prober.go:28] interesting pod/console-operator-584dcb6b54-bdpxl container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.14:8443/readyz\": dial tcp 10.132.0.14:8443: connect: connection refused" start-of-body=
Jul 27 20:35:10.200428 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.200363    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl" podUID="efafc91f-4c5f-47e5-8350-fdf66054226c" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.14:8443/readyz\": dial tcp 10.132.0.14:8443: connect: connection refused"
Jul 27 20:35:10.201475 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.201407    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm" event={"ID":"040c8c6c-43fc-4c1a-865b-d6f74fb008ec","Type":"ContainerStarted","Data":"1f28697f0aa078ce8114c9075a1dbc9a7b8ca8ca7cf8b167a17f3feea165a96e"}
Jul 27 20:35:10.218043 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.216712    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj" podStartSLOduration=0.964528482 podStartE2EDuration="7.216693389s" totalImagesPullingTime="6.252164907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:10.208938916 +0000 UTC m=+49.849155354" watchObservedRunningTime="2026-07-27 20:35:10.216693389 +0000 UTC m=+49.856909809"
Jul 27 20:35:10.218043 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.217017    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-j9njv"]
Jul 27 20:35:10.228095 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.226235    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl" podStartSLOduration=0.9970441 podStartE2EDuration="7.226216529s" totalImagesPullingTime="6.229172429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:10.225762709 +0000 UTC m=+49.865979174" watchObservedRunningTime="2026-07-27 20:35:10.226216529 +0000 UTC m=+49.866432970"
Jul 27 20:35:10.238654 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.238601    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-j9njv"]
Jul 27 20:35:10.238825 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.238740    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-j9njv"
Jul 27 20:35:10.241821 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.241771    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-hspwk" podStartSLOduration=0.961994658 podStartE2EDuration="7.24175324s" totalImagesPullingTime="6.279758582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:10.240764018 +0000 UTC m=+49.880980482" watchObservedRunningTime="2026-07-27 20:35:10.24175324 +0000 UTC m=+49.881969680"
Jul 27 20:35:10.243047 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.243008    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 27 20:35:10.247735 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.243295    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dzgwf\""
Jul 27 20:35:10.247735 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.243355    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 27 20:35:10.274519 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.272728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-j9njv\" (UID: \"b96c2f08-0f8b-49cd-8952-b2a54a65e4aa\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-j9njv"
Jul 27 20:35:10.274519 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.272825    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-j9njv\" (UID: \"b96c2f08-0f8b-49cd-8952-b2a54a65e4aa\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-j9njv"
Jul 27 20:35:10.280209 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.280147    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm" podStartSLOduration=0.947948792 podStartE2EDuration="7.280129511s" totalImagesPullingTime="6.332180719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:10.259597258 +0000 UTC m=+49.899813700" watchObservedRunningTime="2026-07-27 20:35:10.280129511 +0000 UTC m=+49.920345950"
Jul 27 20:35:10.337372 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.337326    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:10.373407 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.373376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-j9njv\" (UID: \"b96c2f08-0f8b-49cd-8952-b2a54a65e4aa\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-j9njv"
Jul 27 20:35:10.373591 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.373424    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-j9njv\" (UID: \"b96c2f08-0f8b-49cd-8952-b2a54a65e4aa\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-j9njv"
Jul 27 20:35:10.373726 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:10.373692    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:35:10.373965 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.373947    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-j9njv\" (UID: \"b96c2f08-0f8b-49cd-8952-b2a54a65e4aa\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-j9njv"
Jul 27 20:35:10.374073 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:10.374060    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-networking-console-plugin-cert podName:b96c2f08-0f8b-49cd-8952-b2a54a65e4aa nodeName:}" failed. No retries permitted until 2026-07-27 20:35:10.87376263 +0000 UTC m=+50.513979048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-j9njv" (UID: "b96c2f08-0f8b-49cd-8952-b2a54a65e4aa") : secret "networking-console-plugin-cert" not found
Jul 27 20:35:10.438429 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.438356    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:10.539911 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.539862    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:10.601207 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.601173    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:10.879337 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.879303    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-j9njv\" (UID: \"b96c2f08-0f8b-49cd-8952-b2a54a65e4aa\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-j9njv"
Jul 27 20:35:10.879781 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:10.879434    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:35:10.879781 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:10.879495    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-networking-console-plugin-cert podName:b96c2f08-0f8b-49cd-8952-b2a54a65e4aa nodeName:}" failed. No retries permitted until 2026-07-27 20:35:11.879477194 +0000 UTC m=+51.519693616 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-j9njv" (UID: "b96c2f08-0f8b-49cd-8952-b2a54a65e4aa") : secret "networking-console-plugin-cert" not found
Jul 27 20:35:10.979810 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:10.979776    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-vghz8\" (UID: \"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"
Jul 27 20:35:10.979977 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:10.979926    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:35:10.980040 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:10.979997    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls podName:5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f nodeName:}" failed. No retries permitted until 2026-07-27 20:35:18.979978056 +0000 UTC m=+58.620194474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-vghz8" (UID: "5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:35:11.080623 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.080594    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:11.080789 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.080656    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a233ebd-9e71-4709-825a-2e80a4ab50d3-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jzvk9\" (UID: \"4a233ebd-9e71-4709-825a-2e80a4ab50d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9"
Jul 27 20:35:11.080789 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.080700    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:11.080789 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:11.080733    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:35:11.080789 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:11.080790    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs podName:1a26fdaf-9d7e-4108-b8b1-f028188d2922 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:19.080771958 +0000 UTC m=+58.720988375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs") pod "router-default-84bfbc884c-qvrvp" (UID: "1a26fdaf-9d7e-4108-b8b1-f028188d2922") : secret "router-metrics-certs-default" not found
Jul 27 20:35:11.080992 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:11.080835    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 20:35:11.080992 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:11.080843    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle podName:1a26fdaf-9d7e-4108-b8b1-f028188d2922 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:19.080833356 +0000 UTC m=+58.721049785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle") pod "router-default-84bfbc884c-qvrvp" (UID: "1a26fdaf-9d7e-4108-b8b1-f028188d2922") : configmap references non-existent config key: service-ca.crt
Jul 27 20:35:11.080992 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:11.080929    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a233ebd-9e71-4709-825a-2e80a4ab50d3-samples-operator-tls podName:4a233ebd-9e71-4709-825a-2e80a4ab50d3 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:19.08091119 +0000 UTC m=+58.721127614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4a233ebd-9e71-4709-825a-2e80a4ab50d3-samples-operator-tls") pod "cluster-samples-operator-6748489656-jzvk9" (UID: "4a233ebd-9e71-4709-825a-2e80a4ab50d3") : secret "samples-operator-tls" not found
Jul 27 20:35:11.151453 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.151372    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:11.206739 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.206706    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/0.log"
Jul 27 20:35:11.206906 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.206748    2562 generic.go:356] "Generic (PLEG): container finished" podID="efafc91f-4c5f-47e5-8350-fdf66054226c" containerID="2d69488bf219287742ca46a78dd5994f2ba1d7949efff67370503e66f2c46e3d" exitCode=255
Jul 27 20:35:11.206906 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.206824    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl" event={"ID":"efafc91f-4c5f-47e5-8350-fdf66054226c","Type":"ContainerDied","Data":"2d69488bf219287742ca46a78dd5994f2ba1d7949efff67370503e66f2c46e3d"}
Jul 27 20:35:11.207108 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.207086    2562 scope.go:117] "RemoveContainer" containerID="2d69488bf219287742ca46a78dd5994f2ba1d7949efff67370503e66f2c46e3d"
Jul 27 20:35:11.208552 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.208525    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-tnq84" event={"ID":"4113dabe-2d35-48f3-bb94-b377ee920246","Type":"ContainerStarted","Data":"cce61c476349ab667aa73598f453f70de76012c8bd045c689d91ceb38346bed5"}
Jul 27 20:35:11.229615 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.229587    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:11.239651 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.239598    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-tnq84" podStartSLOduration=1.93553702 podStartE2EDuration="8.239577704s" totalImagesPullingTime="6.304040684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:11.238723038 +0000 UTC m=+50.878939501" watchObservedRunningTime="2026-07-27 20:35:11.239577704 +0000 UTC m=+50.879794143"
Jul 27 20:35:11.346941 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.346905    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pxzn9"]
Jul 27 20:35:11.369366 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.368988    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pxzn9"]
Jul 27 20:35:11.369366 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.369127    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:11.371433 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.371408    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 20:35:11.371760 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.371735    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8t4xf\""
Jul 27 20:35:11.372192 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.372169    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 20:35:11.384058 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.384034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d791f22-7d91-4ba5-8225-690d8b1d2df2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:11.384181 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.384092    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:11.384250 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.384177    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d791f22-7d91-4ba5-8225-690d8b1d2df2-crio-socket\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:11.384250 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.384205    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d791f22-7d91-4ba5-8225-690d8b1d2df2-data-volume\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:11.384367 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.384250    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtsvh\" (UniqueName: \"kubernetes.io/projected/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-api-access-gtsvh\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:11.390935 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.390328    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:11.485526 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.485460    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d791f22-7d91-4ba5-8225-690d8b1d2df2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:11.485526 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.485495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:11.485715 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:11.485583    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:35:11.485715 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:11.485604    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:35:11.485715 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:11.485633    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-rbac-proxy-cm podName:0d791f22-7d91-4ba5-8225-690d8b1d2df2 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:11.985616207 +0000 UTC m=+51.625832625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pxzn9" (UID: "0d791f22-7d91-4ba5-8225-690d8b1d2df2") : configmap "kube-rbac-proxy" not found
Jul 27 20:35:11.485715 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:11.485655    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d791f22-7d91-4ba5-8225-690d8b1d2df2-insights-runtime-extractor-tls podName:0d791f22-7d91-4ba5-8225-690d8b1d2df2 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:11.98564075 +0000 UTC m=+51.625857167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d791f22-7d91-4ba5-8225-690d8b1d2df2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pxzn9" (UID: "0d791f22-7d91-4ba5-8225-690d8b1d2df2") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:35:11.485715 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.485673    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d791f22-7d91-4ba5-8225-690d8b1d2df2-crio-socket\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:11.485715 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.485696    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d791f22-7d91-4ba5-8225-690d8b1d2df2-data-volume\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:11.485979 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.485722    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtsvh\" (UniqueName: \"kubernetes.io/projected/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-api-access-gtsvh\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:11.485979 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.485859    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d791f22-7d91-4ba5-8225-690d8b1d2df2-crio-socket\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:11.486042 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.485979    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d791f22-7d91-4ba5-8225-690d8b1d2df2-data-volume\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:11.493720 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.493695    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtsvh\" (UniqueName: \"kubernetes.io/projected/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-api-access-gtsvh\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:11.547549 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.547513    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:11.573459 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.573409    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-8mbwt"]
Jul 27 20:35:11.582592 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.582566    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8mbwt"
Jul 27 20:35:11.585188 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.585166    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 27 20:35:11.585564 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.585544    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-k6vd7\""
Jul 27 20:35:11.585899 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.585879    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 27 20:35:11.586478 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.586455    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-8mbwt"]
Jul 27 20:35:11.639145 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.639114    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:11.687513 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.687488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnwxt\" (UniqueName: \"kubernetes.io/projected/d81f303d-627e-4444-8776-f3f7a0b796a5-kube-api-access-pnwxt\") pod \"migrator-6865c9967-8mbwt\" (UID: \"d81f303d-627e-4444-8776-f3f7a0b796a5\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8mbwt"
Jul 27 20:35:11.688468 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.688442    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:11.788380 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.788294    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnwxt\" (UniqueName: \"kubernetes.io/projected/d81f303d-627e-4444-8776-f3f7a0b796a5-kube-api-access-pnwxt\") pod \"migrator-6865c9967-8mbwt\" (UID: \"d81f303d-627e-4444-8776-f3f7a0b796a5\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8mbwt"
Jul 27 20:35:11.806459 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.806435    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnwxt\" (UniqueName: \"kubernetes.io/projected/d81f303d-627e-4444-8776-f3f7a0b796a5-kube-api-access-pnwxt\") pod \"migrator-6865c9967-8mbwt\" (UID: \"d81f303d-627e-4444-8776-f3f7a0b796a5\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8mbwt"
Jul 27 20:35:11.835082 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.835051    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:11.889787 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.889757    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-j9njv\" (UID: \"b96c2f08-0f8b-49cd-8952-b2a54a65e4aa\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-j9njv"
Jul 27 20:35:11.890105 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:11.889888    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:35:11.890105 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:11.889944    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-networking-console-plugin-cert podName:b96c2f08-0f8b-49cd-8952-b2a54a65e4aa nodeName:}" failed. No retries permitted until 2026-07-27 20:35:13.889927704 +0000 UTC m=+53.530144124 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-j9njv" (UID: "b96c2f08-0f8b-49cd-8952-b2a54a65e4aa") : secret "networking-console-plugin-cert" not found
Jul 27 20:35:11.894642 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.894610    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8mbwt"
Jul 27 20:35:11.937587 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.937550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:11.990977 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.990950    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:11.991110 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:11.991086    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:35:11.991110 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:11.991096    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d791f22-7d91-4ba5-8225-690d8b1d2df2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:11.991216 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:11.991163    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-rbac-proxy-cm podName:0d791f22-7d91-4ba5-8225-690d8b1d2df2 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:12.991140958 +0000 UTC m=+52.631357387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pxzn9" (UID: "0d791f22-7d91-4ba5-8225-690d8b1d2df2") : configmap "kube-rbac-proxy" not found
Jul 27 20:35:11.991216 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:11.991187    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:35:11.991342 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:11.991225    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d791f22-7d91-4ba5-8225-690d8b1d2df2-insights-runtime-extractor-tls podName:0d791f22-7d91-4ba5-8225-690d8b1d2df2 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:12.991213303 +0000 UTC m=+52.631429719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d791f22-7d91-4ba5-8225-690d8b1d2df2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pxzn9" (UID: "0d791f22-7d91-4ba5-8225-690d8b1d2df2") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:35:12.029745 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:12.029714    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-8mbwt"]
Jul 27 20:35:12.032337 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:35:12.032314    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd81f303d_627e_4444_8776_f3f7a0b796a5.slice/crio-1324833c84a5363f1fd1c1e789ced44a7c64f0f12dd82e116ecaccef079e01be WatchSource:0}: Error finding container 1324833c84a5363f1fd1c1e789ced44a7c64f0f12dd82e116ecaccef079e01be: Status 404 returned error can't find the container with id 1324833c84a5363f1fd1c1e789ced44a7c64f0f12dd82e116ecaccef079e01be
Jul 27 20:35:12.212820 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:12.212787    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8mbwt" event={"ID":"d81f303d-627e-4444-8776-f3f7a0b796a5","Type":"ContainerStarted","Data":"1324833c84a5363f1fd1c1e789ced44a7c64f0f12dd82e116ecaccef079e01be"}
Jul 27 20:35:12.214300 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:12.214266    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 20:35:12.214659 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:12.214645    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/0.log"
Jul 27 20:35:12.214718 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:12.214677    2562 generic.go:356] "Generic (PLEG): container finished" podID="efafc91f-4c5f-47e5-8350-fdf66054226c" containerID="41d2453d2ddbc9d253f2551178a5c6a22e7d303ac4f97076beb2b009a66818bf" exitCode=255
Jul 27 20:35:12.214760 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:12.214750    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl" event={"ID":"efafc91f-4c5f-47e5-8350-fdf66054226c","Type":"ContainerDied","Data":"41d2453d2ddbc9d253f2551178a5c6a22e7d303ac4f97076beb2b009a66818bf"}
Jul 27 20:35:12.214800 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:12.214786    2562 scope.go:117] "RemoveContainer" containerID="2d69488bf219287742ca46a78dd5994f2ba1d7949efff67370503e66f2c46e3d"
Jul 27 20:35:12.215029 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:12.215007    2562 scope.go:117] "RemoveContainer" containerID="41d2453d2ddbc9d253f2551178a5c6a22e7d303ac4f97076beb2b009a66818bf"
Jul 27 20:35:12.215223 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:12.215202    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-bdpxl_openshift-console-operator(efafc91f-4c5f-47e5-8350-fdf66054226c)\"" pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl" podUID="efafc91f-4c5f-47e5-8350-fdf66054226c"
Jul 27 20:35:12.356851 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:12.356827    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r5m9z_36724fee-b20c-435b-a906-e9c098932706/dns-node-resolver/0.log"
Jul 27 20:35:13.001747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.001706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d791f22-7d91-4ba5-8225-690d8b1d2df2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:13.002202 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.001760    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:13.002202 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:13.001888    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:35:13.002202 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:13.001914    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:35:13.002202 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:13.001974    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d791f22-7d91-4ba5-8225-690d8b1d2df2-insights-runtime-extractor-tls podName:0d791f22-7d91-4ba5-8225-690d8b1d2df2 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:15.001951327 +0000 UTC m=+54.642167747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d791f22-7d91-4ba5-8225-690d8b1d2df2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pxzn9" (UID: "0d791f22-7d91-4ba5-8225-690d8b1d2df2") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:35:13.002202 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:13.001996    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-rbac-proxy-cm podName:0d791f22-7d91-4ba5-8225-690d8b1d2df2 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:15.001985721 +0000 UTC m=+54.642202153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pxzn9" (UID: "0d791f22-7d91-4ba5-8225-690d8b1d2df2") : configmap "kube-rbac-proxy" not found
Jul 27 20:35:13.219568 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.219542    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 20:35:13.219855 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.219833    2562 scope.go:117] "RemoveContainer" containerID="41d2453d2ddbc9d253f2551178a5c6a22e7d303ac4f97076beb2b009a66818bf"
Jul 27 20:35:13.219994 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:13.219976    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-bdpxl_openshift-console-operator(efafc91f-4c5f-47e5-8350-fdf66054226c)\"" pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl" podUID="efafc91f-4c5f-47e5-8350-fdf66054226c"
Jul 27 20:35:13.438463 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.438081    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-5lsfc"]
Jul 27 20:35:13.454901 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.454875    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-5lsfc"]
Jul 27 20:35:13.455029 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.454967    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-5lsfc"
Jul 27 20:35:13.457338 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.457320    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 27 20:35:13.457577 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.457561    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 27 20:35:13.457682 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.457668    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xb79c\""
Jul 27 20:35:13.457825 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.457809    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 27 20:35:13.458016 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.458000    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 27 20:35:13.499031 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.499004    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:13.507387 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.507365    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgm2x\" (UniqueName: \"kubernetes.io/projected/238a5d4e-0f4c-4bd9-ba80-c17b3013aedb-kube-api-access-bgm2x\") pod \"service-ca-658d7b7c78-5lsfc\" (UID: \"238a5d4e-0f4c-4bd9-ba80-c17b3013aedb\") " pod="openshift-service-ca/service-ca-658d7b7c78-5lsfc"
Jul 27 20:35:13.507455 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.507435    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/238a5d4e-0f4c-4bd9-ba80-c17b3013aedb-signing-key\") pod \"service-ca-658d7b7c78-5lsfc\" (UID: \"238a5d4e-0f4c-4bd9-ba80-c17b3013aedb\") " pod="openshift-service-ca/service-ca-658d7b7c78-5lsfc"
Jul 27 20:35:13.507495 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.507484    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/238a5d4e-0f4c-4bd9-ba80-c17b3013aedb-signing-cabundle\") pod \"service-ca-658d7b7c78-5lsfc\" (UID: \"238a5d4e-0f4c-4bd9-ba80-c17b3013aedb\") " pod="openshift-service-ca/service-ca-658d7b7c78-5lsfc"
Jul 27 20:35:13.608194 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.608169    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgm2x\" (UniqueName: \"kubernetes.io/projected/238a5d4e-0f4c-4bd9-ba80-c17b3013aedb-kube-api-access-bgm2x\") pod \"service-ca-658d7b7c78-5lsfc\" (UID: \"238a5d4e-0f4c-4bd9-ba80-c17b3013aedb\") " pod="openshift-service-ca/service-ca-658d7b7c78-5lsfc"
Jul 27 20:35:13.608319 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.608289    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/238a5d4e-0f4c-4bd9-ba80-c17b3013aedb-signing-key\") pod \"service-ca-658d7b7c78-5lsfc\" (UID: \"238a5d4e-0f4c-4bd9-ba80-c17b3013aedb\") " pod="openshift-service-ca/service-ca-658d7b7c78-5lsfc"
Jul 27 20:35:13.608396 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.608380    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/238a5d4e-0f4c-4bd9-ba80-c17b3013aedb-signing-cabundle\") pod \"service-ca-658d7b7c78-5lsfc\" (UID: \"238a5d4e-0f4c-4bd9-ba80-c17b3013aedb\") " pod="openshift-service-ca/service-ca-658d7b7c78-5lsfc"
Jul 27 20:35:13.609053 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.609030    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/238a5d4e-0f4c-4bd9-ba80-c17b3013aedb-signing-cabundle\") pod \"service-ca-658d7b7c78-5lsfc\" (UID: \"238a5d4e-0f4c-4bd9-ba80-c17b3013aedb\") " pod="openshift-service-ca/service-ca-658d7b7c78-5lsfc"
Jul 27 20:35:13.610498 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.610478    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/238a5d4e-0f4c-4bd9-ba80-c17b3013aedb-signing-key\") pod \"service-ca-658d7b7c78-5lsfc\" (UID: \"238a5d4e-0f4c-4bd9-ba80-c17b3013aedb\") " pod="openshift-service-ca/service-ca-658d7b7c78-5lsfc"
Jul 27 20:35:13.616414 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.616394    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgm2x\" (UniqueName: \"kubernetes.io/projected/238a5d4e-0f4c-4bd9-ba80-c17b3013aedb-kube-api-access-bgm2x\") pod \"service-ca-658d7b7c78-5lsfc\" (UID: \"238a5d4e-0f4c-4bd9-ba80-c17b3013aedb\") " pod="openshift-service-ca/service-ca-658d7b7c78-5lsfc"
Jul 27 20:35:13.642144 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.642109    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:13.697777 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.697723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:13.757187 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.757167    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wgfxv_a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48/node-ca/0.log"
Jul 27 20:35:13.764439 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.764421    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-5lsfc"
Jul 27 20:35:13.905859 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.905838    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-5lsfc"]
Jul 27 20:35:13.908037 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:35:13.908008    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod238a5d4e_0f4c_4bd9_ba80_c17b3013aedb.slice/crio-1e13ff4026f104173899c174967b63b16543d28f5eef7eac5c35f2903cf7c8fa WatchSource:0}: Error finding container 1e13ff4026f104173899c174967b63b16543d28f5eef7eac5c35f2903cf7c8fa: Status 404 returned error can't find the container with id 1e13ff4026f104173899c174967b63b16543d28f5eef7eac5c35f2903cf7c8fa
Jul 27 20:35:13.911004 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:13.910980    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-j9njv\" (UID: \"b96c2f08-0f8b-49cd-8952-b2a54a65e4aa\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-j9njv"
Jul 27 20:35:13.911166 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:13.911147    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:35:13.911243 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:13.911207    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-networking-console-plugin-cert podName:b96c2f08-0f8b-49cd-8952-b2a54a65e4aa nodeName:}" failed. No retries permitted until 2026-07-27 20:35:17.91118794 +0000 UTC m=+57.551404372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-j9njv" (UID: "b96c2f08-0f8b-49cd-8952-b2a54a65e4aa") : secret "networking-console-plugin-cert" not found
Jul 27 20:35:14.157430 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:14.157382    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gb2sz_e7eade65-21e0-49d0-9f9b-cd7400161efb/serve-healthcheck-canary/0.log"
Jul 27 20:35:14.224714 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:14.224641    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8mbwt" event={"ID":"d81f303d-627e-4444-8776-f3f7a0b796a5","Type":"ContainerStarted","Data":"e14556f7ff331e4ed24a4079237cc5e0eb3c144d458b32fcfa5f15b16023c7e9"}
Jul 27 20:35:14.224714 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:14.224701    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8mbwt" event={"ID":"d81f303d-627e-4444-8776-f3f7a0b796a5","Type":"ContainerStarted","Data":"2cc9989f34ad2317dcd93af7a64f496c7fe317a01ceec695be2bb5fd6a39207d"}
Jul 27 20:35:14.226050 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:14.226015    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-5lsfc" event={"ID":"238a5d4e-0f4c-4bd9-ba80-c17b3013aedb","Type":"ContainerStarted","Data":"755e58cefeef098233ff7abd1d37129ff8c5ddbc9cd4cc4cca2da22f72098463"}
Jul 27 20:35:14.226169 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:14.226078    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-5lsfc" event={"ID":"238a5d4e-0f4c-4bd9-ba80-c17b3013aedb","Type":"ContainerStarted","Data":"1e13ff4026f104173899c174967b63b16543d28f5eef7eac5c35f2903cf7c8fa"}
Jul 27 20:35:14.226315 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:14.226300    2562 scope.go:117] "RemoveContainer" containerID="41d2453d2ddbc9d253f2551178a5c6a22e7d303ac4f97076beb2b009a66818bf"
Jul 27 20:35:14.226467 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:14.226450    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-bdpxl_openshift-console-operator(efafc91f-4c5f-47e5-8350-fdf66054226c)\"" pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl" podUID="efafc91f-4c5f-47e5-8350-fdf66054226c"
Jul 27 20:35:14.243041 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:14.243004    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8mbwt" podStartSLOduration=1.763786702 podStartE2EDuration="3.24299182s" totalImagesPullingTime="1.479205118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:14.242979335 +0000 UTC m=+53.883195797" watchObservedRunningTime="2026-07-27 20:35:14.24299182 +0000 UTC m=+53.883208257"
Jul 27 20:35:14.257833 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:14.257796    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-5lsfc" podStartSLOduration=1.257784017 podStartE2EDuration="1.257784017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:14.257426634 +0000 UTC m=+53.897643072" watchObservedRunningTime="2026-07-27 20:35:14.257784017 +0000 UTC m=+53.898000456"
Jul 27 20:35:14.375447 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:14.375413    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:15.023030 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:15.022997    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d791f22-7d91-4ba5-8225-690d8b1d2df2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:15.023030 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:15.023044    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:15.023377 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:15.023144    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:35:15.023377 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:15.023187    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:35:15.023377 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:15.023218    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d791f22-7d91-4ba5-8225-690d8b1d2df2-insights-runtime-extractor-tls podName:0d791f22-7d91-4ba5-8225-690d8b1d2df2 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:19.023200684 +0000 UTC m=+58.663417107 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d791f22-7d91-4ba5-8225-690d8b1d2df2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pxzn9" (UID: "0d791f22-7d91-4ba5-8225-690d8b1d2df2") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:35:15.023377 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:15.023294    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-rbac-proxy-cm podName:0d791f22-7d91-4ba5-8225-690d8b1d2df2 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:19.023267578 +0000 UTC m=+58.663484008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pxzn9" (UID: "0d791f22-7d91-4ba5-8225-690d8b1d2df2") : configmap "kube-rbac-proxy" not found
Jul 27 20:35:15.224431 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:15.224385    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:15.325673 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:15.325609    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:15.382977 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:15.382908    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:15.537594 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:15.537560    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:15.638640 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:15.638556    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:15.862599 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:15.862564    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:16.026907 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:16.026821    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:16.326758 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:16.326727    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:17.146036 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:17.145995    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:17.391207 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:17.391174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:17.724371 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:17.724335    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:17.923409 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:17.923375    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:17.953060 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:17.953025    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-j9njv\" (UID: \"b96c2f08-0f8b-49cd-8952-b2a54a65e4aa\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-j9njv"
Jul 27 20:35:17.953229 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:17.953152    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 20:35:17.953229 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:17.953219    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-networking-console-plugin-cert podName:b96c2f08-0f8b-49cd-8952-b2a54a65e4aa nodeName:}" failed. No retries permitted until 2026-07-27 20:35:25.953201456 +0000 UTC m=+65.593417874 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-j9njv" (UID: "b96c2f08-0f8b-49cd-8952-b2a54a65e4aa") : secret "networking-console-plugin-cert" not found
Jul 27 20:35:18.122469 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:18.122430    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:18.521391 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:18.521315    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:18.919396 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:18.919363    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:19.061940 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:19.061908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d791f22-7d91-4ba5-8225-690d8b1d2df2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:19.062126 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:19.061947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:19.062126 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:19.062029    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:35:19.062126 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:19.062063    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:35:19.062126 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:19.062092    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-rbac-proxy-cm podName:0d791f22-7d91-4ba5-8225-690d8b1d2df2 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:27.062075647 +0000 UTC m=+66.702292082 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pxzn9" (UID: "0d791f22-7d91-4ba5-8225-690d8b1d2df2") : configmap "kube-rbac-proxy" not found
Jul 27 20:35:19.062126 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:19.062110    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d791f22-7d91-4ba5-8225-690d8b1d2df2-insights-runtime-extractor-tls podName:0d791f22-7d91-4ba5-8225-690d8b1d2df2 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:27.062098094 +0000 UTC m=+66.702314511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d791f22-7d91-4ba5-8225-690d8b1d2df2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pxzn9" (UID: "0d791f22-7d91-4ba5-8225-690d8b1d2df2") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:35:19.062409 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:19.062128    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-vghz8\" (UID: \"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"
Jul 27 20:35:19.062409 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:19.062306    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:35:19.062409 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:19.062367    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls podName:5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f nodeName:}" failed. No retries permitted until 2026-07-27 20:35:35.062351455 +0000 UTC m=+74.702567888 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-vghz8" (UID: "5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:35:19.117860 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:19.117837    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fphdr"
Jul 27 20:35:19.124219 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:19.124193    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:19.162822 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:19.162796    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:19.162991 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:19.162960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:19.162991 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:19.162976    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle podName:1a26fdaf-9d7e-4108-b8b1-f028188d2922 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:35.162957519 +0000 UTC m=+74.803173957 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle") pod "router-default-84bfbc884c-qvrvp" (UID: "1a26fdaf-9d7e-4108-b8b1-f028188d2922") : configmap references non-existent config key: service-ca.crt
Jul 27 20:35:19.163108 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:19.163053    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:35:19.163108 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:19.163067    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a233ebd-9e71-4709-825a-2e80a4ab50d3-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jzvk9\" (UID: \"4a233ebd-9e71-4709-825a-2e80a4ab50d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9"
Jul 27 20:35:19.163108 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:19.163087    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs podName:1a26fdaf-9d7e-4108-b8b1-f028188d2922 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:35.163076707 +0000 UTC m=+74.803293335 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs") pod "router-default-84bfbc884c-qvrvp" (UID: "1a26fdaf-9d7e-4108-b8b1-f028188d2922") : secret "router-metrics-certs-default" not found
Jul 27 20:35:19.165397 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:19.165370    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a233ebd-9e71-4709-825a-2e80a4ab50d3-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-jzvk9\" (UID: \"4a233ebd-9e71-4709-825a-2e80a4ab50d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9"
Jul 27 20:35:19.224475 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:19.224408    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:19.437432 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:19.437401    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9"
Jul 27 20:35:19.521155 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:19.521111    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:19.559827 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:19.559756    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9"]
Jul 27 20:35:19.715938 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:19.715902    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:19.816343 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:19.816251    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:20.199416 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:20.199379    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:20.199776 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:20.199762    2562 scope.go:117] "RemoveContainer" containerID="41d2453d2ddbc9d253f2551178a5c6a22e7d303ac4f97076beb2b009a66818bf"
Jul 27 20:35:20.199922 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:35:20.199904    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-bdpxl_openshift-console-operator(efafc91f-4c5f-47e5-8350-fdf66054226c)\"" pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl" podUID="efafc91f-4c5f-47e5-8350-fdf66054226c"
Jul 27 20:35:20.247920 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:20.247887    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9" event={"ID":"4a233ebd-9e71-4709-825a-2e80a4ab50d3","Type":"ContainerStarted","Data":"4dcc12d92e3d6ab9d517e69fb160685a73f7dae0d51f3b4be8e4e8d04d703a36"}
Jul 27 20:35:20.328975 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:20.328939    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:20.926853 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:20.926812    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:20.998855 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:20.998770    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:21.122702 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:21.122649    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:21.429813 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:21.429783    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:21.530634 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:21.530603    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:21.746723 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:21.746635    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:22.122305 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:22.122255    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:22.255771 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:22.255731    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9" event={"ID":"4a233ebd-9e71-4709-825a-2e80a4ab50d3","Type":"ContainerStarted","Data":"c361e3b8090db6985e8e3e897d1179dc415a1be1762d594de080d301d8962c24"}
Jul 27 20:35:22.255981 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:22.255791    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9" event={"ID":"4a233ebd-9e71-4709-825a-2e80a4ab50d3","Type":"ContainerStarted","Data":"2ccfa42fcdb25e969dd3d2d5559a19eeb79718813a5c57e4228403261cff6f43"}
Jul 27 20:35:22.271174 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:22.271128    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-jzvk9" podStartSLOduration=17.401442861 podStartE2EDuration="19.271113404s" totalImagesPullingTime="1.869670543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:22.269979902 +0000 UTC m=+61.910196355" watchObservedRunningTime="2026-07-27 20:35:22.271113404 +0000 UTC m=+61.911329841"
Jul 27 20:35:22.727670 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:22.727628    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:23.321249 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:23.319639    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:23.559659 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:23.559624    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:23.719198 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:23.719099    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:24.117321 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:24.117290    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:25.619413 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.619368    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret\") pod \"global-pull-secret-syncer-4z4nt\" (UID: \"d1006199-a395-4fef-b9a5-7abe2931fd07\") " pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:35:25.619889 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.619525    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs\") pod \"network-metrics-daemon-s8rhb\" (UID: \"28e5f501-0964-4435-b714-b53d1985c224\") " pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:35:25.622104 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.622080    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:35:25.622994 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.622980    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:35:25.631910 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.631882    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1006199-a395-4fef-b9a5-7abe2931fd07-original-pull-secret\") pod \"global-pull-secret-syncer-4z4nt\" (UID: \"d1006199-a395-4fef-b9a5-7abe2931fd07\") " pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:35:25.632000 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.631914    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28e5f501-0964-4435-b714-b53d1985c224-metrics-certs\") pod \"network-metrics-daemon-s8rhb\" (UID: \"28e5f501-0964-4435-b714-b53d1985c224\") " pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:35:25.674691 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.674654    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kqrvq\""
Jul 27 20:35:25.682787 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.682761    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s8rhb"
Jul 27 20:35:25.720290 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.720247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls\") pod \"dns-default-6rjrr\" (UID: \"2c2578b4-d3fa-4263-a604-3800a3e85f49\") " pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:35:25.720431 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.720303    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:35:25.720431 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.720374    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8tdl\" (UniqueName: \"kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl\") pod \"network-check-target-2hxvx\" (UID: \"97208f7a-c966-4a7f-abee-d5732ca900c9\") " pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:35:25.723036 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.723008    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c2578b4-d3fa-4263-a604-3800a3e85f49-metrics-tls\") pod \"dns-default-6rjrr\" (UID: \"2c2578b4-d3fa-4263-a604-3800a3e85f49\") " pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:35:25.723234 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.723214    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls\") pod \"image-registry-75674f955c-kp8sl\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") " pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:35:25.723375 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.723228    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8tdl\" (UniqueName: \"kubernetes.io/projected/97208f7a-c966-4a7f-abee-d5732ca900c9-kube-api-access-r8tdl\") pod \"network-check-target-2hxvx\" (UID: \"97208f7a-c966-4a7f-abee-d5732ca900c9\") " pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:35:25.777202 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.776865    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pl2wx\""
Jul 27 20:35:25.780339 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.780318    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z4nt"
Jul 27 20:35:25.785015 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.785002    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:35:25.803791 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.803734    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s8rhb"]
Jul 27 20:35:25.806247 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:35:25.806221    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28e5f501_0964_4435_b714_b53d1985c224.slice/crio-7edfbc141cf29b2022d2a719710485dde6cf25f9b76f55753d0aab62be6770a5 WatchSource:0}: Error finding container 7edfbc141cf29b2022d2a719710485dde6cf25f9b76f55753d0aab62be6770a5: Status 404 returned error can't find the container with id 7edfbc141cf29b2022d2a719710485dde6cf25f9b76f55753d0aab62be6770a5
Jul 27 20:35:25.882932 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.882903    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8k9nx\""
Jul 27 20:35:25.890090 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.890066    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hgqwx\""
Jul 27 20:35:25.891018 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.890999    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:35:25.898264 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.898238    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:35:25.907264 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.907241    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4z4nt"]
Jul 27 20:35:25.910493 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:35:25.910460    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1006199_a395_4fef_b9a5_7abe2931fd07.slice/crio-557c547405dc1944f729c540cbcb35b159329f2a3a2fb48655ca58c94a8b5c73 WatchSource:0}: Error finding container 557c547405dc1944f729c540cbcb35b159329f2a3a2fb48655ca58c94a8b5c73: Status 404 returned error can't find the container with id 557c547405dc1944f729c540cbcb35b159329f2a3a2fb48655ca58c94a8b5c73
Jul 27 20:35:25.924669 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:25.924645    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2hxvx"]
Jul 27 20:35:25.926192 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:35:25.926170    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97208f7a_c966_4a7f_abee_d5732ca900c9.slice/crio-9b8af1063e9821d44b5fd0958ce480be1cb46e7e842029cd841a11633d87b65c WatchSource:0}: Error finding container 9b8af1063e9821d44b5fd0958ce480be1cb46e7e842029cd841a11633d87b65c: Status 404 returned error can't find the container with id 9b8af1063e9821d44b5fd0958ce480be1cb46e7e842029cd841a11633d87b65c
Jul 27 20:35:26.023407 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:26.023332    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-j9njv\" (UID: \"b96c2f08-0f8b-49cd-8952-b2a54a65e4aa\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-j9njv"
Jul 27 20:35:26.026152 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:26.026117    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b96c2f08-0f8b-49cd-8952-b2a54a65e4aa-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-j9njv\" (UID: \"b96c2f08-0f8b-49cd-8952-b2a54a65e4aa\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-j9njv"
Jul 27 20:35:26.047208 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:26.047177    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75674f955c-kp8sl"]
Jul 27 20:35:26.049148 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:35:26.049128    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc698af_ec70_45f5_8212_2ae3213eaf83.slice/crio-127d21cf7a50c337bcc9f47e9ac9ae55fee40d82df140101f1cc7ac2636de966 WatchSource:0}: Error finding container 127d21cf7a50c337bcc9f47e9ac9ae55fee40d82df140101f1cc7ac2636de966: Status 404 returned error can't find the container with id 127d21cf7a50c337bcc9f47e9ac9ae55fee40d82df140101f1cc7ac2636de966
Jul 27 20:35:26.059702 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:26.059679    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6rjrr"]
Jul 27 20:35:26.061834 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:35:26.061812    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c2578b4_d3fa_4263_a604_3800a3e85f49.slice/crio-1a9c66d8959535a8b9b26af82ab1d923e419a97255b999c6e3f597d2d69e991f WatchSource:0}: Error finding container 1a9c66d8959535a8b9b26af82ab1d923e419a97255b999c6e3f597d2d69e991f: Status 404 returned error can't find the container with id 1a9c66d8959535a8b9b26af82ab1d923e419a97255b999c6e3f597d2d69e991f
Jul 27 20:35:26.159565 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:26.159502    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dzgwf\""
Jul 27 20:35:26.167192 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:26.167167    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-j9njv"
Jul 27 20:35:26.278463 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:26.278403    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75674f955c-kp8sl" event={"ID":"0cc698af-ec70-45f5-8212-2ae3213eaf83","Type":"ContainerStarted","Data":"ca55671fff693e8a6c3ffd5f6cccdebaf9869ce691d6e15a33357be0529d7015"}
Jul 27 20:35:26.278757 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:26.278730    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75674f955c-kp8sl" event={"ID":"0cc698af-ec70-45f5-8212-2ae3213eaf83","Type":"ContainerStarted","Data":"127d21cf7a50c337bcc9f47e9ac9ae55fee40d82df140101f1cc7ac2636de966"}
Jul 27 20:35:26.278936 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:26.278902    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:35:26.280828 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:26.280801    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2hxvx" event={"ID":"97208f7a-c966-4a7f-abee-d5732ca900c9","Type":"ContainerStarted","Data":"f327433bc28a72f37eb1fe03a9662daf823e387adacafee4ff8315f0c5063c95"}
Jul 27 20:35:26.280930 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:26.280855    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2hxvx" event={"ID":"97208f7a-c966-4a7f-abee-d5732ca900c9","Type":"ContainerStarted","Data":"9b8af1063e9821d44b5fd0958ce480be1cb46e7e842029cd841a11633d87b65c"}
Jul 27 20:35:26.280930 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:26.280880    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:35:26.282166 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:26.282132    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4z4nt" event={"ID":"d1006199-a395-4fef-b9a5-7abe2931fd07","Type":"ContainerStarted","Data":"557c547405dc1944f729c540cbcb35b159329f2a3a2fb48655ca58c94a8b5c73"}
Jul 27 20:35:26.283610 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:26.283587    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s8rhb" event={"ID":"28e5f501-0964-4435-b714-b53d1985c224","Type":"ContainerStarted","Data":"7edfbc141cf29b2022d2a719710485dde6cf25f9b76f55753d0aab62be6770a5"}
Jul 27 20:35:26.285507 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:26.284881    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6rjrr" event={"ID":"2c2578b4-d3fa-4263-a604-3800a3e85f49","Type":"ContainerStarted","Data":"1a9c66d8959535a8b9b26af82ab1d923e419a97255b999c6e3f597d2d69e991f"}
Jul 27 20:35:26.294853 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:26.294773    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-j9njv"]
Jul 27 20:35:26.297905 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:26.297847    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75674f955c-kp8sl" podStartSLOduration=65.297829549 podStartE2EDuration="1m5.297829549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:26.297749532 +0000 UTC m=+65.937965995" watchObservedRunningTime="2026-07-27 20:35:26.297829549 +0000 UTC m=+65.938045988"
Jul 27 20:35:26.299391 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:35:26.299363    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96c2f08_0f8b_49cd_8952_b2a54a65e4aa.slice/crio-8fdfe66928701ab9e1df5d5ca0bb5c9ece65ba68fc35a0f836e2790b23fe241b WatchSource:0}: Error finding container 8fdfe66928701ab9e1df5d5ca0bb5c9ece65ba68fc35a0f836e2790b23fe241b: Status 404 returned error can't find the container with id 8fdfe66928701ab9e1df5d5ca0bb5c9ece65ba68fc35a0f836e2790b23fe241b
Jul 27 20:35:26.313828 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:26.313771    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2hxvx" podStartSLOduration=65.313754639 podStartE2EDuration="1m5.313754639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:26.312093119 +0000 UTC m=+65.952309576" watchObservedRunningTime="2026-07-27 20:35:26.313754639 +0000 UTC m=+65.953971080"
Jul 27 20:35:27.133210 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:27.133131    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d791f22-7d91-4ba5-8225-690d8b1d2df2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:27.133210 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:27.133215    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:27.133993 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:27.133944    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d791f22-7d91-4ba5-8225-690d8b1d2df2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:27.136680 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:27.136627    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d791f22-7d91-4ba5-8225-690d8b1d2df2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxzn9\" (UID: \"0d791f22-7d91-4ba5-8225-690d8b1d2df2\") " pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:27.283036 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:27.282954    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8t4xf\""
Jul 27 20:35:27.290668 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:27.290639    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pxzn9"
Jul 27 20:35:27.291042 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:27.291008    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-j9njv" event={"ID":"b96c2f08-0f8b-49cd-8952-b2a54a65e4aa","Type":"ContainerStarted","Data":"8fdfe66928701ab9e1df5d5ca0bb5c9ece65ba68fc35a0f836e2790b23fe241b"}
Jul 27 20:35:27.293039 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:27.293009    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s8rhb" event={"ID":"28e5f501-0964-4435-b714-b53d1985c224","Type":"ContainerStarted","Data":"2cd98f9a919f4783af0cf445cf306caae8538eaa31331b3d2111b816d90052b2"}
Jul 27 20:35:27.293143 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:27.293063    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s8rhb" event={"ID":"28e5f501-0964-4435-b714-b53d1985c224","Type":"ContainerStarted","Data":"d8fff0b021d4fc2fc7d2e36fbc81a384d17fba00e8b0e0970f725a5413fcf9e6"}
Jul 27 20:35:27.308009 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:27.307945    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s8rhb" podStartSLOduration=65.221320178 podStartE2EDuration="1m6.307896378s" totalImagesPullingTime="1.0865762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:27.307108456 +0000 UTC m=+66.947324916" watchObservedRunningTime="2026-07-27 20:35:27.307896378 +0000 UTC m=+66.948112816"
Jul 27 20:35:27.473053 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:27.472932    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pxzn9"]
Jul 27 20:35:27.475583 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:35:27.475553    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d791f22_7d91_4ba5_8225_690d8b1d2df2.slice/crio-6c90ed10c450d166ea2286294bfc73d8d0f46334653f9c3f950cc1dd77ba04c0 WatchSource:0}: Error finding container 6c90ed10c450d166ea2286294bfc73d8d0f46334653f9c3f950cc1dd77ba04c0: Status 404 returned error can't find the container with id 6c90ed10c450d166ea2286294bfc73d8d0f46334653f9c3f950cc1dd77ba04c0
Jul 27 20:35:28.298991 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:28.298946    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxzn9" event={"ID":"0d791f22-7d91-4ba5-8225-690d8b1d2df2","Type":"ContainerStarted","Data":"6c90ed10c450d166ea2286294bfc73d8d0f46334653f9c3f950cc1dd77ba04c0"}
Jul 27 20:35:31.312814 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:31.312776    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6rjrr" event={"ID":"2c2578b4-d3fa-4263-a604-3800a3e85f49","Type":"ContainerStarted","Data":"2edc37bf3ddb859fa1dec3c1989d00fd936dba41abe39956fbc3c6d5c2d84595"}
Jul 27 20:35:31.313352 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:31.312843    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6rjrr" event={"ID":"2c2578b4-d3fa-4263-a604-3800a3e85f49","Type":"ContainerStarted","Data":"3ba98e574fda550f2050955cd8e191d830be8e0fbedee1f151d0b512599b69f1"}
Jul 27 20:35:31.313352 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:31.312876    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:35:31.314448 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:31.314420    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4z4nt" event={"ID":"d1006199-a395-4fef-b9a5-7abe2931fd07","Type":"ContainerStarted","Data":"fddf6eb7e905732ce0b2d9bdf589218459069ea826b972de524bc3bf27c37a6d"}
Jul 27 20:35:31.315983 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:31.315959    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-j9njv" event={"ID":"b96c2f08-0f8b-49cd-8952-b2a54a65e4aa","Type":"ContainerStarted","Data":"2814ba2d1f7fd94c154454426c46fa2b778af3168a8c810f091beedb18d592a5"}
Jul 27 20:35:31.329640 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:31.329592    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6rjrr" podStartSLOduration=34.096933212 podStartE2EDuration="38.329579669s" totalImagesPullingTime="4.232646457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:31.328013902 +0000 UTC m=+70.968230358" watchObservedRunningTime="2026-07-27 20:35:31.329579669 +0000 UTC m=+70.969796108"
Jul 27 20:35:31.345599 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:31.345552    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-j9njv" podStartSLOduration=17.358211825 podStartE2EDuration="21.345534974s" totalImagesPullingTime="3.987323149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:31.344017231 +0000 UTC m=+70.984233692" watchObservedRunningTime="2026-07-27 20:35:31.345534974 +0000 UTC m=+70.985751414"
Jul 27 20:35:31.360366 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:31.360326    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4z4nt" podStartSLOduration=65.931436877 podStartE2EDuration="1m10.360312075s" totalImagesPullingTime="4.428875198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:31.358904528 +0000 UTC m=+70.999120989" watchObservedRunningTime="2026-07-27 20:35:31.360312075 +0000 UTC m=+71.000528511"
Jul 27 20:35:32.074609 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.074577    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b"]
Jul 27 20:35:32.079795 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.079773    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764fb9db8d-7949x"]
Jul 27 20:35:32.079944 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.079910    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b"
Jul 27 20:35:32.082653 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.082431    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 20:35:32.082847 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.082822    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 20:35:32.082959 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.082922    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 27 20:35:32.082959 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.082942    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 20:35:32.083183 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.083165    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"]
Jul 27 20:35:32.084128 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.083337    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764fb9db8d-7949x"
Jul 27 20:35:32.085446 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.085423    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8vgq5\""
Jul 27 20:35:32.086798 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.086776    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 27 20:35:32.089134 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.088663    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.091765 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.091715    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 27 20:35:32.093978 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.093183    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 27 20:35:32.093978 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.093538    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 27 20:35:32.094709 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.094188    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 27 20:35:32.104859 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.104245    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b"]
Jul 27 20:35:32.105515 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.105452    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764fb9db8d-7949x"]
Jul 27 20:35:32.106628 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.106605    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"]
Jul 27 20:35:32.177820 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.177791    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjcw2\" (UniqueName: \"kubernetes.io/projected/39a88612-049d-460e-a8bb-c99cf211bfd1-kube-api-access-cjcw2\") pod \"managed-serviceaccount-addon-agent-764fb9db8d-7949x\" (UID: \"39a88612-049d-460e-a8bb-c99cf211bfd1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764fb9db8d-7949x"
Jul 27 20:35:32.177820 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.177822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13ccc293-83e6-46ed-b8e4-efffd66ee06e-tmp\") pod \"klusterlet-addon-workmgr-f5d774d59-7245b\" (UID: \"13ccc293-83e6-46ed-b8e4-efffd66ee06e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b"
Jul 27 20:35:32.178008 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.177841    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ea830552-b1e2-49b6-adbe-0168d13910df-hub\") pod \"cluster-proxy-proxy-agent-5d697b765b-vc89g\" (UID: \"ea830552-b1e2-49b6-adbe-0168d13910df\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.178008 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.177878    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/13ccc293-83e6-46ed-b8e4-efffd66ee06e-klusterlet-config\") pod \"klusterlet-addon-workmgr-f5d774d59-7245b\" (UID: \"13ccc293-83e6-46ed-b8e4-efffd66ee06e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b"
Jul 27 20:35:32.178008 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.177960    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ea830552-b1e2-49b6-adbe-0168d13910df-ca\") pod \"cluster-proxy-proxy-agent-5d697b765b-vc89g\" (UID: \"ea830552-b1e2-49b6-adbe-0168d13910df\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.178008 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.177985    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ea830552-b1e2-49b6-adbe-0168d13910df-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d697b765b-vc89g\" (UID: \"ea830552-b1e2-49b6-adbe-0168d13910df\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.178008 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.178003    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/39a88612-049d-460e-a8bb-c99cf211bfd1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-764fb9db8d-7949x\" (UID: \"39a88612-049d-460e-a8bb-c99cf211bfd1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764fb9db8d-7949x"
Jul 27 20:35:32.178242 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.178021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea830552-b1e2-49b6-adbe-0168d13910df-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d697b765b-vc89g\" (UID: \"ea830552-b1e2-49b6-adbe-0168d13910df\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.178242 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.178058    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f56zr\" (UniqueName: \"kubernetes.io/projected/13ccc293-83e6-46ed-b8e4-efffd66ee06e-kube-api-access-f56zr\") pod \"klusterlet-addon-workmgr-f5d774d59-7245b\" (UID: \"13ccc293-83e6-46ed-b8e4-efffd66ee06e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b"
Jul 27 20:35:32.178242 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.178081    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea830552-b1e2-49b6-adbe-0168d13910df-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d697b765b-vc89g\" (UID: \"ea830552-b1e2-49b6-adbe-0168d13910df\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.178242 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.178101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw9fd\" (UniqueName: \"kubernetes.io/projected/ea830552-b1e2-49b6-adbe-0168d13910df-kube-api-access-cw9fd\") pod \"cluster-proxy-proxy-agent-5d697b765b-vc89g\" (UID: \"ea830552-b1e2-49b6-adbe-0168d13910df\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.279047 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.279014    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea830552-b1e2-49b6-adbe-0168d13910df-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d697b765b-vc89g\" (UID: \"ea830552-b1e2-49b6-adbe-0168d13910df\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.279047 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.279060    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw9fd\" (UniqueName: \"kubernetes.io/projected/ea830552-b1e2-49b6-adbe-0168d13910df-kube-api-access-cw9fd\") pod \"cluster-proxy-proxy-agent-5d697b765b-vc89g\" (UID: \"ea830552-b1e2-49b6-adbe-0168d13910df\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.279315 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.279126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjcw2\" (UniqueName: \"kubernetes.io/projected/39a88612-049d-460e-a8bb-c99cf211bfd1-kube-api-access-cjcw2\") pod \"managed-serviceaccount-addon-agent-764fb9db8d-7949x\" (UID: \"39a88612-049d-460e-a8bb-c99cf211bfd1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764fb9db8d-7949x"
Jul 27 20:35:32.279315 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.279143    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13ccc293-83e6-46ed-b8e4-efffd66ee06e-tmp\") pod \"klusterlet-addon-workmgr-f5d774d59-7245b\" (UID: \"13ccc293-83e6-46ed-b8e4-efffd66ee06e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b"
Jul 27 20:35:32.279315 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.279161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ea830552-b1e2-49b6-adbe-0168d13910df-hub\") pod \"cluster-proxy-proxy-agent-5d697b765b-vc89g\" (UID: \"ea830552-b1e2-49b6-adbe-0168d13910df\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.279315 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.279192    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/13ccc293-83e6-46ed-b8e4-efffd66ee06e-klusterlet-config\") pod \"klusterlet-addon-workmgr-f5d774d59-7245b\" (UID: \"13ccc293-83e6-46ed-b8e4-efffd66ee06e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b"
Jul 27 20:35:32.279315 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.279247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ea830552-b1e2-49b6-adbe-0168d13910df-ca\") pod \"cluster-proxy-proxy-agent-5d697b765b-vc89g\" (UID: \"ea830552-b1e2-49b6-adbe-0168d13910df\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.279315 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.279295    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ea830552-b1e2-49b6-adbe-0168d13910df-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d697b765b-vc89g\" (UID: \"ea830552-b1e2-49b6-adbe-0168d13910df\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.279804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.279321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/39a88612-049d-460e-a8bb-c99cf211bfd1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-764fb9db8d-7949x\" (UID: \"39a88612-049d-460e-a8bb-c99cf211bfd1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764fb9db8d-7949x"
Jul 27 20:35:32.279804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.279349    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea830552-b1e2-49b6-adbe-0168d13910df-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d697b765b-vc89g\" (UID: \"ea830552-b1e2-49b6-adbe-0168d13910df\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.279804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.279384    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f56zr\" (UniqueName: \"kubernetes.io/projected/13ccc293-83e6-46ed-b8e4-efffd66ee06e-kube-api-access-f56zr\") pod \"klusterlet-addon-workmgr-f5d774d59-7245b\" (UID: \"13ccc293-83e6-46ed-b8e4-efffd66ee06e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b"
Jul 27 20:35:32.279804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.279501    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13ccc293-83e6-46ed-b8e4-efffd66ee06e-tmp\") pod \"klusterlet-addon-workmgr-f5d774d59-7245b\" (UID: \"13ccc293-83e6-46ed-b8e4-efffd66ee06e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b"
Jul 27 20:35:32.279804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.279793    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea830552-b1e2-49b6-adbe-0168d13910df-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d697b765b-vc89g\" (UID: \"ea830552-b1e2-49b6-adbe-0168d13910df\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.282548 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.282520    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ea830552-b1e2-49b6-adbe-0168d13910df-hub\") pod \"cluster-proxy-proxy-agent-5d697b765b-vc89g\" (UID: \"ea830552-b1e2-49b6-adbe-0168d13910df\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.282686 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.282658    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/39a88612-049d-460e-a8bb-c99cf211bfd1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-764fb9db8d-7949x\" (UID: \"39a88612-049d-460e-a8bb-c99cf211bfd1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764fb9db8d-7949x"
Jul 27 20:35:32.283105 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.283082    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ea830552-b1e2-49b6-adbe-0168d13910df-ca\") pod \"cluster-proxy-proxy-agent-5d697b765b-vc89g\" (UID: \"ea830552-b1e2-49b6-adbe-0168d13910df\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.283244 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.283222    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ea830552-b1e2-49b6-adbe-0168d13910df-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d697b765b-vc89g\" (UID: \"ea830552-b1e2-49b6-adbe-0168d13910df\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.283329 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.283313    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/13ccc293-83e6-46ed-b8e4-efffd66ee06e-klusterlet-config\") pod \"klusterlet-addon-workmgr-f5d774d59-7245b\" (UID: \"13ccc293-83e6-46ed-b8e4-efffd66ee06e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b"
Jul 27 20:35:32.283388 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.283356    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ea830552-b1e2-49b6-adbe-0168d13910df-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d697b765b-vc89g\" (UID: \"ea830552-b1e2-49b6-adbe-0168d13910df\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.287952 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.287906    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f56zr\" (UniqueName: \"kubernetes.io/projected/13ccc293-83e6-46ed-b8e4-efffd66ee06e-kube-api-access-f56zr\") pod \"klusterlet-addon-workmgr-f5d774d59-7245b\" (UID: \"13ccc293-83e6-46ed-b8e4-efffd66ee06e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b"
Jul 27 20:35:32.288224 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.288202    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw9fd\" (UniqueName: \"kubernetes.io/projected/ea830552-b1e2-49b6-adbe-0168d13910df-kube-api-access-cw9fd\") pod \"cluster-proxy-proxy-agent-5d697b765b-vc89g\" (UID: \"ea830552-b1e2-49b6-adbe-0168d13910df\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:32.288409 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.288370    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjcw2\" (UniqueName: \"kubernetes.io/projected/39a88612-049d-460e-a8bb-c99cf211bfd1-kube-api-access-cjcw2\") pod \"managed-serviceaccount-addon-agent-764fb9db8d-7949x\" (UID: \"39a88612-049d-460e-a8bb-c99cf211bfd1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764fb9db8d-7949x"
Jul 27 20:35:32.401239 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.401146    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b"
Jul 27 20:35:32.415924 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.415897    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764fb9db8d-7949x"
Jul 27 20:35:32.422177 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:32.422152    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"
Jul 27 20:35:34.804256 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:34.804216    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g"]
Jul 27 20:35:34.808191 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:35:34.808158    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea830552_b1e2_49b6_adbe_0168d13910df.slice/crio-6ef85a558066f404aacc6d306e65c956270b94073a1b13959def43c54a787a9f WatchSource:0}: Error finding container 6ef85a558066f404aacc6d306e65c956270b94073a1b13959def43c54a787a9f: Status 404 returned error can't find the container with id 6ef85a558066f404aacc6d306e65c956270b94073a1b13959def43c54a787a9f
Jul 27 20:35:34.864371 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:34.864345    2562 scope.go:117] "RemoveContainer" containerID="41d2453d2ddbc9d253f2551178a5c6a22e7d303ac4f97076beb2b009a66818bf"
Jul 27 20:35:35.030770 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.030671    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764fb9db8d-7949x"]
Jul 27 20:35:35.033124 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:35:35.033092    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39a88612_049d_460e_a8bb_c99cf211bfd1.slice/crio-edc6c784ec4ab4b8c47a2295aa0ed3d0a0c4e29f00d606cfe23ed4d834805d1c WatchSource:0}: Error finding container edc6c784ec4ab4b8c47a2295aa0ed3d0a0c4e29f00d606cfe23ed4d834805d1c: Status 404 returned error can't find the container with id edc6c784ec4ab4b8c47a2295aa0ed3d0a0c4e29f00d606cfe23ed4d834805d1c
Jul 27 20:35:35.033504 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.033460    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b"]
Jul 27 20:35:35.035452 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:35:35.035416    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13ccc293_83e6_46ed_b8e4_efffd66ee06e.slice/crio-f01c6c9016d212b6ca29ac5e99bdc67fb1b036a9b23f3cc1ca9ad7b2386a7cef WatchSource:0}: Error finding container f01c6c9016d212b6ca29ac5e99bdc67fb1b036a9b23f3cc1ca9ad7b2386a7cef: Status 404 returned error can't find the container with id f01c6c9016d212b6ca29ac5e99bdc67fb1b036a9b23f3cc1ca9ad7b2386a7cef
Jul 27 20:35:35.107150 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.107118    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-vghz8\" (UID: \"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"
Jul 27 20:35:35.109699 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.109669    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-vghz8\" (UID: \"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"
Jul 27 20:35:35.208382 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.208139    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:35.208382 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.208259    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:35.208906 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.208880    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a26fdaf-9d7e-4108-b8b1-f028188d2922-service-ca-bundle\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:35.214006 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.213981    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a26fdaf-9d7e-4108-b8b1-f028188d2922-metrics-certs\") pod \"router-default-84bfbc884c-qvrvp\" (UID: \"1a26fdaf-9d7e-4108-b8b1-f028188d2922\") " pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:35.238997 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.238974    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t7c5q\""
Jul 27 20:35:35.247576 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.247551    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"
Jul 27 20:35:35.334026 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.333950    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b" event={"ID":"13ccc293-83e6-46ed-b8e4-efffd66ee06e","Type":"ContainerStarted","Data":"f01c6c9016d212b6ca29ac5e99bdc67fb1b036a9b23f3cc1ca9ad7b2386a7cef"}
Jul 27 20:35:35.337280 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.337243    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 20:35:35.337413 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.337387    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl" event={"ID":"efafc91f-4c5f-47e5-8350-fdf66054226c","Type":"ContainerStarted","Data":"a9e9aa859c53c01e5fae7b3897d06768f36d97c65885b645c787cb8f62ab1801"}
Jul 27 20:35:35.338408 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.338345    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:35.340554 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.340509    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764fb9db8d-7949x" event={"ID":"39a88612-049d-460e-a8bb-c99cf211bfd1","Type":"ContainerStarted","Data":"edc6c784ec4ab4b8c47a2295aa0ed3d0a0c4e29f00d606cfe23ed4d834805d1c"}
Jul 27 20:35:35.343617 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.343555    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxzn9" event={"ID":"0d791f22-7d91-4ba5-8225-690d8b1d2df2","Type":"ContainerStarted","Data":"7684378b2c9169f648cbe158537a846a401e6850305b0b679ffd1dfdec582b40"}
Jul 27 20:35:35.344929 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.344904    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-bdpxl"
Jul 27 20:35:35.345076 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.345056    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g" event={"ID":"ea830552-b1e2-49b6-adbe-0168d13910df","Type":"ContainerStarted","Data":"6ef85a558066f404aacc6d306e65c956270b94073a1b13959def43c54a787a9f"}
Jul 27 20:35:35.365042 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.364906    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cgfst\""
Jul 27 20:35:35.369745 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.369715    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:35.422567 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.420654    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8"]
Jul 27 20:35:35.442974 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.442050    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-2wpxf"]
Jul 27 20:35:35.446673 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.446654    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-2wpxf"
Jul 27 20:35:35.449414 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.449162    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-n6tnw\""
Jul 27 20:35:35.450311 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.449882    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 20:35:35.450311 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.450122    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 20:35:35.462003 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.461827    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-2wpxf"]
Jul 27 20:35:35.599743 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.599656    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-84bfbc884c-qvrvp"]
Jul 27 20:35:35.602083 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:35:35.602049    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a26fdaf_9d7e_4108_b8b1_f028188d2922.slice/crio-653479f90531e33c65dabad0e5e3143bc7c94443a14a68b4012ad99c8e6576b6 WatchSource:0}: Error finding container 653479f90531e33c65dabad0e5e3143bc7c94443a14a68b4012ad99c8e6576b6: Status 404 returned error can't find the container with id 653479f90531e33c65dabad0e5e3143bc7c94443a14a68b4012ad99c8e6576b6
Jul 27 20:35:35.613301 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.613248    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcnfz\" (UniqueName: \"kubernetes.io/projected/8b954f0a-741a-46e0-bc68-75bfc6324548-kube-api-access-mcnfz\") pod \"downloads-7c97dc4555-2wpxf\" (UID: \"8b954f0a-741a-46e0-bc68-75bfc6324548\") " pod="openshift-console/downloads-7c97dc4555-2wpxf"
Jul 27 20:35:35.714347 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.714185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcnfz\" (UniqueName: \"kubernetes.io/projected/8b954f0a-741a-46e0-bc68-75bfc6324548-kube-api-access-mcnfz\") pod \"downloads-7c97dc4555-2wpxf\" (UID: \"8b954f0a-741a-46e0-bc68-75bfc6324548\") " pod="openshift-console/downloads-7c97dc4555-2wpxf"
Jul 27 20:35:35.724424 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.724369    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcnfz\" (UniqueName: \"kubernetes.io/projected/8b954f0a-741a-46e0-bc68-75bfc6324548-kube-api-access-mcnfz\") pod \"downloads-7c97dc4555-2wpxf\" (UID: \"8b954f0a-741a-46e0-bc68-75bfc6324548\") " pod="openshift-console/downloads-7c97dc4555-2wpxf"
Jul 27 20:35:35.767319 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.767262    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-2wpxf"
Jul 27 20:35:35.968574 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:35.968445    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-2wpxf"]
Jul 27 20:35:36.361383 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:36.361304    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-2wpxf" event={"ID":"8b954f0a-741a-46e0-bc68-75bfc6324548","Type":"ContainerStarted","Data":"06dff454b39d7b9893b62f4cc0b18c9183e1f36356fd25a48830a536290c36e9"}
Jul 27 20:35:36.363368 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:36.363293    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8" event={"ID":"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f","Type":"ContainerStarted","Data":"9530155e53c572cf70d1cd70f82f05bb1ad00711d5de7f71ca1f95ef416524f8"}
Jul 27 20:35:36.367915 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:36.367775    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-84bfbc884c-qvrvp" event={"ID":"1a26fdaf-9d7e-4108-b8b1-f028188d2922","Type":"ContainerStarted","Data":"989b1e1b1ac12a3fa6788a7d67bf8cf03d40e450dd6c6ac875d1d90ae6ae86a2"}
Jul 27 20:35:36.367915 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:36.367815    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-84bfbc884c-qvrvp" event={"ID":"1a26fdaf-9d7e-4108-b8b1-f028188d2922","Type":"ContainerStarted","Data":"653479f90531e33c65dabad0e5e3143bc7c94443a14a68b4012ad99c8e6576b6"}
Jul 27 20:35:36.371881 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:36.371798    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:36.374778 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:36.374739    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:36.389759 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:36.388997    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-84bfbc884c-qvrvp" podStartSLOduration=33.388973592 podStartE2EDuration="33.388973592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:36.386929129 +0000 UTC m=+76.027145592" watchObservedRunningTime="2026-07-27 20:35:36.388973592 +0000 UTC m=+76.029190033"
Jul 27 20:35:37.379870 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:37.379812    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:37.381853 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:37.381645    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-84bfbc884c-qvrvp"
Jul 27 20:35:41.322739 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:41.322685    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6rjrr"
Jul 27 20:35:45.896746 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:45.896708    2562 patch_prober.go:28] interesting pod/image-registry-75674f955c-kp8sl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 27 20:35:45.897171 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:45.896771    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-75674f955c-kp8sl" podUID="0cc698af-ec70-45f5-8212-2ae3213eaf83" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 20:35:47.434094 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:47.430221    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxzn9" event={"ID":"0d791f22-7d91-4ba5-8225-690d8b1d2df2","Type":"ContainerStarted","Data":"66bff5e5f14afe37453c6d958504ab31ad04e62a39f5ee96fd5dcc273b0a5a51"}
Jul 27 20:35:47.437866 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:47.437832    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g" event={"ID":"ea830552-b1e2-49b6-adbe-0168d13910df","Type":"ContainerStarted","Data":"84832f92cfad81b13387f2d8088fa6ef3858d9d83f656b2c258c96a0c87c8e0c"}
Jul 27 20:35:47.438024 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:47.437885    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g" event={"ID":"ea830552-b1e2-49b6-adbe-0168d13910df","Type":"ContainerStarted","Data":"032df3113235d7eb0764f7e5231e240376db66db6578600d04c13cf44e740e9f"}
Jul 27 20:35:47.438024 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:47.437906    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g" event={"ID":"ea830552-b1e2-49b6-adbe-0168d13910df","Type":"ContainerStarted","Data":"b888045f20154e3352d7a00bcd2c6af1f83ecce8e3957eedc4ad679bfadb6ddd"}
Jul 27 20:35:47.439649 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:47.439624    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8" event={"ID":"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f","Type":"ContainerStarted","Data":"05c3999e7722f009638fa1360f12b95e2c051f81daa96fe21954354914a07d38"}
Jul 27 20:35:47.441414 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:47.441359    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b" event={"ID":"13ccc293-83e6-46ed-b8e4-efffd66ee06e","Type":"ContainerStarted","Data":"651d45971ab73d7c72a2826789dcd9a5b8586d93762dbfe92e584b19dd3daf23"}
Jul 27 20:35:47.441716 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:47.441698    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b"
Jul 27 20:35:47.443683 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:47.443661    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b"
Jul 27 20:35:47.443986 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:47.443966    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764fb9db8d-7949x" event={"ID":"39a88612-049d-460e-a8bb-c99cf211bfd1","Type":"ContainerStarted","Data":"240afc7d04bebf149b071251e180ed8408c890d5ef6c81f0ec864f51521bad2b"}
Jul 27 20:35:47.461103 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:47.461048    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d697b765b-vc89g" podStartSLOduration=3.800673518 podStartE2EDuration="15.461032614s" totalImagesPullingTime="11.660359096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:47.459572061 +0000 UTC m=+87.099788499" watchObservedRunningTime="2026-07-27 20:35:47.461032614 +0000 UTC m=+87.101249050"
Jul 27 20:35:47.476174 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:47.476133    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8" podStartSLOduration=33.443906872 podStartE2EDuration="44.476121357s" totalImagesPullingTime="11.032214485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:47.475077496 +0000 UTC m=+87.115293935" watchObservedRunningTime="2026-07-27 20:35:47.476121357 +0000 UTC m=+87.116337795"
Jul 27 20:35:47.496383 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:47.496328    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f5d774d59-7245b" podStartSLOduration=4.062820148 podStartE2EDuration="15.496314282s" totalImagesPullingTime="11.433494134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:47.495631098 +0000 UTC m=+87.135847554" watchObservedRunningTime="2026-07-27 20:35:47.496314282 +0000 UTC m=+87.136530720"
Jul 27 20:35:47.511691 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:47.511642    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764fb9db8d-7949x" podStartSLOduration=4.075422131 podStartE2EDuration="15.511624411s" totalImagesPullingTime="11.43620228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:47.510321374 +0000 UTC m=+87.150537816" watchObservedRunningTime="2026-07-27 20:35:47.511624411 +0000 UTC m=+87.151840850"
Jul 27 20:35:48.303960 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:48.303933    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:35:55.481389 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:55.481319    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-2wpxf" event={"ID":"8b954f0a-741a-46e0-bc68-75bfc6324548","Type":"ContainerStarted","Data":"5d8072a9d1f4ffc8d7a5b7078c9b19a5c985d58aad72119d9bee12667e1b6da9"}
Jul 27 20:35:55.481918 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:55.481768    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-2wpxf"
Jul 27 20:35:55.496126 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:55.496102    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-2wpxf"
Jul 27 20:35:55.499719 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:55.499668    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-2wpxf" podStartSLOduration=1.523880371 podStartE2EDuration="20.499652798s" totalImagesPullingTime="18.975772427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:55.498367827 +0000 UTC m=+95.138584289" watchObservedRunningTime="2026-07-27 20:35:55.499652798 +0000 UTC m=+95.139869235"
Jul 27 20:35:57.296907 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:57.296038    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2hxvx"
Jul 27 20:35:59.269973 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:59.269941    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75674f955c-kp8sl"]
Jul 27 20:35:59.508789 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:59.508710    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxzn9" event={"ID":"0d791f22-7d91-4ba5-8225-690d8b1d2df2","Type":"ContainerStarted","Data":"c5d2fd8036fa7fca88543e3371adb388ddd1e859debb2b08f1ace46a1617fbb2"}
Jul 27 20:35:59.510628 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:59.510604    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 20:35:59.510749 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:59.510642    2562 generic.go:356] "Generic (PLEG): container finished" podID="5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f" containerID="05c3999e7722f009638fa1360f12b95e2c051f81daa96fe21954354914a07d38" exitCode=2
Jul 27 20:35:59.510749 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:59.510708    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8" event={"ID":"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f","Type":"ContainerDied","Data":"05c3999e7722f009638fa1360f12b95e2c051f81daa96fe21954354914a07d38"}
Jul 27 20:35:59.511003 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:59.510987    2562 scope.go:117] "RemoveContainer" containerID="05c3999e7722f009638fa1360f12b95e2c051f81daa96fe21954354914a07d38"
Jul 27 20:35:59.526406 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:35:59.526356    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pxzn9" podStartSLOduration=17.060386584 podStartE2EDuration="48.526337093s" totalImagesPullingTime="31.465950509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:35:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:59.524738305 +0000 UTC m=+99.164954767" watchObservedRunningTime="2026-07-27 20:35:59.526337093 +0000 UTC m=+99.166553532"
Jul 27 20:36:00.518599 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:00.518568    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 20:36:00.519093 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:00.518703    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-vghz8" event={"ID":"5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f","Type":"ContainerStarted","Data":"66a67390002abb42fc26eba4f06d6f55b30e87e9a3ffb9e95177371016d553e1"}
Jul 27 20:36:03.251570 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.251532    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vv5bs"]
Jul 27 20:36:03.295659 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.295626    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.298824 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.298796    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 20:36:03.299969 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.299945    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 20:36:03.300247 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.300226    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 20:36:03.300515 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.300494    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dfz44\""
Jul 27 20:36:03.300694 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.300680    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 20:36:03.370329 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.370283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c689faa5-6262-4ddf-be4f-783a8ba269bc-node-exporter-tls\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.370507 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.370346    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c689faa5-6262-4ddf-be4f-783a8ba269bc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.370507 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.370394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8mxv\" (UniqueName: \"kubernetes.io/projected/c689faa5-6262-4ddf-be4f-783a8ba269bc-kube-api-access-l8mxv\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.370507 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.370421    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c689faa5-6262-4ddf-be4f-783a8ba269bc-metrics-client-ca\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.370507 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.370448    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c689faa5-6262-4ddf-be4f-783a8ba269bc-root\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.370507 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.370476    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c689faa5-6262-4ddf-be4f-783a8ba269bc-sys\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.370507 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.370498    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c689faa5-6262-4ddf-be4f-783a8ba269bc-node-exporter-wtmp\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.370809 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.370533    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c689faa5-6262-4ddf-be4f-783a8ba269bc-node-exporter-accelerators-collector-config\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.370809 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.370588    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c689faa5-6262-4ddf-be4f-783a8ba269bc-node-exporter-textfile\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.471343 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.471169    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8mxv\" (UniqueName: \"kubernetes.io/projected/c689faa5-6262-4ddf-be4f-783a8ba269bc-kube-api-access-l8mxv\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.471343 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.471233    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c689faa5-6262-4ddf-be4f-783a8ba269bc-metrics-client-ca\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.471343 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.471261    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c689faa5-6262-4ddf-be4f-783a8ba269bc-root\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.471343 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.471316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c689faa5-6262-4ddf-be4f-783a8ba269bc-sys\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.471343 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.471339    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c689faa5-6262-4ddf-be4f-783a8ba269bc-node-exporter-wtmp\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.471703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.471389    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c689faa5-6262-4ddf-be4f-783a8ba269bc-node-exporter-accelerators-collector-config\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.471703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.471464    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c689faa5-6262-4ddf-be4f-783a8ba269bc-node-exporter-textfile\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.471703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.471534    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c689faa5-6262-4ddf-be4f-783a8ba269bc-node-exporter-tls\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.471703 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.471566    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c689faa5-6262-4ddf-be4f-783a8ba269bc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.471911 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.471729    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c689faa5-6262-4ddf-be4f-783a8ba269bc-sys\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.472726 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.472702    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c689faa5-6262-4ddf-be4f-783a8ba269bc-node-exporter-accelerators-collector-config\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.472726 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.472715    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c689faa5-6262-4ddf-be4f-783a8ba269bc-metrics-client-ca\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.472908 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.472791    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c689faa5-6262-4ddf-be4f-783a8ba269bc-root\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.472970 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.472922    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c689faa5-6262-4ddf-be4f-783a8ba269bc-node-exporter-wtmp\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.473304 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.473266    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c689faa5-6262-4ddf-be4f-783a8ba269bc-node-exporter-textfile\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.475444 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.475404    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c689faa5-6262-4ddf-be4f-783a8ba269bc-node-exporter-tls\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.475802 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.475786    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c689faa5-6262-4ddf-be4f-783a8ba269bc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.479558 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.479541    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8mxv\" (UniqueName: \"kubernetes.io/projected/c689faa5-6262-4ddf-be4f-783a8ba269bc-kube-api-access-l8mxv\") pod \"node-exporter-vv5bs\" (UID: \"c689faa5-6262-4ddf-be4f-783a8ba269bc\") " pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:03.610509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:03.610473    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vv5bs"
Jul 27 20:36:04.538431 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:04.538389    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vv5bs" event={"ID":"c689faa5-6262-4ddf-be4f-783a8ba269bc","Type":"ContainerStarted","Data":"44d3aac421f5baf8f9682f943d0d8aee7337dc90766589c33aa60ee3ff22a0c8"}
Jul 27 20:36:05.543643 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:05.543567    2562 generic.go:356] "Generic (PLEG): container finished" podID="c689faa5-6262-4ddf-be4f-783a8ba269bc" containerID="106e0fe26df0d4910ee6f15d99df0f77f1dc0cbb5ee219b6044571d5cd85b722" exitCode=0
Jul 27 20:36:05.544026 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:05.543655    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vv5bs" event={"ID":"c689faa5-6262-4ddf-be4f-783a8ba269bc","Type":"ContainerDied","Data":"106e0fe26df0d4910ee6f15d99df0f77f1dc0cbb5ee219b6044571d5cd85b722"}
Jul 27 20:36:06.549702 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:06.549669    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vv5bs" event={"ID":"c689faa5-6262-4ddf-be4f-783a8ba269bc","Type":"ContainerStarted","Data":"807ccc6da27c8b6d509ab077f44d47d1cd67de0e3e999394fee126dca09d0d31"}
Jul 27 20:36:06.550171 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:06.549747    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vv5bs" event={"ID":"c689faa5-6262-4ddf-be4f-783a8ba269bc","Type":"ContainerStarted","Data":"66f08d57b424b10b19a091f774f8fe89826f325fd6514a45e87b662ede2d0fed"}
Jul 27 20:36:06.569504 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:06.569462    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vv5bs" podStartSLOduration=2.005806051 podStartE2EDuration="3.569448485s" totalImagesPullingTime="1.49514999s" totalInitContainerRuntime="68.492444ms" isStatefulPod=true podCreationTimestamp="2026-07-27 20:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:06.568389408 +0000 UTC m=+106.208605876" watchObservedRunningTime="2026-07-27 20:36:06.569448485 +0000 UTC m=+106.209664922"
Jul 27 20:36:21.608812 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:21.608779    2562 generic.go:356] "Generic (PLEG): container finished" podID="a6c193d5-281f-4d93-b21a-5adedf4bf8d8" containerID="03015cc7d83c502990fb66c7b53a978c8f0a98f45cf3f7f6a7687154b6c440e7" exitCode=0
Jul 27 20:36:21.609252 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:21.608845    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj" event={"ID":"a6c193d5-281f-4d93-b21a-5adedf4bf8d8","Type":"ContainerDied","Data":"03015cc7d83c502990fb66c7b53a978c8f0a98f45cf3f7f6a7687154b6c440e7"}
Jul 27 20:36:21.609252 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:21.609213    2562 scope.go:117] "RemoveContainer" containerID="03015cc7d83c502990fb66c7b53a978c8f0a98f45cf3f7f6a7687154b6c440e7"
Jul 27 20:36:21.610422 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:21.610403    2562 generic.go:356] "Generic (PLEG): container finished" podID="4113dabe-2d35-48f3-bb94-b377ee920246" containerID="cce61c476349ab667aa73598f453f70de76012c8bd045c689d91ceb38346bed5" exitCode=0
Jul 27 20:36:21.610512 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:21.610475    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-tnq84" event={"ID":"4113dabe-2d35-48f3-bb94-b377ee920246","Type":"ContainerDied","Data":"cce61c476349ab667aa73598f453f70de76012c8bd045c689d91ceb38346bed5"}
Jul 27 20:36:21.610754 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:21.610741    2562 scope.go:117] "RemoveContainer" containerID="cce61c476349ab667aa73598f453f70de76012c8bd045c689d91ceb38346bed5"
Jul 27 20:36:22.616392 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:22.616347    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj" event={"ID":"a6c193d5-281f-4d93-b21a-5adedf4bf8d8","Type":"ContainerStarted","Data":"9b865a775386f9fb17e922bb36ecc6a9e0e2aaa791b8a51c15cbed5b9c34979d"}
Jul 27 20:36:22.618192 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:22.618165    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-tnq84" event={"ID":"4113dabe-2d35-48f3-bb94-b377ee920246","Type":"ContainerStarted","Data":"6397f9c7d8287397bc62ff8a015bfd7ba398e9b6b69c4e2ee5864ae7830282e3"}
Jul 27 20:36:24.291977 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.291920    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-75674f955c-kp8sl" podUID="0cc698af-ec70-45f5-8212-2ae3213eaf83" containerName="registry" containerID="cri-o://ca55671fff693e8a6c3ffd5f6cccdebaf9869ce691d6e15a33357be0529d7015" gracePeriod=30
Jul 27 20:36:24.566492 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.566430    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:36:24.629645 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.629590    2562 generic.go:356] "Generic (PLEG): container finished" podID="0cc698af-ec70-45f5-8212-2ae3213eaf83" containerID="ca55671fff693e8a6c3ffd5f6cccdebaf9869ce691d6e15a33357be0529d7015" exitCode=0
Jul 27 20:36:24.629813 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.629651    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75674f955c-kp8sl"
Jul 27 20:36:24.629813 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.629662    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75674f955c-kp8sl" event={"ID":"0cc698af-ec70-45f5-8212-2ae3213eaf83","Type":"ContainerDied","Data":"ca55671fff693e8a6c3ffd5f6cccdebaf9869ce691d6e15a33357be0529d7015"}
Jul 27 20:36:24.629813 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.629719    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75674f955c-kp8sl" event={"ID":"0cc698af-ec70-45f5-8212-2ae3213eaf83","Type":"ContainerDied","Data":"127d21cf7a50c337bcc9f47e9ac9ae55fee40d82df140101f1cc7ac2636de966"}
Jul 27 20:36:24.629813 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.629752    2562 scope.go:117] "RemoveContainer" containerID="ca55671fff693e8a6c3ffd5f6cccdebaf9869ce691d6e15a33357be0529d7015"
Jul 27 20:36:24.638045 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.638027    2562 scope.go:117] "RemoveContainer" containerID="ca55671fff693e8a6c3ffd5f6cccdebaf9869ce691d6e15a33357be0529d7015"
Jul 27 20:36:24.638340 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:36:24.638311    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca55671fff693e8a6c3ffd5f6cccdebaf9869ce691d6e15a33357be0529d7015\": container with ID starting with ca55671fff693e8a6c3ffd5f6cccdebaf9869ce691d6e15a33357be0529d7015 not found: ID does not exist" containerID="ca55671fff693e8a6c3ffd5f6cccdebaf9869ce691d6e15a33357be0529d7015"
Jul 27 20:36:24.638456 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.638346    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca55671fff693e8a6c3ffd5f6cccdebaf9869ce691d6e15a33357be0529d7015"} err="failed to get container status \"ca55671fff693e8a6c3ffd5f6cccdebaf9869ce691d6e15a33357be0529d7015\": rpc error: code = NotFound desc = could not find container \"ca55671fff693e8a6c3ffd5f6cccdebaf9869ce691d6e15a33357be0529d7015\": container with ID starting with ca55671fff693e8a6c3ffd5f6cccdebaf9869ce691d6e15a33357be0529d7015 not found: ID does not exist"
Jul 27 20:36:24.642485 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.642465    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cc698af-ec70-45f5-8212-2ae3213eaf83-installation-pull-secrets\") pod \"0cc698af-ec70-45f5-8212-2ae3213eaf83\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") "
Jul 27 20:36:24.642596 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.642494    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cc698af-ec70-45f5-8212-2ae3213eaf83-image-registry-private-configuration\") pod \"0cc698af-ec70-45f5-8212-2ae3213eaf83\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") "
Jul 27 20:36:24.642596 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.642520    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qn7vp\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-kube-api-access-qn7vp\") pod \"0cc698af-ec70-45f5-8212-2ae3213eaf83\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") "
Jul 27 20:36:24.642596 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.642562    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-certificates\") pod \"0cc698af-ec70-45f5-8212-2ae3213eaf83\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") "
Jul 27 20:36:24.642596 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.642582    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls\") pod \"0cc698af-ec70-45f5-8212-2ae3213eaf83\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") "
Jul 27 20:36:24.642790 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.642613    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cc698af-ec70-45f5-8212-2ae3213eaf83-ca-trust-extracted\") pod \"0cc698af-ec70-45f5-8212-2ae3213eaf83\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") "
Jul 27 20:36:24.642790 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.642649    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-bound-sa-token\") pod \"0cc698af-ec70-45f5-8212-2ae3213eaf83\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") "
Jul 27 20:36:24.642790 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.642686    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cc698af-ec70-45f5-8212-2ae3213eaf83-trusted-ca\") pod \"0cc698af-ec70-45f5-8212-2ae3213eaf83\" (UID: \"0cc698af-ec70-45f5-8212-2ae3213eaf83\") "
Jul 27 20:36:24.643178 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.643077    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0cc698af-ec70-45f5-8212-2ae3213eaf83" (UID: "0cc698af-ec70-45f5-8212-2ae3213eaf83"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:36:24.643366 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.643313    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cc698af-ec70-45f5-8212-2ae3213eaf83-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0cc698af-ec70-45f5-8212-2ae3213eaf83" (UID: "0cc698af-ec70-45f5-8212-2ae3213eaf83"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:36:24.645262 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.645230    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0cc698af-ec70-45f5-8212-2ae3213eaf83" (UID: "0cc698af-ec70-45f5-8212-2ae3213eaf83"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:36:24.645637 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.645574    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cc698af-ec70-45f5-8212-2ae3213eaf83-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0cc698af-ec70-45f5-8212-2ae3213eaf83" (UID: "0cc698af-ec70-45f5-8212-2ae3213eaf83"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:36:24.645720 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.645642    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cc698af-ec70-45f5-8212-2ae3213eaf83-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0cc698af-ec70-45f5-8212-2ae3213eaf83" (UID: "0cc698af-ec70-45f5-8212-2ae3213eaf83"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:36:24.645720 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.645634    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0cc698af-ec70-45f5-8212-2ae3213eaf83" (UID: "0cc698af-ec70-45f5-8212-2ae3213eaf83"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:36:24.645792 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.645749    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-kube-api-access-qn7vp" (OuterVolumeSpecName: "kube-api-access-qn7vp") pod "0cc698af-ec70-45f5-8212-2ae3213eaf83" (UID: "0cc698af-ec70-45f5-8212-2ae3213eaf83"). InnerVolumeSpecName "kube-api-access-qn7vp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:36:24.651407 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.651379    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc698af-ec70-45f5-8212-2ae3213eaf83-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0cc698af-ec70-45f5-8212-2ae3213eaf83" (UID: "0cc698af-ec70-45f5-8212-2ae3213eaf83"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:24.743234 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.743205    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-certificates\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 20:36:24.743234 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.743231    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-registry-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 20:36:24.743404 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.743241    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cc698af-ec70-45f5-8212-2ae3213eaf83-ca-trust-extracted\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 20:36:24.743404 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.743249    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-bound-sa-token\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 20:36:24.743404 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.743257    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cc698af-ec70-45f5-8212-2ae3213eaf83-trusted-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 20:36:24.743404 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.743265    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cc698af-ec70-45f5-8212-2ae3213eaf83-installation-pull-secrets\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 20:36:24.743404 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.743291    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cc698af-ec70-45f5-8212-2ae3213eaf83-image-registry-private-configuration\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 20:36:24.743404 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.743299    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn7vp\" (UniqueName: \"kubernetes.io/projected/0cc698af-ec70-45f5-8212-2ae3213eaf83-kube-api-access-qn7vp\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 20:36:24.943924 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.943892    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75674f955c-kp8sl"]
Jul 27 20:36:24.949914 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:24.949886    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75674f955c-kp8sl"]
Jul 27 20:36:26.868457 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:26.868420    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cc698af-ec70-45f5-8212-2ae3213eaf83" path="/var/lib/kubelet/pods/0cc698af-ec70-45f5-8212-2ae3213eaf83/volumes"
Jul 27 20:36:40.697224 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:40.697195    2562 generic.go:356] "Generic (PLEG): container finished" podID="040c8c6c-43fc-4c1a-865b-d6f74fb008ec" containerID="1f28697f0aa078ce8114c9075a1dbc9a7b8ca8ca7cf8b167a17f3feea165a96e" exitCode=0
Jul 27 20:36:40.697565 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:40.697286    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm" event={"ID":"040c8c6c-43fc-4c1a-865b-d6f74fb008ec","Type":"ContainerDied","Data":"1f28697f0aa078ce8114c9075a1dbc9a7b8ca8ca7cf8b167a17f3feea165a96e"}
Jul 27 20:36:40.697678 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:40.697661    2562 scope.go:117] "RemoveContainer" containerID="1f28697f0aa078ce8114c9075a1dbc9a7b8ca8ca7cf8b167a17f3feea165a96e"
Jul 27 20:36:41.703053 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:36:41.703019    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-mwvdm" event={"ID":"040c8c6c-43fc-4c1a-865b-d6f74fb008ec","Type":"ContainerStarted","Data":"45224e8c1840def8cbf9f6e80628739a7864d074f0d8c8ba43be35fdba9ed533"}
Jul 27 20:38:05.048124 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:38:05.048084    2562 controller.go:195] "Failed to update lease" err="Put \"https://abfd37b6fbc2d4e8091c7e25058b939b-649bf434765c6a16.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-143-205.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 27 20:38:15.049241 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:38:15.049201    2562 controller.go:195] "Failed to update lease" err="Put \"https://abfd37b6fbc2d4e8091c7e25058b939b-649bf434765c6a16.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-143-205.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 27 20:38:25.050032 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:38:25.049992    2562 controller.go:195] "Failed to update lease" err="Put \"https://abfd37b6fbc2d4e8091c7e25058b939b-649bf434765c6a16.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-143-205.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 27 20:38:29.864306 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864235    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.864871 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864554    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xb79c\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.864871 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864266    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ndx4b\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.864871 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864263    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.864871 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864264    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t7c5q\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.864871 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864602    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pl2wx\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.864871 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864326    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.864871 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864328    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-k6vd7\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.864871 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864351    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cgfst\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.864871 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864639    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.864871 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864646    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.864871 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864364    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.864871 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864660    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.864871 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864381    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.864871 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864358    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.864871 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864679    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.864871 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864410    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.864871 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864410    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.865692 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864434    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.865692 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864433    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.865692 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864434    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.865692 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864234    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sjvtx\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.865692 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864235    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.865692 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864453    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.865692 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864732    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.865692 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864494    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.865692 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:38:29.864738    2562 controller.go:195] "Failed to update lease" err="Put \"https://abfd37b6fbc2d4e8091c7e25058b939b-649bf434765c6a16.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-143-205.ec2.internal?timeout=10s\": http2: client connection lost"
Jul 27 20:38:29.865692 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864528    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.865692 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864561    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.865692 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864758    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.865692 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864602    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.865692 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864352    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.865692 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864666    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.865692 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864787    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.865692 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864682    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.865692 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864405    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864427    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864713    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864523    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864244    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864322    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864399    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mlcnn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864867    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b8bx6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864881    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864895    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tnlvr\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864937    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864963    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864969    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864983    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864988    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864968    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865000    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.864990    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865018    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865025    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865028    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8vgq5\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865008    2562 reflector.go:571] "Warning: watch ended with error" reflector="pkg/kubelet/config/apiserver.go:66" type="*v1.Pod" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865044    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5pq2v\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865050    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dwzcd\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865021    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hgqwx\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865053    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dzgwf\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865061    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865075    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2p8xj\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865086    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865096    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865099    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865104    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865108    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6j6jl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865107    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865137    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865147    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.866764 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865159    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865147    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865163    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865163    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865189    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-f6p2p\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865192    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865203    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865217    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865225    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865228    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8t4xf\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865241    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865244    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca\"/\"signing-key\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865248    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dfz44\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865220    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865259    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-dockercfg-z2vk7\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865243    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mx4h5\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865261    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865292    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865384    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865398    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"original-pull-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865407    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-465t8\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865407    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865416    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"default-dockercfg-n6tnw\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865433    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865447    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865441    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865462    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865469    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8jmkm\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865472    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865489    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865493    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865496    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865517    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-agent\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865512    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865517    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865538    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.867804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865541    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865546    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865560    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ltd6n\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865566    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865573    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865580    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865601    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865617    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865624    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865622    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865648    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865649    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865658    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865654    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kqrvq\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865664    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865670    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865682    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865684    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gdqp8\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868356 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865684    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"default-dockercfg-k5jnc\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868863 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865677    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:29.868863 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:29.865702    2562 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 20:38:30.673113 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.673080    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 27 20:38:30.673301 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.673119    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 20:38:30.683397 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.683380    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 27 20:38:30.684862 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.684848    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 20:38:30.691221 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.691202    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 20:38:30.694537 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.694523    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 27 20:38:30.695765 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.695750    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 27 20:38:30.711746 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.711723    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:38:30.716248 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.716232    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b8bx6\""
Jul 27 20:38:30.718982 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.718967    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gdqp8\""
Jul 27 20:38:30.719158 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.719143    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 27 20:38:30.720656 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.720641    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-465t8\""
Jul 27 20:38:30.736543 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.736525    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mlcnn\""
Jul 27 20:38:30.742179 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.742165    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 27 20:38:30.745046 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.745033    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 20:38:30.752016 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.752001    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 20:38:30.754861 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.754846    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 27 20:38:30.756501 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.756487    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 20:38:30.765012 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.764995    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 27 20:38:30.770474 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.770459    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-f6p2p\""
Jul 27 20:38:30.773767 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.773751    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 27 20:38:30.785311 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.785261    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 27 20:38:30.786383 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.786368    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 20:38:30.798215 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.798197    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 20:38:30.799879 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.799865    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 20:38:30.808548 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.808527    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hgqwx\""
Jul 27 20:38:30.819151 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.819130    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 20:38:30.824937 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.824919    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:38:30.842180 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.842163    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 20:38:30.847916 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.847897    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 27 20:38:30.850697 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.850685    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 20:38:30.853437 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.853423    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 27 20:38:30.853593 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.853576    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 20:38:30.855182 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.855150    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 27 20:38:30.868217 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.868196    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k5jnc\""
Jul 27 20:38:30.869690 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.869674    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 27 20:38:30.874288 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.874256    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pl2wx\""
Jul 27 20:38:30.894498 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.894479    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:38:30.897865 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.897848    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 20:38:30.901318 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.901297    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kqrvq\""
Jul 27 20:38:30.904522 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.904506    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tnlvr\""
Jul 27 20:38:30.912173 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.912157    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 27 20:38:30.912260 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.912212    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 27 20:38:30.913080 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.913067    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 27 20:38:30.914650 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.914636    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8t4xf\""
Jul 27 20:38:30.919138 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.919123    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 20:38:30.934946 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.934896    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 27 20:38:30.935906 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.935893    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 20:38:30.938431 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.938418    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 27 20:38:30.941189 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.941175    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 27 20:38:30.969531 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.969510    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6j6jl\""
Jul 27 20:38:30.971102 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.971087    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 20:38:30.980949 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.980930    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 27 20:38:30.997025 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.997007    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:38:30.999922 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:30.999907    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8vgq5\""
Jul 27 20:38:31.003535 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.003521    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 20:38:31.005253 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.005237    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 27 20:38:31.012892 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.012876    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ndx4b\""
Jul 27 20:38:31.015704 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.015688    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 27 20:38:31.016468 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.016447    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 20:38:31.028136 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.028119    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 27 20:38:31.028244 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.028122    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 20:38:31.031334 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.031317    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 27 20:38:31.031749 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.031734    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dzgwf\""
Jul 27 20:38:31.043850 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.043831    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2p8xj\""
Jul 27 20:38:31.053250 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.053232    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 20:38:31.059043 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.059025    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z2vk7\""
Jul 27 20:38:31.063727 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.063711    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 20:38:31.063772 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.063716    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dfz44\""
Jul 27 20:38:31.068309 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.068294    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 20:38:31.090310 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.090289    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 27 20:38:31.093060 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.093046    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 20:38:31.106008 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.105988    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 20:38:31.106651 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.106638    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:38:31.113338 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.113323    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 20:38:31.123813 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.123795    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 27 20:38:31.124451 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.124436    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dwzcd\""
Jul 27 20:38:31.134976 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.134959    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 20:38:31.135116 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.135103    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 20:38:31.146581 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.146561    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 27 20:38:31.151043 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.151027    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:38:31.152195 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.152180    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sjvtx\""
Jul 27 20:38:31.158040 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.158025    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 27 20:38:31.163284 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.163261    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-n6tnw\""
Jul 27 20:38:31.178328 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.178310    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:38:31.180004 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.179989    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 20:38:31.185734 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.185688    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 20:38:31.205014 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.204993    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 20:38:31.205185 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.205171    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 27 20:38:31.206462 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.206446    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:38:31.226232 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.226213    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:38:31.239818 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.239798    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cgfst\""
Jul 27 20:38:31.243375 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.243360    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 27 20:38:31.244834 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.244820    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 20:38:31.247803 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.247787    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 20:38:31.249416 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.249399    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 20:38:31.256249 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.256231    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 20:38:31.256351 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.256239    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 20:38:31.284728 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.284708    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 20:38:31.297039 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.297017    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-k6vd7\""
Jul 27 20:38:31.297144 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.297019    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 20:38:31.303824 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.303806    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 27 20:38:31.323901 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.323883    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 20:38:31.352112 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.352089    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:38:31.354254 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.354233    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 20:38:31.354254 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.354248    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 20:38:31.361936 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.361919    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 20:38:31.363911 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.363895    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 20:38:31.369747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.369731    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8jmkm\""
Jul 27 20:38:31.370642 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.370629    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5pq2v\""
Jul 27 20:38:31.373969 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.373954    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:38:31.391480 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.391456    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 20:38:31.393225 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.393207    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xb79c\""
Jul 27 20:38:31.396240 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.396219    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 20:38:31.400187 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.400171    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 27 20:38:31.413839 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.413811    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 27 20:38:31.415963 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.415945    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 27 20:38:31.417147 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.417129    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 20:38:31.421479 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.421463    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 20:38:31.427836 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.427821    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:38:31.435161 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.435145    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t7c5q\""
Jul 27 20:38:31.438615 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.438574    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:38:31.445021 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.445004    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 20:38:31.446911 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.446897    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ltd6n\""
Jul 27 20:38:31.449255 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.449241    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mx4h5\""
Jul 27 20:38:31.455905 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.454627    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 27 20:38:31.457410 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:38:31.457392    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 20:39:20.764859 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:20.764831    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 20:39:20.770640 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:20.770622    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 20:39:20.775286 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:20.775252    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 20:39:20.779601 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:20.779580    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 20:39:20.780943 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:20.780927    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 20:39:20.782443 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:20.782427    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 20:39:20.790740 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:20.790721    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 20:39:51.935549 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:51.935517    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"]
Jul 27 20:39:51.937876 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:51.935814    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cc698af-ec70-45f5-8212-2ae3213eaf83" containerName="registry"
Jul 27 20:39:51.937876 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:51.935824    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cc698af-ec70-45f5-8212-2ae3213eaf83" containerName="registry"
Jul 27 20:39:51.937876 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:51.935881    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cc698af-ec70-45f5-8212-2ae3213eaf83" containerName="registry"
Jul 27 20:39:51.938753 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:51.938737    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:39:51.943486 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:51.943460    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 20:39:51.943621 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:51.943597    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 20:39:51.943693 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:51.943628    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 20:39:51.943693 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:51.943676    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ln5pk\""
Jul 27 20:39:51.943792 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:51.943704    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 20:39:51.964547 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:51.964525    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"]
Jul 27 20:39:52.020916 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.020885    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxxqm\" (UniqueName: \"kubernetes.io/projected/767d4400-0e3f-47ee-b1fa-1b4c729bca4c-kube-api-access-zxxqm\") pod \"opendatahub-operator-controller-manager-9b945668b-h2jg2\" (UID: \"767d4400-0e3f-47ee-b1fa-1b4c729bca4c\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:39:52.021067 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.020927    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/767d4400-0e3f-47ee-b1fa-1b4c729bca4c-manifests\") pod \"opendatahub-operator-controller-manager-9b945668b-h2jg2\" (UID: \"767d4400-0e3f-47ee-b1fa-1b4c729bca4c\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:39:52.021067 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.020957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/767d4400-0e3f-47ee-b1fa-1b4c729bca4c-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b945668b-h2jg2\" (UID: \"767d4400-0e3f-47ee-b1fa-1b4c729bca4c\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:39:52.021067 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.021024    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/767d4400-0e3f-47ee-b1fa-1b4c729bca4c-tmp\") pod \"opendatahub-operator-controller-manager-9b945668b-h2jg2\" (UID: \"767d4400-0e3f-47ee-b1fa-1b4c729bca4c\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:39:52.021167 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.021072    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/767d4400-0e3f-47ee-b1fa-1b4c729bca4c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b945668b-h2jg2\" (UID: \"767d4400-0e3f-47ee-b1fa-1b4c729bca4c\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:39:52.122469 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.122431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/767d4400-0e3f-47ee-b1fa-1b4c729bca4c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b945668b-h2jg2\" (UID: \"767d4400-0e3f-47ee-b1fa-1b4c729bca4c\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:39:52.122641 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.122480    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxxqm\" (UniqueName: \"kubernetes.io/projected/767d4400-0e3f-47ee-b1fa-1b4c729bca4c-kube-api-access-zxxqm\") pod \"opendatahub-operator-controller-manager-9b945668b-h2jg2\" (UID: \"767d4400-0e3f-47ee-b1fa-1b4c729bca4c\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:39:52.122641 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.122523    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/767d4400-0e3f-47ee-b1fa-1b4c729bca4c-manifests\") pod \"opendatahub-operator-controller-manager-9b945668b-h2jg2\" (UID: \"767d4400-0e3f-47ee-b1fa-1b4c729bca4c\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:39:52.122641 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.122566    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/767d4400-0e3f-47ee-b1fa-1b4c729bca4c-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b945668b-h2jg2\" (UID: \"767d4400-0e3f-47ee-b1fa-1b4c729bca4c\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:39:52.122641 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.122609    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/767d4400-0e3f-47ee-b1fa-1b4c729bca4c-tmp\") pod \"opendatahub-operator-controller-manager-9b945668b-h2jg2\" (UID: \"767d4400-0e3f-47ee-b1fa-1b4c729bca4c\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:39:52.123030 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.123002    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/767d4400-0e3f-47ee-b1fa-1b4c729bca4c-manifests\") pod \"opendatahub-operator-controller-manager-9b945668b-h2jg2\" (UID: \"767d4400-0e3f-47ee-b1fa-1b4c729bca4c\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:39:52.124806 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.124767    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/767d4400-0e3f-47ee-b1fa-1b4c729bca4c-tmp\") pod \"opendatahub-operator-controller-manager-9b945668b-h2jg2\" (UID: \"767d4400-0e3f-47ee-b1fa-1b4c729bca4c\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:39:52.125044 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.125026    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/767d4400-0e3f-47ee-b1fa-1b4c729bca4c-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b945668b-h2jg2\" (UID: \"767d4400-0e3f-47ee-b1fa-1b4c729bca4c\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:39:52.125130 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.125108    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/767d4400-0e3f-47ee-b1fa-1b4c729bca4c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b945668b-h2jg2\" (UID: \"767d4400-0e3f-47ee-b1fa-1b4c729bca4c\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:39:52.130372 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.130347    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxxqm\" (UniqueName: \"kubernetes.io/projected/767d4400-0e3f-47ee-b1fa-1b4c729bca4c-kube-api-access-zxxqm\") pod \"opendatahub-operator-controller-manager-9b945668b-h2jg2\" (UID: \"767d4400-0e3f-47ee-b1fa-1b4c729bca4c\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:39:52.250466 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.250379    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:39:52.382686 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.382660    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"]
Jul 27 20:39:52.384826 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:39:52.384794    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767d4400_0e3f_47ee_b1fa_1b4c729bca4c.slice/crio-980c00d98aea8faa3add249990553b3e2eaa06e7e7d70767ca47304c79889bcf WatchSource:0}: Error finding container 980c00d98aea8faa3add249990553b3e2eaa06e7e7d70767ca47304c79889bcf: Status 404 returned error can't find the container with id 980c00d98aea8faa3add249990553b3e2eaa06e7e7d70767ca47304c79889bcf
Jul 27 20:39:52.386607 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.386588    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:39:52.421541 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:52.421512    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2" event={"ID":"767d4400-0e3f-47ee-b1fa-1b4c729bca4c","Type":"ContainerStarted","Data":"980c00d98aea8faa3add249990553b3e2eaa06e7e7d70767ca47304c79889bcf"}
Jul 27 20:39:56.442456 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:56.442419    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2" event={"ID":"767d4400-0e3f-47ee-b1fa-1b4c729bca4c","Type":"ContainerStarted","Data":"9811c45115120d6a4a24f5b2976119c5f9df6fd8e2b44d72fcdac92c339c9170"}
Jul 27 20:39:57.447223 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:57.447193    2562 generic.go:356] "Generic (PLEG): container finished" podID="767d4400-0e3f-47ee-b1fa-1b4c729bca4c" containerID="9811c45115120d6a4a24f5b2976119c5f9df6fd8e2b44d72fcdac92c339c9170" exitCode=0
Jul 27 20:39:57.447601 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:57.447295    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2" event={"ID":"767d4400-0e3f-47ee-b1fa-1b4c729bca4c","Type":"ContainerDied","Data":"9811c45115120d6a4a24f5b2976119c5f9df6fd8e2b44d72fcdac92c339c9170"}
Jul 27 20:39:58.454339 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:58.454308    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2" event={"ID":"767d4400-0e3f-47ee-b1fa-1b4c729bca4c","Type":"ContainerStarted","Data":"c66da5f884aa3e244f4cd941969b57690e7801cee8d6848b6b4e502f048782aa"}
Jul 27 20:39:58.454717 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:39:58.454426    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:40:09.460999 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:09.460967    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2"
Jul 27 20:40:09.489307 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:09.489235    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-h2jg2" podStartSLOduration=13.549142073 podStartE2EDuration="18.48921968s" totalImagesPullingTime="3.873505023s" totalInitContainerRuntime="1.066572584s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:39:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:39:58.489864324 +0000 UTC m=+338.130080763" watchObservedRunningTime="2026-07-27 20:40:09.48921968 +0000 UTC m=+349.129436118"
Jul 27 20:40:12.872394 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:12.872362    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mvr6f"]
Jul 27 20:40:12.886112 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:12.886082    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mvr6f"
Jul 27 20:40:12.893920 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:12.893897    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 27 20:40:12.894048 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:12.893918    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-kvpw9\""
Jul 27 20:40:12.944864 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:12.944830    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mvr6f"]
Jul 27 20:40:12.997408 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:12.997380    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8de06676-b75e-4d35-b362-5a0eaa84e635-cert\") pod \"odh-model-controller-7998c67dc4-mvr6f\" (UID: \"8de06676-b75e-4d35-b362-5a0eaa84e635\") " pod="opendatahub/odh-model-controller-7998c67dc4-mvr6f"
Jul 27 20:40:12.997561 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:12.997412    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64x77\" (UniqueName: \"kubernetes.io/projected/8de06676-b75e-4d35-b362-5a0eaa84e635-kube-api-access-64x77\") pod \"odh-model-controller-7998c67dc4-mvr6f\" (UID: \"8de06676-b75e-4d35-b362-5a0eaa84e635\") " pod="opendatahub/odh-model-controller-7998c67dc4-mvr6f"
Jul 27 20:40:13.098536 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:13.098501    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8de06676-b75e-4d35-b362-5a0eaa84e635-cert\") pod \"odh-model-controller-7998c67dc4-mvr6f\" (UID: \"8de06676-b75e-4d35-b362-5a0eaa84e635\") " pod="opendatahub/odh-model-controller-7998c67dc4-mvr6f"
Jul 27 20:40:13.098536 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:13.098539    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64x77\" (UniqueName: \"kubernetes.io/projected/8de06676-b75e-4d35-b362-5a0eaa84e635-kube-api-access-64x77\") pod \"odh-model-controller-7998c67dc4-mvr6f\" (UID: \"8de06676-b75e-4d35-b362-5a0eaa84e635\") " pod="opendatahub/odh-model-controller-7998c67dc4-mvr6f"
Jul 27 20:40:13.098731 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:40:13.098674    2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 27 20:40:13.098777 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:40:13.098758    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8de06676-b75e-4d35-b362-5a0eaa84e635-cert podName:8de06676-b75e-4d35-b362-5a0eaa84e635 nodeName:}" failed. No retries permitted until 2026-07-27 20:40:13.598736958 +0000 UTC m=+353.238953381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8de06676-b75e-4d35-b362-5a0eaa84e635-cert") pod "odh-model-controller-7998c67dc4-mvr6f" (UID: "8de06676-b75e-4d35-b362-5a0eaa84e635") : secret "odh-model-controller-webhook-cert" not found
Jul 27 20:40:13.154775 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:13.154690    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64x77\" (UniqueName: \"kubernetes.io/projected/8de06676-b75e-4d35-b362-5a0eaa84e635-kube-api-access-64x77\") pod \"odh-model-controller-7998c67dc4-mvr6f\" (UID: \"8de06676-b75e-4d35-b362-5a0eaa84e635\") " pod="opendatahub/odh-model-controller-7998c67dc4-mvr6f"
Jul 27 20:40:13.601969 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:13.601940    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8de06676-b75e-4d35-b362-5a0eaa84e635-cert\") pod \"odh-model-controller-7998c67dc4-mvr6f\" (UID: \"8de06676-b75e-4d35-b362-5a0eaa84e635\") " pod="opendatahub/odh-model-controller-7998c67dc4-mvr6f"
Jul 27 20:40:13.604229 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:13.604207    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8de06676-b75e-4d35-b362-5a0eaa84e635-cert\") pod \"odh-model-controller-7998c67dc4-mvr6f\" (UID: \"8de06676-b75e-4d35-b362-5a0eaa84e635\") " pod="opendatahub/odh-model-controller-7998c67dc4-mvr6f"
Jul 27 20:40:13.796457 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:13.796425    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mvr6f"
Jul 27 20:40:13.935207 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:13.935151    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mvr6f"]
Jul 27 20:40:13.937361 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:40:13.937330    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8de06676_b75e_4d35_b362_5a0eaa84e635.slice/crio-b283540509a5fa2f21a98d30b45c56c58f214fd65a2c5fb105d3af0168fe1ea6 WatchSource:0}: Error finding container b283540509a5fa2f21a98d30b45c56c58f214fd65a2c5fb105d3af0168fe1ea6: Status 404 returned error can't find the container with id b283540509a5fa2f21a98d30b45c56c58f214fd65a2c5fb105d3af0168fe1ea6
Jul 27 20:40:14.178875 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:14.178796    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lzpj7"]
Jul 27 20:40:14.183673 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:14.183654    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lzpj7"
Jul 27 20:40:14.188454 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:14.188428    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 27 20:40:14.188557 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:14.188525    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-snckb\""
Jul 27 20:40:14.208836 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:14.208810    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lzpj7"]
Jul 27 20:40:14.309232 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:14.309198    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc0eca5-fe9d-42f5-aabf-509f36c4c963-tls-certs\") pod \"model-serving-api-54d89bd5fc-lzpj7\" (UID: \"bbc0eca5-fe9d-42f5-aabf-509f36c4c963\") " pod="opendatahub/model-serving-api-54d89bd5fc-lzpj7"
Jul 27 20:40:14.309427 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:14.309260    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk49m\" (UniqueName: \"kubernetes.io/projected/bbc0eca5-fe9d-42f5-aabf-509f36c4c963-kube-api-access-mk49m\") pod \"model-serving-api-54d89bd5fc-lzpj7\" (UID: \"bbc0eca5-fe9d-42f5-aabf-509f36c4c963\") " pod="opendatahub/model-serving-api-54d89bd5fc-lzpj7"
Jul 27 20:40:14.410579 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:14.410549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc0eca5-fe9d-42f5-aabf-509f36c4c963-tls-certs\") pod \"model-serving-api-54d89bd5fc-lzpj7\" (UID: \"bbc0eca5-fe9d-42f5-aabf-509f36c4c963\") " pod="opendatahub/model-serving-api-54d89bd5fc-lzpj7"
Jul 27 20:40:14.410761 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:14.410596    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk49m\" (UniqueName: \"kubernetes.io/projected/bbc0eca5-fe9d-42f5-aabf-509f36c4c963-kube-api-access-mk49m\") pod \"model-serving-api-54d89bd5fc-lzpj7\" (UID: \"bbc0eca5-fe9d-42f5-aabf-509f36c4c963\") " pod="opendatahub/model-serving-api-54d89bd5fc-lzpj7"
Jul 27 20:40:14.410761 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:40:14.410696    2562 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 27 20:40:14.410761 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:40:14.410757    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbc0eca5-fe9d-42f5-aabf-509f36c4c963-tls-certs podName:bbc0eca5-fe9d-42f5-aabf-509f36c4c963 nodeName:}" failed. No retries permitted until 2026-07-27 20:40:14.910742631 +0000 UTC m=+354.550959047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bbc0eca5-fe9d-42f5-aabf-509f36c4c963-tls-certs") pod "model-serving-api-54d89bd5fc-lzpj7" (UID: "bbc0eca5-fe9d-42f5-aabf-509f36c4c963") : secret "model-serving-api-tls" not found
Jul 27 20:40:14.421084 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:14.421057    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk49m\" (UniqueName: \"kubernetes.io/projected/bbc0eca5-fe9d-42f5-aabf-509f36c4c963-kube-api-access-mk49m\") pod \"model-serving-api-54d89bd5fc-lzpj7\" (UID: \"bbc0eca5-fe9d-42f5-aabf-509f36c4c963\") " pod="opendatahub/model-serving-api-54d89bd5fc-lzpj7"
Jul 27 20:40:14.523999 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:14.523931    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mvr6f" event={"ID":"8de06676-b75e-4d35-b362-5a0eaa84e635","Type":"ContainerStarted","Data":"b283540509a5fa2f21a98d30b45c56c58f214fd65a2c5fb105d3af0168fe1ea6"}
Jul 27 20:40:14.915451 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:14.915404    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc0eca5-fe9d-42f5-aabf-509f36c4c963-tls-certs\") pod \"model-serving-api-54d89bd5fc-lzpj7\" (UID: \"bbc0eca5-fe9d-42f5-aabf-509f36c4c963\") " pod="opendatahub/model-serving-api-54d89bd5fc-lzpj7"
Jul 27 20:40:14.918593 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:14.918565    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc0eca5-fe9d-42f5-aabf-509f36c4c963-tls-certs\") pod \"model-serving-api-54d89bd5fc-lzpj7\" (UID: \"bbc0eca5-fe9d-42f5-aabf-509f36c4c963\") " pod="opendatahub/model-serving-api-54d89bd5fc-lzpj7"
Jul 27 20:40:15.094128 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:15.094089    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lzpj7"
Jul 27 20:40:15.317441 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:15.317406    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lzpj7"]
Jul 27 20:40:16.421023 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:40:16.420989    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc0eca5_fe9d_42f5_aabf_509f36c4c963.slice/crio-31bb07456f0fbcfa3e18f7c92c30fe3e5dc4667a7f80353b5875c49332b4a3b6 WatchSource:0}: Error finding container 31bb07456f0fbcfa3e18f7c92c30fe3e5dc4667a7f80353b5875c49332b4a3b6: Status 404 returned error can't find the container with id 31bb07456f0fbcfa3e18f7c92c30fe3e5dc4667a7f80353b5875c49332b4a3b6
Jul 27 20:40:16.535768 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:16.535743    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mvr6f" event={"ID":"8de06676-b75e-4d35-b362-5a0eaa84e635","Type":"ContainerStarted","Data":"6bfc8bd53d9faf3c4e119ac2b707bb7218d858db4600f975e0ce03652e240e95"}
Jul 27 20:40:16.535899 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:16.535876    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-mvr6f"
Jul 27 20:40:16.537060 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:16.537039    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lzpj7" event={"ID":"bbc0eca5-fe9d-42f5-aabf-509f36c4c963","Type":"ContainerStarted","Data":"31bb07456f0fbcfa3e18f7c92c30fe3e5dc4667a7f80353b5875c49332b4a3b6"}
Jul 27 20:40:16.563679 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:16.563625    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-mvr6f" podStartSLOduration=2.02994861 podStartE2EDuration="4.563605457s" totalImagesPullingTime="2.533656847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:40:16.563208078 +0000 UTC m=+356.203424545" watchObservedRunningTime="2026-07-27 20:40:16.563605457 +0000 UTC m=+356.203821902"
Jul 27 20:40:18.517315 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:18.517203    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-86f57966b4-v8tsh"]
Jul 27 20:40:18.520784 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:18.520760    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86f57966b4-v8tsh"
Jul 27 20:40:18.523640 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:18.523620    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 27 20:40:18.524139 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:18.524116    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 20:40:18.542024 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:18.541997    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86f57966b4-v8tsh"]
Jul 27 20:40:18.548104 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:18.548075    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lzpj7" event={"ID":"bbc0eca5-fe9d-42f5-aabf-509f36c4c963","Type":"ContainerStarted","Data":"ff23e96bdff4a69df13ac4849710a0cfcc9c201b56164bf6bf88aac70484265b"}
Jul 27 20:40:18.548227 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:18.548191    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-lzpj7"
Jul 27 20:40:18.647576 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:18.647543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c13b62a-e640-4e08-be6b-54932c7c86bf-tmp\") pod \"kube-auth-proxy-86f57966b4-v8tsh\" (UID: \"7c13b62a-e640-4e08-be6b-54932c7c86bf\") " pod="openshift-ingress/kube-auth-proxy-86f57966b4-v8tsh"
Jul 27 20:40:18.647748 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:18.647612    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b96j\" (UniqueName: \"kubernetes.io/projected/7c13b62a-e640-4e08-be6b-54932c7c86bf-kube-api-access-7b96j\") pod \"kube-auth-proxy-86f57966b4-v8tsh\" (UID: \"7c13b62a-e640-4e08-be6b-54932c7c86bf\") " pod="openshift-ingress/kube-auth-proxy-86f57966b4-v8tsh"
Jul 27 20:40:18.647748 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:18.647674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c13b62a-e640-4e08-be6b-54932c7c86bf-tls-certs\") pod \"kube-auth-proxy-86f57966b4-v8tsh\" (UID: \"7c13b62a-e640-4e08-be6b-54932c7c86bf\") " pod="openshift-ingress/kube-auth-proxy-86f57966b4-v8tsh"
Jul 27 20:40:18.657342 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:18.657281    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-lzpj7" podStartSLOduration=2.965246326 podStartE2EDuration="4.657252715s" totalImagesPullingTime="1.692006389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:40:18.653887895 +0000 UTC m=+358.294104363" watchObservedRunningTime="2026-07-27 20:40:18.657252715 +0000 UTC m=+358.297469154"
Jul 27 20:40:18.748688 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:18.748656    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c13b62a-e640-4e08-be6b-54932c7c86bf-tmp\") pod \"kube-auth-proxy-86f57966b4-v8tsh\" (UID: \"7c13b62a-e640-4e08-be6b-54932c7c86bf\") " pod="openshift-ingress/kube-auth-proxy-86f57966b4-v8tsh"
Jul 27 20:40:18.748887 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:18.748712    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b96j\" (UniqueName: \"kubernetes.io/projected/7c13b62a-e640-4e08-be6b-54932c7c86bf-kube-api-access-7b96j\") pod \"kube-auth-proxy-86f57966b4-v8tsh\" (UID: \"7c13b62a-e640-4e08-be6b-54932c7c86bf\") " pod="openshift-ingress/kube-auth-proxy-86f57966b4-v8tsh"
Jul 27 20:40:18.748887 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:18.748750    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c13b62a-e640-4e08-be6b-54932c7c86bf-tls-certs\") pod \"kube-auth-proxy-86f57966b4-v8tsh\" (UID: \"7c13b62a-e640-4e08-be6b-54932c7c86bf\") " pod="openshift-ingress/kube-auth-proxy-86f57966b4-v8tsh"
Jul 27 20:40:18.748887 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:40:18.748861    2562 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 27 20:40:18.749044 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:40:18.748920    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c13b62a-e640-4e08-be6b-54932c7c86bf-tls-certs podName:7c13b62a-e640-4e08-be6b-54932c7c86bf nodeName:}" failed. No retries permitted until 2026-07-27 20:40:19.248901225 +0000 UTC m=+358.889117662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7c13b62a-e640-4e08-be6b-54932c7c86bf-tls-certs") pod "kube-auth-proxy-86f57966b4-v8tsh" (UID: "7c13b62a-e640-4e08-be6b-54932c7c86bf") : secret "kube-auth-proxy-tls" not found
Jul 27 20:40:18.750857 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:18.750830    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c13b62a-e640-4e08-be6b-54932c7c86bf-tmp\") pod \"kube-auth-proxy-86f57966b4-v8tsh\" (UID: \"7c13b62a-e640-4e08-be6b-54932c7c86bf\") " pod="openshift-ingress/kube-auth-proxy-86f57966b4-v8tsh"
Jul 27 20:40:18.762115 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:18.762095    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b96j\" (UniqueName: \"kubernetes.io/projected/7c13b62a-e640-4e08-be6b-54932c7c86bf-kube-api-access-7b96j\") pod \"kube-auth-proxy-86f57966b4-v8tsh\" (UID: \"7c13b62a-e640-4e08-be6b-54932c7c86bf\") " pod="openshift-ingress/kube-auth-proxy-86f57966b4-v8tsh"
Jul 27 20:40:19.253341 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:19.253297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c13b62a-e640-4e08-be6b-54932c7c86bf-tls-certs\") pod \"kube-auth-proxy-86f57966b4-v8tsh\" (UID: \"7c13b62a-e640-4e08-be6b-54932c7c86bf\") " pod="openshift-ingress/kube-auth-proxy-86f57966b4-v8tsh"
Jul 27 20:40:19.255686 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:19.255657    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c13b62a-e640-4e08-be6b-54932c7c86bf-tls-certs\") pod \"kube-auth-proxy-86f57966b4-v8tsh\" (UID: \"7c13b62a-e640-4e08-be6b-54932c7c86bf\") " pod="openshift-ingress/kube-auth-proxy-86f57966b4-v8tsh"
Jul 27 20:40:19.430910 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:19.430874    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86f57966b4-v8tsh"
Jul 27 20:40:19.617808 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:40:19.617778    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c13b62a_e640_4e08_be6b_54932c7c86bf.slice/crio-1aefd1bb0d42cec5ac82609fbdde932c38d2a6dc132378f6029925fd8be3ff61 WatchSource:0}: Error finding container 1aefd1bb0d42cec5ac82609fbdde932c38d2a6dc132378f6029925fd8be3ff61: Status 404 returned error can't find the container with id 1aefd1bb0d42cec5ac82609fbdde932c38d2a6dc132378f6029925fd8be3ff61
Jul 27 20:40:19.624231 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:19.624178    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86f57966b4-v8tsh"]
Jul 27 20:40:20.560975 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:20.560938    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86f57966b4-v8tsh" event={"ID":"7c13b62a-e640-4e08-be6b-54932c7c86bf","Type":"ContainerStarted","Data":"1aefd1bb0d42cec5ac82609fbdde932c38d2a6dc132378f6029925fd8be3ff61"}
Jul 27 20:40:21.322456 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.322422    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"]
Jul 27 20:40:21.327623 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.327601    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.332216 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.332187    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 20:40:21.332464 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.332439    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 20:40:21.332582 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.332450    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-64rq2\""
Jul 27 20:40:21.332958 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.332934    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 20:40:21.333247 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.333233    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 20:40:21.362881 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.362854    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"]
Jul 27 20:40:21.472444 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.472405    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42f45d03-86d4-44b3-9368-e7c84cd96496-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.472622 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.472456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/42f45d03-86d4-44b3-9368-e7c84cd96496-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.472622 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.472581    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/42f45d03-86d4-44b3-9368-e7c84cd96496-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.472730 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.472637    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/42f45d03-86d4-44b3-9368-e7c84cd96496-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.472730 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.472671    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/42f45d03-86d4-44b3-9368-e7c84cd96496-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.472730 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.472693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9t4f\" (UniqueName: \"kubernetes.io/projected/42f45d03-86d4-44b3-9368-e7c84cd96496-kube-api-access-x9t4f\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.472876 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.472801    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/42f45d03-86d4-44b3-9368-e7c84cd96496-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.573898 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.573819    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/42f45d03-86d4-44b3-9368-e7c84cd96496-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.573898 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.573854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42f45d03-86d4-44b3-9368-e7c84cd96496-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.573898 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.573871    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/42f45d03-86d4-44b3-9368-e7c84cd96496-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.574167 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.573925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/42f45d03-86d4-44b3-9368-e7c84cd96496-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.574167 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.573953    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/42f45d03-86d4-44b3-9368-e7c84cd96496-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.574167 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.573986    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/42f45d03-86d4-44b3-9368-e7c84cd96496-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.574167 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.574017    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9t4f\" (UniqueName: \"kubernetes.io/projected/42f45d03-86d4-44b3-9368-e7c84cd96496-kube-api-access-x9t4f\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.574627 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.574600    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/42f45d03-86d4-44b3-9368-e7c84cd96496-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.576372 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.576338    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/42f45d03-86d4-44b3-9368-e7c84cd96496-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.576499 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.576353    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/42f45d03-86d4-44b3-9368-e7c84cd96496-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.576699 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.576679    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/42f45d03-86d4-44b3-9368-e7c84cd96496-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.576733 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.576693    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/42f45d03-86d4-44b3-9368-e7c84cd96496-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.586842 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.586817    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42f45d03-86d4-44b3-9368-e7c84cd96496-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.587030 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.587012    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9t4f\" (UniqueName: \"kubernetes.io/projected/42f45d03-86d4-44b3-9368-e7c84cd96496-kube-api-access-x9t4f\") pod \"istiod-openshift-gateway-5677ccb49b-98www\" (UID: \"42f45d03-86d4-44b3-9368-e7c84cd96496\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.639058 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.639016    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:21.834753 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:21.834722    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"]
Jul 27 20:40:22.298594 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:40:22.298526    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42f45d03_86d4_44b3_9368_e7c84cd96496.slice/crio-29a2c5afad3125c4def7a5674a540f351d229859227ca9b905bf4dd7642cf707 WatchSource:0}: Error finding container 29a2c5afad3125c4def7a5674a540f351d229859227ca9b905bf4dd7642cf707: Status 404 returned error can't find the container with id 29a2c5afad3125c4def7a5674a540f351d229859227ca9b905bf4dd7642cf707
Jul 27 20:40:22.353403 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:22.353381    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 27 20:40:22.572368 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:22.572329    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86f57966b4-v8tsh" event={"ID":"7c13b62a-e640-4e08-be6b-54932c7c86bf","Type":"ContainerStarted","Data":"e7e29146d670348f6510fd41ad5cde7ba7107bf0771c7f7f6d10087dba17707e"}
Jul 27 20:40:22.573543 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:22.573516    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www" event={"ID":"42f45d03-86d4-44b3-9368-e7c84cd96496","Type":"ContainerStarted","Data":"29a2c5afad3125c4def7a5674a540f351d229859227ca9b905bf4dd7642cf707"}
Jul 27 20:40:22.645906 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:22.645854    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-86f57966b4-v8tsh" podStartSLOduration=1.916740157 podStartE2EDuration="4.645840236s" totalImagesPullingTime="2.729100079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:40:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:40:22.644032733 +0000 UTC m=+362.284249187" watchObservedRunningTime="2026-07-27 20:40:22.645840236 +0000 UTC m=+362.286056674"
Jul 27 20:40:24.949578 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:24.949539    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:40:24.949907 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:24.949608    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:40:25.589806 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:25.589768    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www" event={"ID":"42f45d03-86d4-44b3-9368-e7c84cd96496","Type":"ContainerStarted","Data":"5aca2d53b9f0553e98b520b014b2a06bee82290c6b8387ab6654d9cf55d34f02"}
Jul 27 20:40:25.589985 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:25.589834    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:40:25.642905 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:25.640633    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www" podStartSLOduration=1.9919690509999999 podStartE2EDuration="4.640612766s" totalImagesPullingTime="2.648643715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:40:25.636830923 +0000 UTC m=+365.277047363" watchObservedRunningTime="2026-07-27 20:40:25.640612766 +0000 UTC m=+365.280829207"
Jul 27 20:40:26.598436 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:26.598404    2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-98www container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 20:40:26.598848 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:26.598465    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www" podUID="42f45d03-86d4-44b3-9368-e7c84cd96496" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 20:40:27.544152 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:27.544119    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-mvr6f"
Jul 27 20:40:29.558485 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:29.558459    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-lzpj7"
Jul 27 20:40:29.597724 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:40:29.597698    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-98www"
Jul 27 20:41:44.953817 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:41:44.953743    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28"]
Jul 27 20:41:44.957053 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:41:44.957037    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28"
Jul 27 20:41:44.959887 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:41:44.959866    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 20:41:44.960070 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:41:44.960054    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pkgpm\""
Jul 27 20:41:44.960729 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:41:44.960714    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 20:41:44.988619 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:41:44.988593    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28"]
Jul 27 20:41:45.043817 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:41:45.043791    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrws4\" (UniqueName: \"kubernetes.io/projected/25a51b06-df1a-45f0-81bb-1825c379d810-kube-api-access-zrws4\") pod \"limitador-operator-controller-manager-859d7b78bd-l7n28\" (UID: \"25a51b06-df1a-45f0-81bb-1825c379d810\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28"
Jul 27 20:41:45.145213 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:41:45.145175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrws4\" (UniqueName: \"kubernetes.io/projected/25a51b06-df1a-45f0-81bb-1825c379d810-kube-api-access-zrws4\") pod \"limitador-operator-controller-manager-859d7b78bd-l7n28\" (UID: \"25a51b06-df1a-45f0-81bb-1825c379d810\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28"
Jul 27 20:41:45.158345 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:41:45.158313    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrws4\" (UniqueName: \"kubernetes.io/projected/25a51b06-df1a-45f0-81bb-1825c379d810-kube-api-access-zrws4\") pod \"limitador-operator-controller-manager-859d7b78bd-l7n28\" (UID: \"25a51b06-df1a-45f0-81bb-1825c379d810\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28"
Jul 27 20:41:45.266800 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:41:45.266717    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28"
Jul 27 20:41:45.406266 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:41:45.406241    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28"]
Jul 27 20:41:45.408626 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:41:45.408601    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a51b06_df1a_45f0_81bb_1825c379d810.slice/crio-b7c4275b52e9cc8cb7e5cb4bc375486f65639321e5b48ee3163f4d37f19f009c WatchSource:0}: Error finding container b7c4275b52e9cc8cb7e5cb4bc375486f65639321e5b48ee3163f4d37f19f009c: Status 404 returned error can't find the container with id b7c4275b52e9cc8cb7e5cb4bc375486f65639321e5b48ee3163f4d37f19f009c
Jul 27 20:41:45.943338 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:41:45.943305    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28" event={"ID":"25a51b06-df1a-45f0-81bb-1825c379d810","Type":"ContainerStarted","Data":"b7c4275b52e9cc8cb7e5cb4bc375486f65639321e5b48ee3163f4d37f19f009c"}
Jul 27 20:41:47.953328 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:41:47.953287    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28" event={"ID":"25a51b06-df1a-45f0-81bb-1825c379d810","Type":"ContainerStarted","Data":"54cec889ffca111706dff5ea86f4c73358cf6ce427141a80cdcce2581e97683b"}
Jul 27 20:41:47.953747 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:41:47.953378    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28"
Jul 27 20:41:47.969506 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:41:47.969464    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28" podStartSLOduration=2.018746884 podStartE2EDuration="3.969450691s" totalImagesPullingTime="1.950703807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:41:47.968441105 +0000 UTC m=+447.608657544" watchObservedRunningTime="2026-07-27 20:41:47.969450691 +0000 UTC m=+447.609667130"
Jul 27 20:41:58.960813 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:41:58.960775    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28"
Jul 27 20:42:14.754539 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:14.754504    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28"]
Jul 27 20:42:14.755006 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:14.754773    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28" podUID="25a51b06-df1a-45f0-81bb-1825c379d810" containerName="manager" containerID="cri-o://54cec889ffca111706dff5ea86f4c73358cf6ce427141a80cdcce2581e97683b" gracePeriod=2
Jul 27 20:42:14.764982 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:14.764952    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28"]
Jul 27 20:42:14.790818 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:14.790779    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pct7z"]
Jul 27 20:42:14.791831 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:14.791811    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25a51b06-df1a-45f0-81bb-1825c379d810" containerName="manager"
Jul 27 20:42:14.791886 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:14.791837    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="25a51b06-df1a-45f0-81bb-1825c379d810" containerName="manager"
Jul 27 20:42:14.791955 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:14.791944    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="25a51b06-df1a-45f0-81bb-1825c379d810" containerName="manager"
Jul 27 20:42:14.794909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:14.794888    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pct7z"
Jul 27 20:42:14.797324 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:42:14.797296    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-l7n28\" is forbidden: User \"system:node:ip-10-0-143-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-205.ec2.internal' and this object" podUID="25a51b06-df1a-45f0-81bb-1825c379d810" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28"
Jul 27 20:42:14.807666 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:14.807641    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pct7z"]
Jul 27 20:42:14.904390 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:14.904357    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-878f4\" (UniqueName: \"kubernetes.io/projected/75a67a19-1ff7-406c-b9b5-f1274771df20-kube-api-access-878f4\") pod \"limitador-operator-controller-manager-859d7b78bd-pct7z\" (UID: \"75a67a19-1ff7-406c-b9b5-f1274771df20\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pct7z"
Jul 27 20:42:14.991314 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:14.991293    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28"
Jul 27 20:42:15.005494 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:15.005443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-878f4\" (UniqueName: \"kubernetes.io/projected/75a67a19-1ff7-406c-b9b5-f1274771df20-kube-api-access-878f4\") pod \"limitador-operator-controller-manager-859d7b78bd-pct7z\" (UID: \"75a67a19-1ff7-406c-b9b5-f1274771df20\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pct7z"
Jul 27 20:42:15.025909 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:15.025882    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-878f4\" (UniqueName: \"kubernetes.io/projected/75a67a19-1ff7-406c-b9b5-f1274771df20-kube-api-access-878f4\") pod \"limitador-operator-controller-manager-859d7b78bd-pct7z\" (UID: \"75a67a19-1ff7-406c-b9b5-f1274771df20\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pct7z"
Jul 27 20:42:15.078500 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:15.078469    2562 generic.go:356] "Generic (PLEG): container finished" podID="25a51b06-df1a-45f0-81bb-1825c379d810" containerID="54cec889ffca111706dff5ea86f4c73358cf6ce427141a80cdcce2581e97683b" exitCode=0
Jul 27 20:42:15.078660 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:15.078518    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l7n28"
Jul 27 20:42:15.078660 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:15.078544    2562 scope.go:117] "RemoveContainer" containerID="54cec889ffca111706dff5ea86f4c73358cf6ce427141a80cdcce2581e97683b"
Jul 27 20:42:15.086987 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:15.086970    2562 scope.go:117] "RemoveContainer" containerID="54cec889ffca111706dff5ea86f4c73358cf6ce427141a80cdcce2581e97683b"
Jul 27 20:42:15.087238 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:42:15.087220    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54cec889ffca111706dff5ea86f4c73358cf6ce427141a80cdcce2581e97683b\": container with ID starting with 54cec889ffca111706dff5ea86f4c73358cf6ce427141a80cdcce2581e97683b not found: ID does not exist" containerID="54cec889ffca111706dff5ea86f4c73358cf6ce427141a80cdcce2581e97683b"
Jul 27 20:42:15.087338 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:15.087247    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54cec889ffca111706dff5ea86f4c73358cf6ce427141a80cdcce2581e97683b"} err="failed to get container status \"54cec889ffca111706dff5ea86f4c73358cf6ce427141a80cdcce2581e97683b\": rpc error: code = NotFound desc = could not find container \"54cec889ffca111706dff5ea86f4c73358cf6ce427141a80cdcce2581e97683b\": container with ID starting with 54cec889ffca111706dff5ea86f4c73358cf6ce427141a80cdcce2581e97683b not found: ID does not exist"
Jul 27 20:42:15.106143 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:15.106120    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrws4\" (UniqueName: \"kubernetes.io/projected/25a51b06-df1a-45f0-81bb-1825c379d810-kube-api-access-zrws4\") pod \"25a51b06-df1a-45f0-81bb-1825c379d810\" (UID: \"25a51b06-df1a-45f0-81bb-1825c379d810\") "
Jul 27 20:42:15.108117 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:15.108097    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25a51b06-df1a-45f0-81bb-1825c379d810-kube-api-access-zrws4" (OuterVolumeSpecName: "kube-api-access-zrws4") pod "25a51b06-df1a-45f0-81bb-1825c379d810" (UID: "25a51b06-df1a-45f0-81bb-1825c379d810"). InnerVolumeSpecName "kube-api-access-zrws4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:42:15.134303 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:15.134260    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pct7z"
Jul 27 20:42:15.207224 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:15.207192    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrws4\" (UniqueName: \"kubernetes.io/projected/25a51b06-df1a-45f0-81bb-1825c379d810-kube-api-access-zrws4\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 20:42:15.270062 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:15.270037    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pct7z"]
Jul 27 20:42:15.271365 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:42:15.271333    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a67a19_1ff7_406c_b9b5_f1274771df20.slice/crio-2483ea3d521df1477551361a3958c12f8b675533329bbb940d91a8be954befd3 WatchSource:0}: Error finding container 2483ea3d521df1477551361a3958c12f8b675533329bbb940d91a8be954befd3: Status 404 returned error can't find the container with id 2483ea3d521df1477551361a3958c12f8b675533329bbb940d91a8be954befd3
Jul 27 20:42:16.085571 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:16.085538    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pct7z" event={"ID":"75a67a19-1ff7-406c-b9b5-f1274771df20","Type":"ContainerStarted","Data":"7482ac89252845ce5e88c0412df594af4ded2839817b75e066b001593e45bbe1"}
Jul 27 20:42:16.086111 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:16.085584    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pct7z" event={"ID":"75a67a19-1ff7-406c-b9b5-f1274771df20","Type":"ContainerStarted","Data":"2483ea3d521df1477551361a3958c12f8b675533329bbb940d91a8be954befd3"}
Jul 27 20:42:16.086111 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:16.085671    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pct7z"
Jul 27 20:42:16.106156 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:16.106112    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pct7z" podStartSLOduration=2.106099717 podStartE2EDuration="2.106099717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:42:16.103919985 +0000 UTC m=+475.744136426" watchObservedRunningTime="2026-07-27 20:42:16.106099717 +0000 UTC m=+475.746316155"
Jul 27 20:42:16.868902 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:16.868867    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25a51b06-df1a-45f0-81bb-1825c379d810" path="/var/lib/kubelet/pods/25a51b06-df1a-45f0-81bb-1825c379d810/volumes"
Jul 27 20:42:27.092593 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:42:27.092561    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pct7z"
Jul 27 20:43:08.138320 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:08.138288    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"]
Jul 27 20:43:08.141792 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:08.141776    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"
Jul 27 20:43:08.144156 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:08.144137    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l2mk4\""
Jul 27 20:43:08.144241 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:08.144180    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 20:43:08.151497 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:08.151472    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"]
Jul 27 20:43:08.232534 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:08.232500    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"]
Jul 27 20:43:08.234246 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:08.234225    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f178037-6a8c-4afa-beba-86f58b639b2b-config-file\") pod \"limitador-limitador-64c94fd64f-8m9p6\" (UID: \"0f178037-6a8c-4afa-beba-86f58b639b2b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"
Jul 27 20:43:08.234476 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:08.234261    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5ckv\" (UniqueName: \"kubernetes.io/projected/0f178037-6a8c-4afa-beba-86f58b639b2b-kube-api-access-d5ckv\") pod \"limitador-limitador-64c94fd64f-8m9p6\" (UID: \"0f178037-6a8c-4afa-beba-86f58b639b2b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"
Jul 27 20:43:08.334857 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:08.334828    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f178037-6a8c-4afa-beba-86f58b639b2b-config-file\") pod \"limitador-limitador-64c94fd64f-8m9p6\" (UID: \"0f178037-6a8c-4afa-beba-86f58b639b2b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"
Jul 27 20:43:08.334857 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:08.334866    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5ckv\" (UniqueName: \"kubernetes.io/projected/0f178037-6a8c-4afa-beba-86f58b639b2b-kube-api-access-d5ckv\") pod \"limitador-limitador-64c94fd64f-8m9p6\" (UID: \"0f178037-6a8c-4afa-beba-86f58b639b2b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"
Jul 27 20:43:08.335474 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:08.335454    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f178037-6a8c-4afa-beba-86f58b639b2b-config-file\") pod \"limitador-limitador-64c94fd64f-8m9p6\" (UID: \"0f178037-6a8c-4afa-beba-86f58b639b2b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"
Jul 27 20:43:08.343366 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:08.343340    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5ckv\" (UniqueName: \"kubernetes.io/projected/0f178037-6a8c-4afa-beba-86f58b639b2b-kube-api-access-d5ckv\") pod \"limitador-limitador-64c94fd64f-8m9p6\" (UID: \"0f178037-6a8c-4afa-beba-86f58b639b2b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"
Jul 27 20:43:08.453681 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:08.453599    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"
Jul 27 20:43:08.588373 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:08.588345    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"]
Jul 27 20:43:08.590102 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:43:08.590078    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f178037_6a8c_4afa_beba_86f58b639b2b.slice/crio-6278b5ec2412a561221a78099443e390c2d53a3861ec628cd79474392819f94f WatchSource:0}: Error finding container 6278b5ec2412a561221a78099443e390c2d53a3861ec628cd79474392819f94f: Status 404 returned error can't find the container with id 6278b5ec2412a561221a78099443e390c2d53a3861ec628cd79474392819f94f
Jul 27 20:43:09.319642 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:09.319608    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8m9p6" event={"ID":"0f178037-6a8c-4afa-beba-86f58b639b2b","Type":"ContainerStarted","Data":"6278b5ec2412a561221a78099443e390c2d53a3861ec628cd79474392819f94f"}
Jul 27 20:43:12.335339 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:12.335308    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8m9p6" event={"ID":"0f178037-6a8c-4afa-beba-86f58b639b2b","Type":"ContainerStarted","Data":"f706a52a8799a59a39faf332f13d191ade42dc8e538ee0db961423e475fe36aa"}
Jul 27 20:43:12.335706 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:12.335387    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"
Jul 27 20:43:12.351145 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:12.351096    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-8m9p6" podStartSLOduration=1.518812987 podStartE2EDuration="4.351082942s" totalImagesPullingTime="2.832269955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:43:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:43:12.350627995 +0000 UTC m=+531.990844435" watchObservedRunningTime="2026-07-27 20:43:12.351082942 +0000 UTC m=+531.991299380"
Jul 27 20:43:22.856314 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:22.856214    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"]
Jul 27 20:43:22.856737 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:22.856446    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-8m9p6" podUID="0f178037-6a8c-4afa-beba-86f58b639b2b" containerName="limitador" containerID="cri-o://f706a52a8799a59a39faf332f13d191ade42dc8e538ee0db961423e475fe36aa" gracePeriod=30
Jul 27 20:43:22.857120 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:22.857101    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"
Jul 27 20:43:23.384771 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:23.384740    2562 generic.go:356] "Generic (PLEG): container finished" podID="0f178037-6a8c-4afa-beba-86f58b639b2b" containerID="f706a52a8799a59a39faf332f13d191ade42dc8e538ee0db961423e475fe36aa" exitCode=0
Jul 27 20:43:23.384927 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:23.384807    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8m9p6" event={"ID":"0f178037-6a8c-4afa-beba-86f58b639b2b","Type":"ContainerDied","Data":"f706a52a8799a59a39faf332f13d191ade42dc8e538ee0db961423e475fe36aa"}
Jul 27 20:43:23.404848 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:23.404824    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"
Jul 27 20:43:23.566362 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:23.566259    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5ckv\" (UniqueName: \"kubernetes.io/projected/0f178037-6a8c-4afa-beba-86f58b639b2b-kube-api-access-d5ckv\") pod \"0f178037-6a8c-4afa-beba-86f58b639b2b\" (UID: \"0f178037-6a8c-4afa-beba-86f58b639b2b\") "
Jul 27 20:43:23.566362 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:23.566345    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f178037-6a8c-4afa-beba-86f58b639b2b-config-file\") pod \"0f178037-6a8c-4afa-beba-86f58b639b2b\" (UID: \"0f178037-6a8c-4afa-beba-86f58b639b2b\") "
Jul 27 20:43:23.566700 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:23.566682    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f178037-6a8c-4afa-beba-86f58b639b2b-config-file" (OuterVolumeSpecName: "config-file") pod "0f178037-6a8c-4afa-beba-86f58b639b2b" (UID: "0f178037-6a8c-4afa-beba-86f58b639b2b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:43:23.568329 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:23.568305    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f178037-6a8c-4afa-beba-86f58b639b2b-kube-api-access-d5ckv" (OuterVolumeSpecName: "kube-api-access-d5ckv") pod "0f178037-6a8c-4afa-beba-86f58b639b2b" (UID: "0f178037-6a8c-4afa-beba-86f58b639b2b"). InnerVolumeSpecName "kube-api-access-d5ckv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:43:23.667521 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:23.667488    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5ckv\" (UniqueName: \"kubernetes.io/projected/0f178037-6a8c-4afa-beba-86f58b639b2b-kube-api-access-d5ckv\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 20:43:23.667521 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:23.667519    2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f178037-6a8c-4afa-beba-86f58b639b2b-config-file\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 20:43:24.390395 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:24.390367    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"
Jul 27 20:43:24.390395 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:24.390375    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8m9p6" event={"ID":"0f178037-6a8c-4afa-beba-86f58b639b2b","Type":"ContainerDied","Data":"6278b5ec2412a561221a78099443e390c2d53a3861ec628cd79474392819f94f"}
Jul 27 20:43:24.390846 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:24.390429    2562 scope.go:117] "RemoveContainer" containerID="f706a52a8799a59a39faf332f13d191ade42dc8e538ee0db961423e475fe36aa"
Jul 27 20:43:24.419312 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:24.419287    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"]
Jul 27 20:43:24.422438 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:24.422414    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8m9p6"]
Jul 27 20:43:24.874431 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:24.871088    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f178037-6a8c-4afa-beba-86f58b639b2b" path="/var/lib/kubelet/pods/0f178037-6a8c-4afa-beba-86f58b639b2b/volumes"
Jul 27 20:43:26.032293 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:26.032240    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zpqtg"]
Jul 27 20:43:26.032757 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:26.032735    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f178037-6a8c-4afa-beba-86f58b639b2b" containerName="limitador"
Jul 27 20:43:26.032830 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:26.032762    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f178037-6a8c-4afa-beba-86f58b639b2b" containerName="limitador"
Jul 27 20:43:26.032894 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:26.032880    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f178037-6a8c-4afa-beba-86f58b639b2b" containerName="limitador"
Jul 27 20:43:26.037081 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:26.037063    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zpqtg"
Jul 27 20:43:26.039388 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:26.039366    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 20:43:26.040162 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:26.040143    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 20:43:26.040569 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:26.040202    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-bxvm5\""
Jul 27 20:43:26.040676 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:26.040649    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 27 20:43:26.043099 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:26.043079    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zpqtg"]
Jul 27 20:43:26.187965 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:26.187929    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsvzs\" (UniqueName: \"kubernetes.io/projected/daa65e7e-402f-46ae-9f05-fbd58ce3c5f0-kube-api-access-hsvzs\") pod \"postgres-69fb4594cf-zpqtg\" (UID: \"daa65e7e-402f-46ae-9f05-fbd58ce3c5f0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zpqtg"
Jul 27 20:43:26.188148 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:26.187976    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/daa65e7e-402f-46ae-9f05-fbd58ce3c5f0-data\") pod \"postgres-69fb4594cf-zpqtg\" (UID: \"daa65e7e-402f-46ae-9f05-fbd58ce3c5f0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zpqtg"
Jul 27 20:43:26.289413 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:26.289314    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsvzs\" (UniqueName: \"kubernetes.io/projected/daa65e7e-402f-46ae-9f05-fbd58ce3c5f0-kube-api-access-hsvzs\") pod \"postgres-69fb4594cf-zpqtg\" (UID: \"daa65e7e-402f-46ae-9f05-fbd58ce3c5f0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zpqtg"
Jul 27 20:43:26.289413 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:26.289382    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/daa65e7e-402f-46ae-9f05-fbd58ce3c5f0-data\") pod \"postgres-69fb4594cf-zpqtg\" (UID: \"daa65e7e-402f-46ae-9f05-fbd58ce3c5f0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zpqtg"
Jul 27 20:43:26.289704 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:26.289688    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/daa65e7e-402f-46ae-9f05-fbd58ce3c5f0-data\") pod \"postgres-69fb4594cf-zpqtg\" (UID: \"daa65e7e-402f-46ae-9f05-fbd58ce3c5f0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zpqtg"
Jul 27 20:43:26.297773 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:26.297740    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsvzs\" (UniqueName: \"kubernetes.io/projected/daa65e7e-402f-46ae-9f05-fbd58ce3c5f0-kube-api-access-hsvzs\") pod \"postgres-69fb4594cf-zpqtg\" (UID: \"daa65e7e-402f-46ae-9f05-fbd58ce3c5f0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zpqtg"
Jul 27 20:43:26.348804 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:26.348777    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zpqtg"
Jul 27 20:43:26.475714 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:26.475690    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zpqtg"]
Jul 27 20:43:26.477614 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:43:26.477585    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa65e7e_402f_46ae_9f05_fbd58ce3c5f0.slice/crio-cd218d91282143c4a43409a3589ca4620f5c31f9827dec54755af6208d58f4e0 WatchSource:0}: Error finding container cd218d91282143c4a43409a3589ca4620f5c31f9827dec54755af6208d58f4e0: Status 404 returned error can't find the container with id cd218d91282143c4a43409a3589ca4620f5c31f9827dec54755af6208d58f4e0
Jul 27 20:43:27.410018 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:27.409981    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zpqtg" event={"ID":"daa65e7e-402f-46ae-9f05-fbd58ce3c5f0","Type":"ContainerStarted","Data":"cd218d91282143c4a43409a3589ca4620f5c31f9827dec54755af6208d58f4e0"}
Jul 27 20:43:31.432991 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:31.432950    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zpqtg" event={"ID":"daa65e7e-402f-46ae-9f05-fbd58ce3c5f0","Type":"ContainerStarted","Data":"182829bc20b2871cdb4147985261f41796c93d4d4d3961b3e7d86fc7bb0eda43"}
Jul 27 20:43:31.433417 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:31.433057    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zpqtg"
Jul 27 20:43:31.448879 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:31.448829    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zpqtg" podStartSLOduration=0.663171616 podStartE2EDuration="5.448816667s" totalImagesPullingTime="4.785645051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:43:31.448747936 +0000 UTC m=+551.088964394" watchObservedRunningTime="2026-07-27 20:43:31.448816667 +0000 UTC m=+551.089033106"
Jul 27 20:43:37.466899 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:37.466863    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zpqtg"
Jul 27 20:43:44.107025 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.106987    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c5c4bbbd9-jsq87"]
Jul 27 20:43:44.135337 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.135303    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c5c4bbbd9-jsq87"]
Jul 27 20:43:44.135509 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.135371    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c5c4bbbd9-jsq87"
Jul 27 20:43:44.137571 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.137527    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 20:43:44.137768 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.137751    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 20:43:44.137844 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.137751    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mp4d9\""
Jul 27 20:43:44.145691 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.145673    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d86c3698-7e44-455c-91ee-0893187dc085-webhook-cert\") pod \"maas-controller-5c5c4bbbd9-jsq87\" (UID: \"d86c3698-7e44-455c-91ee-0893187dc085\") " pod="opendatahub/maas-controller-5c5c4bbbd9-jsq87"
Jul 27 20:43:44.145780 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.145701    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djs4l\" (UniqueName: \"kubernetes.io/projected/d86c3698-7e44-455c-91ee-0893187dc085-kube-api-access-djs4l\") pod \"maas-controller-5c5c4bbbd9-jsq87\" (UID: \"d86c3698-7e44-455c-91ee-0893187dc085\") " pod="opendatahub/maas-controller-5c5c4bbbd9-jsq87"
Jul 27 20:43:44.247002 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.246971    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d86c3698-7e44-455c-91ee-0893187dc085-webhook-cert\") pod \"maas-controller-5c5c4bbbd9-jsq87\" (UID: \"d86c3698-7e44-455c-91ee-0893187dc085\") " pod="opendatahub/maas-controller-5c5c4bbbd9-jsq87"
Jul 27 20:43:44.247002 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.247007    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djs4l\" (UniqueName: \"kubernetes.io/projected/d86c3698-7e44-455c-91ee-0893187dc085-kube-api-access-djs4l\") pod \"maas-controller-5c5c4bbbd9-jsq87\" (UID: \"d86c3698-7e44-455c-91ee-0893187dc085\") " pod="opendatahub/maas-controller-5c5c4bbbd9-jsq87"
Jul 27 20:43:44.249370 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.249342    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d86c3698-7e44-455c-91ee-0893187dc085-webhook-cert\") pod \"maas-controller-5c5c4bbbd9-jsq87\" (UID: \"d86c3698-7e44-455c-91ee-0893187dc085\") " pod="opendatahub/maas-controller-5c5c4bbbd9-jsq87"
Jul 27 20:43:44.256940 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.256911    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djs4l\" (UniqueName: \"kubernetes.io/projected/d86c3698-7e44-455c-91ee-0893187dc085-kube-api-access-djs4l\") pod \"maas-controller-5c5c4bbbd9-jsq87\" (UID: \"d86c3698-7e44-455c-91ee-0893187dc085\") " pod="opendatahub/maas-controller-5c5c4bbbd9-jsq87"
Jul 27 20:43:44.263018 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.262992    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55f5c64d95-p5ngb"]
Jul 27 20:43:44.266717 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.266698    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55f5c64d95-p5ngb"
Jul 27 20:43:44.283134 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.281213    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55f5c64d95-p5ngb"]
Jul 27 20:43:44.348180 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.348141    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpqqq\" (UniqueName: \"kubernetes.io/projected/b66ed687-951e-4645-b64d-1331cb9be557-kube-api-access-mpqqq\") pod \"maas-controller-55f5c64d95-p5ngb\" (UID: \"b66ed687-951e-4645-b64d-1331cb9be557\") " pod="opendatahub/maas-controller-55f5c64d95-p5ngb"
Jul 27 20:43:44.348380 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.348225    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b66ed687-951e-4645-b64d-1331cb9be557-webhook-cert\") pod \"maas-controller-55f5c64d95-p5ngb\" (UID: \"b66ed687-951e-4645-b64d-1331cb9be557\") " pod="opendatahub/maas-controller-55f5c64d95-p5ngb"
Jul 27 20:43:44.445717 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.445625    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c5c4bbbd9-jsq87"
Jul 27 20:43:44.449054 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.448601    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b66ed687-951e-4645-b64d-1331cb9be557-webhook-cert\") pod \"maas-controller-55f5c64d95-p5ngb\" (UID: \"b66ed687-951e-4645-b64d-1331cb9be557\") " pod="opendatahub/maas-controller-55f5c64d95-p5ngb"
Jul 27 20:43:44.449054 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.448661    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpqqq\" (UniqueName: \"kubernetes.io/projected/b66ed687-951e-4645-b64d-1331cb9be557-kube-api-access-mpqqq\") pod \"maas-controller-55f5c64d95-p5ngb\" (UID: \"b66ed687-951e-4645-b64d-1331cb9be557\") " pod="opendatahub/maas-controller-55f5c64d95-p5ngb"
Jul 27 20:43:44.451025 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.450999    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b66ed687-951e-4645-b64d-1331cb9be557-webhook-cert\") pod \"maas-controller-55f5c64d95-p5ngb\" (UID: \"b66ed687-951e-4645-b64d-1331cb9be557\") " pod="opendatahub/maas-controller-55f5c64d95-p5ngb"
Jul 27 20:43:44.457446 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.457423    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpqqq\" (UniqueName: \"kubernetes.io/projected/b66ed687-951e-4645-b64d-1331cb9be557-kube-api-access-mpqqq\") pod \"maas-controller-55f5c64d95-p5ngb\" (UID: \"b66ed687-951e-4645-b64d-1331cb9be557\") " pod="opendatahub/maas-controller-55f5c64d95-p5ngb"
Jul 27 20:43:44.578065 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.578032    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55f5c64d95-p5ngb"
Jul 27 20:43:44.579767 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.579745    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c5c4bbbd9-jsq87"]
Jul 27 20:43:44.582109 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:43:44.582080    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd86c3698_7e44_455c_91ee_0893187dc085.slice/crio-0907c4856115fd163ec05155b61626a7c1fad77c7d98a00ba47f82fa5bd3ee0c WatchSource:0}: Error finding container 0907c4856115fd163ec05155b61626a7c1fad77c7d98a00ba47f82fa5bd3ee0c: Status 404 returned error can't find the container with id 0907c4856115fd163ec05155b61626a7c1fad77c7d98a00ba47f82fa5bd3ee0c
Jul 27 20:43:44.708760 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:44.708730    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55f5c64d95-p5ngb"]
Jul 27 20:43:44.710538 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:43:44.710506    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb66ed687_951e_4645_b64d_1331cb9be557.slice/crio-979e982290f6777df64c64bcd0296a343e9a14b63a64536920f9fd230d2f4b52 WatchSource:0}: Error finding container 979e982290f6777df64c64bcd0296a343e9a14b63a64536920f9fd230d2f4b52: Status 404 returned error can't find the container with id 979e982290f6777df64c64bcd0296a343e9a14b63a64536920f9fd230d2f4b52
Jul 27 20:43:45.504174 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:45.504079    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55f5c64d95-p5ngb" event={"ID":"b66ed687-951e-4645-b64d-1331cb9be557","Type":"ContainerStarted","Data":"979e982290f6777df64c64bcd0296a343e9a14b63a64536920f9fd230d2f4b52"}
Jul 27 20:43:45.506481 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:45.506451    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c5c4bbbd9-jsq87" event={"ID":"d86c3698-7e44-455c-91ee-0893187dc085","Type":"ContainerStarted","Data":"0907c4856115fd163ec05155b61626a7c1fad77c7d98a00ba47f82fa5bd3ee0c"}
Jul 27 20:43:47.516643 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:47.516609    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55f5c64d95-p5ngb" event={"ID":"b66ed687-951e-4645-b64d-1331cb9be557","Type":"ContainerStarted","Data":"718694f33415484e3b846763df972fa9c82c3f89b77acf31decbceae154d9ad0"}
Jul 27 20:43:47.517074 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:47.516721    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55f5c64d95-p5ngb"
Jul 27 20:43:47.518264 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:47.518240    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c5c4bbbd9-jsq87" event={"ID":"d86c3698-7e44-455c-91ee-0893187dc085","Type":"ContainerStarted","Data":"c54c4310fe695f25622366bb095afa6add59477244bf72d991c713932872d860"}
Jul 27 20:43:47.518383 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:47.518306    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c5c4bbbd9-jsq87"
Jul 27 20:43:47.534411 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:47.534366    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55f5c64d95-p5ngb" podStartSLOduration=1.281167235 podStartE2EDuration="3.534354478s" totalImagesPullingTime="2.253187243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:43:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:43:47.533030133 +0000 UTC m=+567.173246591" watchObservedRunningTime="2026-07-27 20:43:47.534354478 +0000 UTC m=+567.174570916"
Jul 27 20:43:47.557663 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:47.557622    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c5c4bbbd9-jsq87" podStartSLOduration=1.182612906 podStartE2EDuration="3.557607205s" totalImagesPullingTime="2.374994299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:43:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:43:47.557162849 +0000 UTC m=+567.197379299" watchObservedRunningTime="2026-07-27 20:43:47.557607205 +0000 UTC m=+567.197823643"
Jul 27 20:43:58.524350 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:58.524318    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c5c4bbbd9-jsq87"
Jul 27 20:43:58.524742 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:58.524537    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55f5c64d95-p5ngb"
Jul 27 20:43:58.578570 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:58.578536    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c5c4bbbd9-jsq87"]
Jul 27 20:43:58.578796 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:58.578748    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5c5c4bbbd9-jsq87" podUID="d86c3698-7e44-455c-91ee-0893187dc085" containerName="manager" containerID="cri-o://c54c4310fe695f25622366bb095afa6add59477244bf72d991c713932872d860" gracePeriod=30
Jul 27 20:43:58.814063 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:58.814042    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c5c4bbbd9-jsq87"
Jul 27 20:43:58.872990 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:58.872966    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d86c3698-7e44-455c-91ee-0893187dc085-webhook-cert\") pod \"d86c3698-7e44-455c-91ee-0893187dc085\" (UID: \"d86c3698-7e44-455c-91ee-0893187dc085\") "
Jul 27 20:43:58.873133 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:58.873019    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djs4l\" (UniqueName: \"kubernetes.io/projected/d86c3698-7e44-455c-91ee-0893187dc085-kube-api-access-djs4l\") pod \"d86c3698-7e44-455c-91ee-0893187dc085\" (UID: \"d86c3698-7e44-455c-91ee-0893187dc085\") "
Jul 27 20:43:58.875166 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:58.875132    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d86c3698-7e44-455c-91ee-0893187dc085-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d86c3698-7e44-455c-91ee-0893187dc085" (UID: "d86c3698-7e44-455c-91ee-0893187dc085"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:43:58.875166 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:58.875146    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d86c3698-7e44-455c-91ee-0893187dc085-kube-api-access-djs4l" (OuterVolumeSpecName: "kube-api-access-djs4l") pod "d86c3698-7e44-455c-91ee-0893187dc085" (UID: "d86c3698-7e44-455c-91ee-0893187dc085"). InnerVolumeSpecName "kube-api-access-djs4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:43:58.973859 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:58.973829    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d86c3698-7e44-455c-91ee-0893187dc085-webhook-cert\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 20:43:58.973859 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:58.973853    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djs4l\" (UniqueName: \"kubernetes.io/projected/d86c3698-7e44-455c-91ee-0893187dc085-kube-api-access-djs4l\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 20:43:59.578156 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:59.578124    2562 generic.go:356] "Generic (PLEG): container finished" podID="d86c3698-7e44-455c-91ee-0893187dc085" containerID="c54c4310fe695f25622366bb095afa6add59477244bf72d991c713932872d860" exitCode=0
Jul 27 20:43:59.578564 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:59.578165    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c5c4bbbd9-jsq87"
Jul 27 20:43:59.578564 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:59.578165    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c5c4bbbd9-jsq87" event={"ID":"d86c3698-7e44-455c-91ee-0893187dc085","Type":"ContainerDied","Data":"c54c4310fe695f25622366bb095afa6add59477244bf72d991c713932872d860"}
Jul 27 20:43:59.578564 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:59.578319    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c5c4bbbd9-jsq87" event={"ID":"d86c3698-7e44-455c-91ee-0893187dc085","Type":"ContainerDied","Data":"0907c4856115fd163ec05155b61626a7c1fad77c7d98a00ba47f82fa5bd3ee0c"}
Jul 27 20:43:59.578564 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:59.578349    2562 scope.go:117] "RemoveContainer" containerID="c54c4310fe695f25622366bb095afa6add59477244bf72d991c713932872d860"
Jul 27 20:43:59.587438 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:59.587422    2562 scope.go:117] "RemoveContainer" containerID="c54c4310fe695f25622366bb095afa6add59477244bf72d991c713932872d860"
Jul 27 20:43:59.587691 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:43:59.587672    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c54c4310fe695f25622366bb095afa6add59477244bf72d991c713932872d860\": container with ID starting with c54c4310fe695f25622366bb095afa6add59477244bf72d991c713932872d860 not found: ID does not exist" containerID="c54c4310fe695f25622366bb095afa6add59477244bf72d991c713932872d860"
Jul 27 20:43:59.587757 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:59.587702    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c54c4310fe695f25622366bb095afa6add59477244bf72d991c713932872d860"} err="failed to get container status \"c54c4310fe695f25622366bb095afa6add59477244bf72d991c713932872d860\": rpc error: code = NotFound desc = could not find container \"c54c4310fe695f25622366bb095afa6add59477244bf72d991c713932872d860\": container with ID starting with c54c4310fe695f25622366bb095afa6add59477244bf72d991c713932872d860 not found: ID does not exist"
Jul 27 20:43:59.599482 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:59.599460    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c5c4bbbd9-jsq87"]
Jul 27 20:43:59.605314 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:43:59.605284    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c5c4bbbd9-jsq87"]
Jul 27 20:44:00.869195 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:00.869158    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d86c3698-7e44-455c-91ee-0893187dc085" path="/var/lib/kubelet/pods/d86c3698-7e44-455c-91ee-0893187dc085/volumes"
Jul 27 20:44:19.579051 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:19.579016    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts"]
Jul 27 20:44:19.579663 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:19.579624    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d86c3698-7e44-455c-91ee-0893187dc085" containerName="manager"
Jul 27 20:44:19.579739 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:19.579665    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d86c3698-7e44-455c-91ee-0893187dc085" containerName="manager"
Jul 27 20:44:19.579793 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:19.579780    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d86c3698-7e44-455c-91ee-0893187dc085" containerName="manager"
Jul 27 20:44:19.582770 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:19.582752    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts"
Jul 27 20:44:19.585067 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:19.585045    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 27 20:44:19.585165 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:19.585114    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2mj6d\""
Jul 27 20:44:19.592958 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:19.592931    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts"]
Jul 27 20:44:19.754978 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:19.754946    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ecf528-0c46-4946-978f-6a3b5a0127e0-openshift-service-ca\") pod \"maas-api-746cdbd7fb-xlgts\" (UID: \"e4ecf528-0c46-4946-978f-6a3b5a0127e0\") " pod="odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts"
Jul 27 20:44:19.754978 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:19.754983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4ecf528-0c46-4946-978f-6a3b5a0127e0-maas-api-tls\") pod \"maas-api-746cdbd7fb-xlgts\" (UID: \"e4ecf528-0c46-4946-978f-6a3b5a0127e0\") " pod="odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts"
Jul 27 20:44:19.755256 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:19.755003    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k7xd\" (UniqueName: \"kubernetes.io/projected/e4ecf528-0c46-4946-978f-6a3b5a0127e0-kube-api-access-5k7xd\") pod \"maas-api-746cdbd7fb-xlgts\" (UID: \"e4ecf528-0c46-4946-978f-6a3b5a0127e0\") " pod="odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts"
Jul 27 20:44:19.855901 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:19.855820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ecf528-0c46-4946-978f-6a3b5a0127e0-openshift-service-ca\") pod \"maas-api-746cdbd7fb-xlgts\" (UID: \"e4ecf528-0c46-4946-978f-6a3b5a0127e0\") " pod="odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts"
Jul 27 20:44:19.855901 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:19.855857    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4ecf528-0c46-4946-978f-6a3b5a0127e0-maas-api-tls\") pod \"maas-api-746cdbd7fb-xlgts\" (UID: \"e4ecf528-0c46-4946-978f-6a3b5a0127e0\") " pod="odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts"
Jul 27 20:44:19.855901 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:19.855877    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k7xd\" (UniqueName: \"kubernetes.io/projected/e4ecf528-0c46-4946-978f-6a3b5a0127e0-kube-api-access-5k7xd\") pod \"maas-api-746cdbd7fb-xlgts\" (UID: \"e4ecf528-0c46-4946-978f-6a3b5a0127e0\") " pod="odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts"
Jul 27 20:44:19.856137 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:44:19.855977    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 27 20:44:19.856137 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:44:19.856048    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4ecf528-0c46-4946-978f-6a3b5a0127e0-maas-api-tls podName:e4ecf528-0c46-4946-978f-6a3b5a0127e0 nodeName:}" failed. No retries permitted until 2026-07-27 20:44:20.356031093 +0000 UTC m=+599.996247514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e4ecf528-0c46-4946-978f-6a3b5a0127e0-maas-api-tls") pod "maas-api-746cdbd7fb-xlgts" (UID: "e4ecf528-0c46-4946-978f-6a3b5a0127e0") : secret "maas-api-serving-cert" not found
Jul 27 20:44:19.856566 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:19.856548    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ecf528-0c46-4946-978f-6a3b5a0127e0-openshift-service-ca\") pod \"maas-api-746cdbd7fb-xlgts\" (UID: \"e4ecf528-0c46-4946-978f-6a3b5a0127e0\") " pod="odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts"
Jul 27 20:44:19.864724 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:19.864697    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k7xd\" (UniqueName: \"kubernetes.io/projected/e4ecf528-0c46-4946-978f-6a3b5a0127e0-kube-api-access-5k7xd\") pod \"maas-api-746cdbd7fb-xlgts\" (UID: \"e4ecf528-0c46-4946-978f-6a3b5a0127e0\") " pod="odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts"
Jul 27 20:44:20.207398 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.207323    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-kkksr"]
Jul 27 20:44:20.210879 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.210852    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kkksr"
Jul 27 20:44:20.213095 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.213071    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 27 20:44:20.213226 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.213107    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-m67sj\""
Jul 27 20:44:20.221041 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.221013    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-kkksr"]
Jul 27 20:44:20.360840 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.360808    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6wz2\" (UniqueName: \"kubernetes.io/projected/4fd9f783-10f5-4d5c-bc65-ba3d1eb990e9-kube-api-access-p6wz2\") pod \"payload-pre-processing-687dbb6cf6-kkksr\" (UID: \"4fd9f783-10f5-4d5c-bc65-ba3d1eb990e9\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kkksr"
Jul 27 20:44:20.361026 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.360856    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4ecf528-0c46-4946-978f-6a3b5a0127e0-maas-api-tls\") pod \"maas-api-746cdbd7fb-xlgts\" (UID: \"e4ecf528-0c46-4946-978f-6a3b5a0127e0\") " pod="odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts"
Jul 27 20:44:20.361026 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.360942    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fd9f783-10f5-4d5c-bc65-ba3d1eb990e9-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-kkksr\" (UID: \"4fd9f783-10f5-4d5c-bc65-ba3d1eb990e9\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kkksr"
Jul 27 20:44:20.363212 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.363185    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4ecf528-0c46-4946-978f-6a3b5a0127e0-maas-api-tls\") pod \"maas-api-746cdbd7fb-xlgts\" (UID: \"e4ecf528-0c46-4946-978f-6a3b5a0127e0\") " pod="odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts"
Jul 27 20:44:20.462396 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.462317    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6wz2\" (UniqueName: \"kubernetes.io/projected/4fd9f783-10f5-4d5c-bc65-ba3d1eb990e9-kube-api-access-p6wz2\") pod \"payload-pre-processing-687dbb6cf6-kkksr\" (UID: \"4fd9f783-10f5-4d5c-bc65-ba3d1eb990e9\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kkksr"
Jul 27 20:44:20.462550 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.462403    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fd9f783-10f5-4d5c-bc65-ba3d1eb990e9-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-kkksr\" (UID: \"4fd9f783-10f5-4d5c-bc65-ba3d1eb990e9\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kkksr"
Jul 27 20:44:20.463044 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.463026    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fd9f783-10f5-4d5c-bc65-ba3d1eb990e9-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-kkksr\" (UID: \"4fd9f783-10f5-4d5c-bc65-ba3d1eb990e9\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kkksr"
Jul 27 20:44:20.474118 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.474090    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6wz2\" (UniqueName: \"kubernetes.io/projected/4fd9f783-10f5-4d5c-bc65-ba3d1eb990e9-kube-api-access-p6wz2\") pod \"payload-pre-processing-687dbb6cf6-kkksr\" (UID: \"4fd9f783-10f5-4d5c-bc65-ba3d1eb990e9\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kkksr"
Jul 27 20:44:20.494000 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.493965    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts"
Jul 27 20:44:20.523055 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.523024    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kkksr"
Jul 27 20:44:20.647967 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.647939    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts"]
Jul 27 20:44:20.651296 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:44:20.651242    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4ecf528_0c46_4946_978f_6a3b5a0127e0.slice/crio-9b945bc6672524eadecdb3935c7c27bc5b67b5489ed6962e2281cbf92e3ed18a WatchSource:0}: Error finding container 9b945bc6672524eadecdb3935c7c27bc5b67b5489ed6962e2281cbf92e3ed18a: Status 404 returned error can't find the container with id 9b945bc6672524eadecdb3935c7c27bc5b67b5489ed6962e2281cbf92e3ed18a
Jul 27 20:44:20.677037 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.676967    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts" event={"ID":"e4ecf528-0c46-4946-978f-6a3b5a0127e0","Type":"ContainerStarted","Data":"9b945bc6672524eadecdb3935c7c27bc5b67b5489ed6962e2281cbf92e3ed18a"}
Jul 27 20:44:20.677132 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.677112    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-kkksr"]
Jul 27 20:44:20.679101 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:44:20.679068    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fd9f783_10f5_4d5c_bc65_ba3d1eb990e9.slice/crio-c23b854e5d632a89f646a74252089a5749ec4921ba593721b0e82ec4c3d3e553 WatchSource:0}: Error finding container c23b854e5d632a89f646a74252089a5749ec4921ba593721b0e82ec4c3d3e553: Status 404 returned error can't find the container with id c23b854e5d632a89f646a74252089a5749ec4921ba593721b0e82ec4c3d3e553
Jul 27 20:44:20.796446 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.796363    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 20:44:20.802661 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.802630    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 20:44:20.804132 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.804107    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 20:44:20.809902 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.809871    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 20:44:20.811291 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.811245    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 20:44:20.817634 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:20.817614    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 20:44:21.686021 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:21.685978    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kkksr" event={"ID":"4fd9f783-10f5-4d5c-bc65-ba3d1eb990e9","Type":"ContainerStarted","Data":"c23b854e5d632a89f646a74252089a5749ec4921ba593721b0e82ec4c3d3e553"}
Jul 27 20:44:23.696620 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:23.696578    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kkksr" event={"ID":"4fd9f783-10f5-4d5c-bc65-ba3d1eb990e9","Type":"ContainerStarted","Data":"b7113a4deabaff559b187701a1cba06b94c2ffeccfa52600bde7b635d8941dd3"}
Jul 27 20:44:23.697112 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:23.696742    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kkksr"
Jul 27 20:44:23.698148 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:23.698117    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts" event={"ID":"e4ecf528-0c46-4946-978f-6a3b5a0127e0","Type":"ContainerStarted","Data":"78a9d975a3040f187de16439fbf1484211eafe5aad18f1fd7e0bd2daa5e6fe13"}
Jul 27 20:44:23.698313 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:23.698240    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts"
Jul 27 20:44:23.715233 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:23.715192    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kkksr" podStartSLOduration=1.155814401 podStartE2EDuration="3.715178693s" totalImagesPullingTime="2.559364292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:44:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:44:23.712779931 +0000 UTC m=+603.352996399" watchObservedRunningTime="2026-07-27 20:44:23.715178693 +0000 UTC m=+603.355395132"
Jul 27 20:44:23.730711 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:23.730666    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts" podStartSLOduration=3.209668262 podStartE2EDuration="4.730651107s" totalImagesPullingTime="1.520982845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:44:23.728843791 +0000 UTC m=+603.369060252" watchObservedRunningTime="2026-07-27 20:44:23.730651107 +0000 UTC m=+603.370867549"
Jul 27 20:44:29.708393 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:29.708363    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-746cdbd7fb-xlgts"
Jul 27 20:44:34.704255 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:34.704221    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kkksr"
Jul 27 20:44:41.222241 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.222202    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"]
Jul 27 20:44:41.226853 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.226830    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.229553 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.229530    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 20:44:41.230397 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.230377    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vz7np\""
Jul 27 20:44:41.230501 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.230463    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 27 20:44:41.230567 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.230501    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 20:44:41.235723 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.235407    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"]
Jul 27 20:44:41.340058 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.340023    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f9d6713-1efc-4fd3-8693-678fe1ce8735-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954\" (UID: \"8f9d6713-1efc-4fd3-8693-678fe1ce8735\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.340203 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.340073    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f9d6713-1efc-4fd3-8693-678fe1ce8735-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954\" (UID: \"8f9d6713-1efc-4fd3-8693-678fe1ce8735\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.340203 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.340157    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f9d6713-1efc-4fd3-8693-678fe1ce8735-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954\" (UID: \"8f9d6713-1efc-4fd3-8693-678fe1ce8735\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.340203 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.340193    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f9d6713-1efc-4fd3-8693-678fe1ce8735-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954\" (UID: \"8f9d6713-1efc-4fd3-8693-678fe1ce8735\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.340374 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.340217    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f9d6713-1efc-4fd3-8693-678fe1ce8735-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954\" (UID: \"8f9d6713-1efc-4fd3-8693-678fe1ce8735\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.340374 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.340284    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlv2q\" (UniqueName: \"kubernetes.io/projected/8f9d6713-1efc-4fd3-8693-678fe1ce8735-kube-api-access-dlv2q\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954\" (UID: \"8f9d6713-1efc-4fd3-8693-678fe1ce8735\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.441688 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.441648    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlv2q\" (UniqueName: \"kubernetes.io/projected/8f9d6713-1efc-4fd3-8693-678fe1ce8735-kube-api-access-dlv2q\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954\" (UID: \"8f9d6713-1efc-4fd3-8693-678fe1ce8735\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.441688 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.441699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f9d6713-1efc-4fd3-8693-678fe1ce8735-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954\" (UID: \"8f9d6713-1efc-4fd3-8693-678fe1ce8735\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.441920 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.441730    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f9d6713-1efc-4fd3-8693-678fe1ce8735-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954\" (UID: \"8f9d6713-1efc-4fd3-8693-678fe1ce8735\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.441920 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.441758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f9d6713-1efc-4fd3-8693-678fe1ce8735-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954\" (UID: \"8f9d6713-1efc-4fd3-8693-678fe1ce8735\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.441920 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.441777    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f9d6713-1efc-4fd3-8693-678fe1ce8735-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954\" (UID: \"8f9d6713-1efc-4fd3-8693-678fe1ce8735\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.441920 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.441809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f9d6713-1efc-4fd3-8693-678fe1ce8735-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954\" (UID: \"8f9d6713-1efc-4fd3-8693-678fe1ce8735\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.442293 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.442240    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f9d6713-1efc-4fd3-8693-678fe1ce8735-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954\" (UID: \"8f9d6713-1efc-4fd3-8693-678fe1ce8735\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.442405 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.442299    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f9d6713-1efc-4fd3-8693-678fe1ce8735-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954\" (UID: \"8f9d6713-1efc-4fd3-8693-678fe1ce8735\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.442405 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.442237    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f9d6713-1efc-4fd3-8693-678fe1ce8735-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954\" (UID: \"8f9d6713-1efc-4fd3-8693-678fe1ce8735\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.443912 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.443891    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f9d6713-1efc-4fd3-8693-678fe1ce8735-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954\" (UID: \"8f9d6713-1efc-4fd3-8693-678fe1ce8735\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.444361 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.444342    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f9d6713-1efc-4fd3-8693-678fe1ce8735-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954\" (UID: \"8f9d6713-1efc-4fd3-8693-678fe1ce8735\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.449876 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.449853    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlv2q\" (UniqueName: \"kubernetes.io/projected/8f9d6713-1efc-4fd3-8693-678fe1ce8735-kube-api-access-dlv2q\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954\" (UID: \"8f9d6713-1efc-4fd3-8693-678fe1ce8735\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.540409 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.540343    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:41.673077 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.673053    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"]
Jul 27 20:44:41.674939 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:44:41.674903    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9d6713_1efc_4fd3_8693_678fe1ce8735.slice/crio-419e3497574740be1114d7d5bf54ea8674d0b90d3dff8a60ffbb25c17c9096aa WatchSource:0}: Error finding container 419e3497574740be1114d7d5bf54ea8674d0b90d3dff8a60ffbb25c17c9096aa: Status 404 returned error can't find the container with id 419e3497574740be1114d7d5bf54ea8674d0b90d3dff8a60ffbb25c17c9096aa
Jul 27 20:44:41.781040 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:41.781008    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954" event={"ID":"8f9d6713-1efc-4fd3-8693-678fe1ce8735","Type":"ContainerStarted","Data":"419e3497574740be1114d7d5bf54ea8674d0b90d3dff8a60ffbb25c17c9096aa"}
Jul 27 20:44:43.792122 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:43.792080    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954" event={"ID":"8f9d6713-1efc-4fd3-8693-678fe1ce8735","Type":"ContainerStarted","Data":"5f699053671409db85557e3cdfb2000d302ab974f975ec038a14311849814bc3"}
Jul 27 20:44:43.811646 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:43.811595    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954" podStartSLOduration=1.710256442 podStartE2EDuration="2.811581509s" totalImagesPullingTime="1.101325067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:44:43.809811218 +0000 UTC m=+623.450027668" watchObservedRunningTime="2026-07-27 20:44:43.811581509 +0000 UTC m=+623.451797948"
Jul 27 20:44:48.440313 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.440280    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"]
Jul 27 20:44:48.443825 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.443808    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.446116 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.446097    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 27 20:44:48.454045 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.454016    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"]
Jul 27 20:44:48.504230 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.504191    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c9d2197-4ca5-4b19-99be-2bfa4f44acde-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8674n\" (UID: \"4c9d2197-4ca5-4b19-99be-2bfa4f44acde\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.504396 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.504297    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c9d2197-4ca5-4b19-99be-2bfa4f44acde-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8674n\" (UID: \"4c9d2197-4ca5-4b19-99be-2bfa4f44acde\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.504396 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.504364    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c9d2197-4ca5-4b19-99be-2bfa4f44acde-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8674n\" (UID: \"4c9d2197-4ca5-4b19-99be-2bfa4f44acde\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.504396 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.504387    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c9d2197-4ca5-4b19-99be-2bfa4f44acde-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8674n\" (UID: \"4c9d2197-4ca5-4b19-99be-2bfa4f44acde\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.504514 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.504466    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c9d2197-4ca5-4b19-99be-2bfa4f44acde-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8674n\" (UID: \"4c9d2197-4ca5-4b19-99be-2bfa4f44acde\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.504514 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.504497    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8nhl\" (UniqueName: \"kubernetes.io/projected/4c9d2197-4ca5-4b19-99be-2bfa4f44acde-kube-api-access-r8nhl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8674n\" (UID: \"4c9d2197-4ca5-4b19-99be-2bfa4f44acde\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.605290 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.605238    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c9d2197-4ca5-4b19-99be-2bfa4f44acde-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8674n\" (UID: \"4c9d2197-4ca5-4b19-99be-2bfa4f44acde\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.605463 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.605333    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8nhl\" (UniqueName: \"kubernetes.io/projected/4c9d2197-4ca5-4b19-99be-2bfa4f44acde-kube-api-access-r8nhl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8674n\" (UID: \"4c9d2197-4ca5-4b19-99be-2bfa4f44acde\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.605463 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.605422    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c9d2197-4ca5-4b19-99be-2bfa4f44acde-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8674n\" (UID: \"4c9d2197-4ca5-4b19-99be-2bfa4f44acde\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.605590 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.605462    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c9d2197-4ca5-4b19-99be-2bfa4f44acde-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8674n\" (UID: \"4c9d2197-4ca5-4b19-99be-2bfa4f44acde\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.605590 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.605525    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c9d2197-4ca5-4b19-99be-2bfa4f44acde-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8674n\" (UID: \"4c9d2197-4ca5-4b19-99be-2bfa4f44acde\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.605590 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.605556    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c9d2197-4ca5-4b19-99be-2bfa4f44acde-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8674n\" (UID: \"4c9d2197-4ca5-4b19-99be-2bfa4f44acde\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.606042 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.606016    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c9d2197-4ca5-4b19-99be-2bfa4f44acde-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8674n\" (UID: \"4c9d2197-4ca5-4b19-99be-2bfa4f44acde\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.606170 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.606043    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c9d2197-4ca5-4b19-99be-2bfa4f44acde-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8674n\" (UID: \"4c9d2197-4ca5-4b19-99be-2bfa4f44acde\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.606170 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.606115    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c9d2197-4ca5-4b19-99be-2bfa4f44acde-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8674n\" (UID: \"4c9d2197-4ca5-4b19-99be-2bfa4f44acde\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.608116 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.608098    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c9d2197-4ca5-4b19-99be-2bfa4f44acde-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8674n\" (UID: \"4c9d2197-4ca5-4b19-99be-2bfa4f44acde\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.608220 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.608203    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c9d2197-4ca5-4b19-99be-2bfa4f44acde-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8674n\" (UID: \"4c9d2197-4ca5-4b19-99be-2bfa4f44acde\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.615240 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.615216    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8nhl\" (UniqueName: \"kubernetes.io/projected/4c9d2197-4ca5-4b19-99be-2bfa4f44acde-kube-api-access-r8nhl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8674n\" (UID: \"4c9d2197-4ca5-4b19-99be-2bfa4f44acde\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.755510 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.755416    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:48.889649 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:48.889614    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"]
Jul 27 20:44:48.891196 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:44:48.891169    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c9d2197_4ca5_4b19_99be_2bfa4f44acde.slice/crio-11acdd1fe10c1b386274f9659911a4fd244376f7c399dda7627ddc3694cc037b WatchSource:0}: Error finding container 11acdd1fe10c1b386274f9659911a4fd244376f7c399dda7627ddc3694cc037b: Status 404 returned error can't find the container with id 11acdd1fe10c1b386274f9659911a4fd244376f7c399dda7627ddc3694cc037b
Jul 27 20:44:49.823376 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:49.823334    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n" event={"ID":"4c9d2197-4ca5-4b19-99be-2bfa4f44acde","Type":"ContainerStarted","Data":"bfdda8e231b06922522e4234d77ca138ceba1f42502f93e8e72ae25ced96e981"}
Jul 27 20:44:49.823810 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:49.823417    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n" event={"ID":"4c9d2197-4ca5-4b19-99be-2bfa4f44acde","Type":"ContainerStarted","Data":"11acdd1fe10c1b386274f9659911a4fd244376f7c399dda7627ddc3694cc037b"}
Jul 27 20:44:49.844573 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:49.844519    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n" podStartSLOduration=1.647595481 podStartE2EDuration="1.8445028s" totalImagesPullingTime="196.907319ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:44:49.842178353 +0000 UTC m=+629.482394810" watchObservedRunningTime="2026-07-27 20:44:49.8445028 +0000 UTC m=+629.484719239"
Jul 27 20:44:51.540663 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:51.540625    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:51.541157 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:51.540687    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:51.553368 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:51.553341    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:51.844300 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:51.844247    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954"
Jul 27 20:44:58.756336 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:58.756295    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:58.756830 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:58.756368    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:58.768768 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:58.768745    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:44:58.876241 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:44:58.876214    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8674n"
Jul 27 20:45:16.120467 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.120436    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"]
Jul 27 20:45:16.123907 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.123885    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.126578 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.126554    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 27 20:45:16.134997 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.134973    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"]
Jul 27 20:45:16.155673 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.155633    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2478db46-7b35-49b3-8e52-64798feda77a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4\" (UID: \"2478db46-7b35-49b3-8e52-64798feda77a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.155829 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.155677    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2478db46-7b35-49b3-8e52-64798feda77a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4\" (UID: \"2478db46-7b35-49b3-8e52-64798feda77a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.155829 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.155748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2478db46-7b35-49b3-8e52-64798feda77a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4\" (UID: \"2478db46-7b35-49b3-8e52-64798feda77a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.155829 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.155779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2478db46-7b35-49b3-8e52-64798feda77a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4\" (UID: \"2478db46-7b35-49b3-8e52-64798feda77a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.155829 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.155799    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2478db46-7b35-49b3-8e52-64798feda77a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4\" (UID: \"2478db46-7b35-49b3-8e52-64798feda77a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.155964 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.155851    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s92sl\" (UniqueName: \"kubernetes.io/projected/2478db46-7b35-49b3-8e52-64798feda77a-kube-api-access-s92sl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4\" (UID: \"2478db46-7b35-49b3-8e52-64798feda77a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.256704 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.256553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2478db46-7b35-49b3-8e52-64798feda77a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4\" (UID: \"2478db46-7b35-49b3-8e52-64798feda77a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.256897 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.256728    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2478db46-7b35-49b3-8e52-64798feda77a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4\" (UID: \"2478db46-7b35-49b3-8e52-64798feda77a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.256897 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.256800    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2478db46-7b35-49b3-8e52-64798feda77a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4\" (UID: \"2478db46-7b35-49b3-8e52-64798feda77a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.256897 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.256826    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2478db46-7b35-49b3-8e52-64798feda77a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4\" (UID: \"2478db46-7b35-49b3-8e52-64798feda77a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.256897 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.256845    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2478db46-7b35-49b3-8e52-64798feda77a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4\" (UID: \"2478db46-7b35-49b3-8e52-64798feda77a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.257128 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.256912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s92sl\" (UniqueName: \"kubernetes.io/projected/2478db46-7b35-49b3-8e52-64798feda77a-kube-api-access-s92sl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4\" (UID: \"2478db46-7b35-49b3-8e52-64798feda77a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.257195 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.257134    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2478db46-7b35-49b3-8e52-64798feda77a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4\" (UID: \"2478db46-7b35-49b3-8e52-64798feda77a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.257312 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.257262    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2478db46-7b35-49b3-8e52-64798feda77a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4\" (UID: \"2478db46-7b35-49b3-8e52-64798feda77a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.257403 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.257308    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2478db46-7b35-49b3-8e52-64798feda77a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4\" (UID: \"2478db46-7b35-49b3-8e52-64798feda77a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.259485 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.259462    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2478db46-7b35-49b3-8e52-64798feda77a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4\" (UID: \"2478db46-7b35-49b3-8e52-64798feda77a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.259677 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.259662    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2478db46-7b35-49b3-8e52-64798feda77a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4\" (UID: \"2478db46-7b35-49b3-8e52-64798feda77a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.264169 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.264141    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s92sl\" (UniqueName: \"kubernetes.io/projected/2478db46-7b35-49b3-8e52-64798feda77a-kube-api-access-s92sl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4\" (UID: \"2478db46-7b35-49b3-8e52-64798feda77a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.435914 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.435834    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:16.570364 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.570338    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"]
Jul 27 20:45:16.572180 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:45:16.572153    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2478db46_7b35_49b3_8e52_64798feda77a.slice/crio-438fe1acec9767201b5af54dae8ba5761377b5b3442b06eeecbb18d4928ccdea WatchSource:0}: Error finding container 438fe1acec9767201b5af54dae8ba5761377b5b3442b06eeecbb18d4928ccdea: Status 404 returned error can't find the container with id 438fe1acec9767201b5af54dae8ba5761377b5b3442b06eeecbb18d4928ccdea
Jul 27 20:45:16.573576 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.573559    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:45:16.959346 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.959312    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4" event={"ID":"2478db46-7b35-49b3-8e52-64798feda77a","Type":"ContainerStarted","Data":"7420024bd42adeadcead50c4257c7ae88f8529665d27f055908b66a8a668d7a0"}
Jul 27 20:45:16.959503 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.959364    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4" event={"ID":"2478db46-7b35-49b3-8e52-64798feda77a","Type":"ContainerStarted","Data":"438fe1acec9767201b5af54dae8ba5761377b5b3442b06eeecbb18d4928ccdea"}
Jul 27 20:45:16.977216 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:16.977172    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4" podStartSLOduration=0.729205498 podStartE2EDuration="977.156966ms" totalImagesPullingTime="247.951468ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:45:16.974806634 +0000 UTC m=+656.615023075" watchObservedRunningTime="2026-07-27 20:45:16.977156966 +0000 UTC m=+656.617373404"
Jul 27 20:45:26.436923 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:26.436891    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:26.437453 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:26.437146    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:26.449248 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:26.449226    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:45:27.016069 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:45:27.016044    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4"
Jul 27 20:47:21.881238 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:21.881197    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55f5c64d95-p5ngb"]
Jul 27 20:47:21.881840 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:21.881527    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55f5c64d95-p5ngb" podUID="b66ed687-951e-4645-b64d-1331cb9be557" containerName="manager" containerID="cri-o://718694f33415484e3b846763df972fa9c82c3f89b77acf31decbceae154d9ad0" gracePeriod=30
Jul 27 20:47:22.133193 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:22.133142    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55f5c64d95-p5ngb"
Jul 27 20:47:22.251079 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:22.251047    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b66ed687-951e-4645-b64d-1331cb9be557-webhook-cert\") pod \"b66ed687-951e-4645-b64d-1331cb9be557\" (UID: \"b66ed687-951e-4645-b64d-1331cb9be557\") "
Jul 27 20:47:22.251236 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:22.251160    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpqqq\" (UniqueName: \"kubernetes.io/projected/b66ed687-951e-4645-b64d-1331cb9be557-kube-api-access-mpqqq\") pod \"b66ed687-951e-4645-b64d-1331cb9be557\" (UID: \"b66ed687-951e-4645-b64d-1331cb9be557\") "
Jul 27 20:47:22.253055 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:22.253024    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b66ed687-951e-4645-b64d-1331cb9be557-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b66ed687-951e-4645-b64d-1331cb9be557" (UID: "b66ed687-951e-4645-b64d-1331cb9be557"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:47:22.253153 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:22.253103    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b66ed687-951e-4645-b64d-1331cb9be557-kube-api-access-mpqqq" (OuterVolumeSpecName: "kube-api-access-mpqqq") pod "b66ed687-951e-4645-b64d-1331cb9be557" (UID: "b66ed687-951e-4645-b64d-1331cb9be557"). InnerVolumeSpecName "kube-api-access-mpqqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:47:22.351798 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:22.351764    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpqqq\" (UniqueName: \"kubernetes.io/projected/b66ed687-951e-4645-b64d-1331cb9be557-kube-api-access-mpqqq\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 20:47:22.351798 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:22.351792    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b66ed687-951e-4645-b64d-1331cb9be557-webhook-cert\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 20:47:22.549726 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:22.549641    2562 generic.go:356] "Generic (PLEG): container finished" podID="b66ed687-951e-4645-b64d-1331cb9be557" containerID="718694f33415484e3b846763df972fa9c82c3f89b77acf31decbceae154d9ad0" exitCode=0
Jul 27 20:47:22.549726 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:22.549691    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55f5c64d95-p5ngb"
Jul 27 20:47:22.549726 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:22.549719    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55f5c64d95-p5ngb" event={"ID":"b66ed687-951e-4645-b64d-1331cb9be557","Type":"ContainerDied","Data":"718694f33415484e3b846763df972fa9c82c3f89b77acf31decbceae154d9ad0"}
Jul 27 20:47:22.549936 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:22.549769    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55f5c64d95-p5ngb" event={"ID":"b66ed687-951e-4645-b64d-1331cb9be557","Type":"ContainerDied","Data":"979e982290f6777df64c64bcd0296a343e9a14b63a64536920f9fd230d2f4b52"}
Jul 27 20:47:22.549936 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:22.549793    2562 scope.go:117] "RemoveContainer" containerID="718694f33415484e3b846763df972fa9c82c3f89b77acf31decbceae154d9ad0"
Jul 27 20:47:22.558958 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:22.558940    2562 scope.go:117] "RemoveContainer" containerID="718694f33415484e3b846763df972fa9c82c3f89b77acf31decbceae154d9ad0"
Jul 27 20:47:22.559227 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:47:22.559209    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"718694f33415484e3b846763df972fa9c82c3f89b77acf31decbceae154d9ad0\": container with ID starting with 718694f33415484e3b846763df972fa9c82c3f89b77acf31decbceae154d9ad0 not found: ID does not exist" containerID="718694f33415484e3b846763df972fa9c82c3f89b77acf31decbceae154d9ad0"
Jul 27 20:47:22.559283 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:22.559236    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"718694f33415484e3b846763df972fa9c82c3f89b77acf31decbceae154d9ad0"} err="failed to get container status \"718694f33415484e3b846763df972fa9c82c3f89b77acf31decbceae154d9ad0\": rpc error: code = NotFound desc = could not find container \"718694f33415484e3b846763df972fa9c82c3f89b77acf31decbceae154d9ad0\": container with ID starting with 718694f33415484e3b846763df972fa9c82c3f89b77acf31decbceae154d9ad0 not found: ID does not exist"
Jul 27 20:47:22.572034 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:22.572009    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55f5c64d95-p5ngb"]
Jul 27 20:47:22.575752 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:22.575729    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55f5c64d95-p5ngb"]
Jul 27 20:47:22.870113 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:47:22.870077    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b66ed687-951e-4645-b64d-1331cb9be557" path="/var/lib/kubelet/pods/b66ed687-951e-4645-b64d-1331cb9be557/volumes"
Jul 27 20:48:23.387318 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:23.387283    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55f5c64d95-w8p5b"]
Jul 27 20:48:23.387711 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:23.387641    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b66ed687-951e-4645-b64d-1331cb9be557" containerName="manager"
Jul 27 20:48:23.387711 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:23.387651    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b66ed687-951e-4645-b64d-1331cb9be557" containerName="manager"
Jul 27 20:48:23.387785 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:23.387731    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b66ed687-951e-4645-b64d-1331cb9be557" containerName="manager"
Jul 27 20:48:23.391777 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:23.391761    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55f5c64d95-w8p5b"
Jul 27 20:48:23.395165 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:23.395138    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 20:48:23.395314 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:23.395138    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 20:48:23.395392 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:23.395148    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mp4d9\""
Jul 27 20:48:23.398022 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:23.397999    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55f5c64d95-w8p5b"]
Jul 27 20:48:23.478107 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:23.478075    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfrcp\" (UniqueName: \"kubernetes.io/projected/463172d1-695e-4013-b03c-446cf9e71b00-kube-api-access-kfrcp\") pod \"maas-controller-55f5c64d95-w8p5b\" (UID: \"463172d1-695e-4013-b03c-446cf9e71b00\") " pod="opendatahub/maas-controller-55f5c64d95-w8p5b"
Jul 27 20:48:23.478247 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:23.478135    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/463172d1-695e-4013-b03c-446cf9e71b00-webhook-cert\") pod \"maas-controller-55f5c64d95-w8p5b\" (UID: \"463172d1-695e-4013-b03c-446cf9e71b00\") " pod="opendatahub/maas-controller-55f5c64d95-w8p5b"
Jul 27 20:48:23.579107 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:23.579074    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfrcp\" (UniqueName: \"kubernetes.io/projected/463172d1-695e-4013-b03c-446cf9e71b00-kube-api-access-kfrcp\") pod \"maas-controller-55f5c64d95-w8p5b\" (UID: \"463172d1-695e-4013-b03c-446cf9e71b00\") " pod="opendatahub/maas-controller-55f5c64d95-w8p5b"
Jul 27 20:48:23.579267 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:23.579212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/463172d1-695e-4013-b03c-446cf9e71b00-webhook-cert\") pod \"maas-controller-55f5c64d95-w8p5b\" (UID: \"463172d1-695e-4013-b03c-446cf9e71b00\") " pod="opendatahub/maas-controller-55f5c64d95-w8p5b"
Jul 27 20:48:23.581610 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:23.581591    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/463172d1-695e-4013-b03c-446cf9e71b00-webhook-cert\") pod \"maas-controller-55f5c64d95-w8p5b\" (UID: \"463172d1-695e-4013-b03c-446cf9e71b00\") " pod="opendatahub/maas-controller-55f5c64d95-w8p5b"
Jul 27 20:48:23.586999 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:23.586971    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfrcp\" (UniqueName: \"kubernetes.io/projected/463172d1-695e-4013-b03c-446cf9e71b00-kube-api-access-kfrcp\") pod \"maas-controller-55f5c64d95-w8p5b\" (UID: \"463172d1-695e-4013-b03c-446cf9e71b00\") " pod="opendatahub/maas-controller-55f5c64d95-w8p5b"
Jul 27 20:48:23.703362 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:23.703256    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55f5c64d95-w8p5b"
Jul 27 20:48:23.833257 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:23.833233    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55f5c64d95-w8p5b"]
Jul 27 20:48:23.835255 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:48:23.835229    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod463172d1_695e_4013_b03c_446cf9e71b00.slice/crio-27e5253a9fb50a8d2cd1175da0f036d1445291d898dc55aa2228e91168ed86de WatchSource:0}: Error finding container 27e5253a9fb50a8d2cd1175da0f036d1445291d898dc55aa2228e91168ed86de: Status 404 returned error can't find the container with id 27e5253a9fb50a8d2cd1175da0f036d1445291d898dc55aa2228e91168ed86de
Jul 27 20:48:24.845076 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:24.845041    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55f5c64d95-w8p5b" event={"ID":"463172d1-695e-4013-b03c-446cf9e71b00","Type":"ContainerStarted","Data":"9cf9cc5f44cce13772b121ecae5d95d73edfa7d5550d5c28dfbfbdef38f6df79"}
Jul 27 20:48:24.845491 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:24.845123    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55f5c64d95-w8p5b" event={"ID":"463172d1-695e-4013-b03c-446cf9e71b00","Type":"ContainerStarted","Data":"27e5253a9fb50a8d2cd1175da0f036d1445291d898dc55aa2228e91168ed86de"}
Jul 27 20:48:24.845491 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:24.845152    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55f5c64d95-w8p5b"
Jul 27 20:48:24.862847 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:24.862801    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55f5c64d95-w8p5b" podStartSLOduration=1.354948471 podStartE2EDuration="1.862789222s" totalImagesPullingTime="507.840751ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:48:24.860985331 +0000 UTC m=+844.501201770" watchObservedRunningTime="2026-07-27 20:48:24.862789222 +0000 UTC m=+844.503005660"
Jul 27 20:48:35.851848 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:35.851814    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55f5c64d95-w8p5b"
Jul 27 20:48:40.471306 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:40.471260    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55f5c64d95-w8p5b"]
Jul 27 20:48:40.471756 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:40.471490    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55f5c64d95-w8p5b" podUID="463172d1-695e-4013-b03c-446cf9e71b00" containerName="manager" containerID="cri-o://9cf9cc5f44cce13772b121ecae5d95d73edfa7d5550d5c28dfbfbdef38f6df79" gracePeriod=30
Jul 27 20:48:40.720878 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:40.720851    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55f5c64d95-w8p5b"
Jul 27 20:48:40.735723 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:40.735671    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfrcp\" (UniqueName: \"kubernetes.io/projected/463172d1-695e-4013-b03c-446cf9e71b00-kube-api-access-kfrcp\") pod \"463172d1-695e-4013-b03c-446cf9e71b00\" (UID: \"463172d1-695e-4013-b03c-446cf9e71b00\") "
Jul 27 20:48:40.735723 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:40.735719    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/463172d1-695e-4013-b03c-446cf9e71b00-webhook-cert\") pod \"463172d1-695e-4013-b03c-446cf9e71b00\" (UID: \"463172d1-695e-4013-b03c-446cf9e71b00\") "
Jul 27 20:48:40.738026 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:40.737993    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/463172d1-695e-4013-b03c-446cf9e71b00-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "463172d1-695e-4013-b03c-446cf9e71b00" (UID: "463172d1-695e-4013-b03c-446cf9e71b00"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:48:40.738510 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:40.738486    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/463172d1-695e-4013-b03c-446cf9e71b00-kube-api-access-kfrcp" (OuterVolumeSpecName: "kube-api-access-kfrcp") pod "463172d1-695e-4013-b03c-446cf9e71b00" (UID: "463172d1-695e-4013-b03c-446cf9e71b00"). InnerVolumeSpecName "kube-api-access-kfrcp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:48:40.837183 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:40.837154    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfrcp\" (UniqueName: \"kubernetes.io/projected/463172d1-695e-4013-b03c-446cf9e71b00-kube-api-access-kfrcp\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 20:48:40.837183 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:40.837178    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/463172d1-695e-4013-b03c-446cf9e71b00-webhook-cert\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 20:48:40.924441 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:40.924404    2562 generic.go:356] "Generic (PLEG): container finished" podID="463172d1-695e-4013-b03c-446cf9e71b00" containerID="9cf9cc5f44cce13772b121ecae5d95d73edfa7d5550d5c28dfbfbdef38f6df79" exitCode=0
Jul 27 20:48:40.924576 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:40.924451    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55f5c64d95-w8p5b"
Jul 27 20:48:40.924576 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:40.924461    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55f5c64d95-w8p5b" event={"ID":"463172d1-695e-4013-b03c-446cf9e71b00","Type":"ContainerDied","Data":"9cf9cc5f44cce13772b121ecae5d95d73edfa7d5550d5c28dfbfbdef38f6df79"}
Jul 27 20:48:40.924576 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:40.924511    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55f5c64d95-w8p5b" event={"ID":"463172d1-695e-4013-b03c-446cf9e71b00","Type":"ContainerDied","Data":"27e5253a9fb50a8d2cd1175da0f036d1445291d898dc55aa2228e91168ed86de"}
Jul 27 20:48:40.924576 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:40.924532    2562 scope.go:117] "RemoveContainer" containerID="9cf9cc5f44cce13772b121ecae5d95d73edfa7d5550d5c28dfbfbdef38f6df79"
Jul 27 20:48:40.933074 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:40.933056    2562 scope.go:117] "RemoveContainer" containerID="9cf9cc5f44cce13772b121ecae5d95d73edfa7d5550d5c28dfbfbdef38f6df79"
Jul 27 20:48:40.933337 ip-10-0-143-205 kubenswrapper[2562]: E0727 20:48:40.933311    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cf9cc5f44cce13772b121ecae5d95d73edfa7d5550d5c28dfbfbdef38f6df79\": container with ID starting with 9cf9cc5f44cce13772b121ecae5d95d73edfa7d5550d5c28dfbfbdef38f6df79 not found: ID does not exist" containerID="9cf9cc5f44cce13772b121ecae5d95d73edfa7d5550d5c28dfbfbdef38f6df79"
Jul 27 20:48:40.933406 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:40.933346    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cf9cc5f44cce13772b121ecae5d95d73edfa7d5550d5c28dfbfbdef38f6df79"} err="failed to get container status \"9cf9cc5f44cce13772b121ecae5d95d73edfa7d5550d5c28dfbfbdef38f6df79\": rpc error: code = NotFound desc = could not find container \"9cf9cc5f44cce13772b121ecae5d95d73edfa7d5550d5c28dfbfbdef38f6df79\": container with ID starting with 9cf9cc5f44cce13772b121ecae5d95d73edfa7d5550d5c28dfbfbdef38f6df79 not found: ID does not exist"
Jul 27 20:48:40.941223 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:40.941202    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55f5c64d95-w8p5b"]
Jul 27 20:48:40.945794 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:40.945773    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55f5c64d95-w8p5b"]
Jul 27 20:48:41.755609 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:41.755573    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55f5c64d95-rfdss"]
Jul 27 20:48:41.756002 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:41.755976    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="463172d1-695e-4013-b03c-446cf9e71b00" containerName="manager"
Jul 27 20:48:41.756002 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:41.755988    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="463172d1-695e-4013-b03c-446cf9e71b00" containerName="manager"
Jul 27 20:48:41.756081 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:41.756063    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="463172d1-695e-4013-b03c-446cf9e71b00" containerName="manager"
Jul 27 20:48:41.760449 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:41.760431    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55f5c64d95-rfdss"
Jul 27 20:48:41.762846 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:41.762826    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 20:48:41.763465 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:41.763447    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 20:48:41.763570 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:41.763450    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mp4d9\""
Jul 27 20:48:41.769068 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:41.769047    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55f5c64d95-rfdss"]
Jul 27 20:48:41.844627 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:41.844602    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp7xs\" (UniqueName: \"kubernetes.io/projected/e53fe4de-f981-4dd5-9016-9f32563aac1c-kube-api-access-xp7xs\") pod \"maas-controller-55f5c64d95-rfdss\" (UID: \"e53fe4de-f981-4dd5-9016-9f32563aac1c\") " pod="opendatahub/maas-controller-55f5c64d95-rfdss"
Jul 27 20:48:41.844748 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:41.844662    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e53fe4de-f981-4dd5-9016-9f32563aac1c-webhook-cert\") pod \"maas-controller-55f5c64d95-rfdss\" (UID: \"e53fe4de-f981-4dd5-9016-9f32563aac1c\") " pod="opendatahub/maas-controller-55f5c64d95-rfdss"
Jul 27 20:48:41.945593 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:41.945564    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e53fe4de-f981-4dd5-9016-9f32563aac1c-webhook-cert\") pod \"maas-controller-55f5c64d95-rfdss\" (UID: \"e53fe4de-f981-4dd5-9016-9f32563aac1c\") " pod="opendatahub/maas-controller-55f5c64d95-rfdss"
Jul 27 20:48:41.945738 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:41.945648    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp7xs\" (UniqueName: \"kubernetes.io/projected/e53fe4de-f981-4dd5-9016-9f32563aac1c-kube-api-access-xp7xs\") pod \"maas-controller-55f5c64d95-rfdss\" (UID: \"e53fe4de-f981-4dd5-9016-9f32563aac1c\") " pod="opendatahub/maas-controller-55f5c64d95-rfdss"
Jul 27 20:48:41.948062 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:41.948044    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e53fe4de-f981-4dd5-9016-9f32563aac1c-webhook-cert\") pod \"maas-controller-55f5c64d95-rfdss\" (UID: \"e53fe4de-f981-4dd5-9016-9f32563aac1c\") " pod="opendatahub/maas-controller-55f5c64d95-rfdss"
Jul 27 20:48:41.953702 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:41.953680    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp7xs\" (UniqueName: \"kubernetes.io/projected/e53fe4de-f981-4dd5-9016-9f32563aac1c-kube-api-access-xp7xs\") pod \"maas-controller-55f5c64d95-rfdss\" (UID: \"e53fe4de-f981-4dd5-9016-9f32563aac1c\") " pod="opendatahub/maas-controller-55f5c64d95-rfdss"
Jul 27 20:48:42.073007 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:42.072979    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55f5c64d95-rfdss"
Jul 27 20:48:42.203857 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:42.203832    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55f5c64d95-rfdss"]
Jul 27 20:48:42.205450 ip-10-0-143-205 kubenswrapper[2562]: W0727 20:48:42.205416    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode53fe4de_f981_4dd5_9016_9f32563aac1c.slice/crio-6357b672dd63d0a6a5d55532d0660faa06a415330b354ccb491fd16dac803894 WatchSource:0}: Error finding container 6357b672dd63d0a6a5d55532d0660faa06a415330b354ccb491fd16dac803894: Status 404 returned error can't find the container with id 6357b672dd63d0a6a5d55532d0660faa06a415330b354ccb491fd16dac803894
Jul 27 20:48:42.870440 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:42.870410    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="463172d1-695e-4013-b03c-446cf9e71b00" path="/var/lib/kubelet/pods/463172d1-695e-4013-b03c-446cf9e71b00/volumes"
Jul 27 20:48:42.936166 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:42.936078    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55f5c64d95-rfdss" event={"ID":"e53fe4de-f981-4dd5-9016-9f32563aac1c","Type":"ContainerStarted","Data":"493befa906070dcf2e042206431a030594154be2ccb895f4ff4d8eba373dd828"}
Jul 27 20:48:42.936166 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:42.936144    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55f5c64d95-rfdss"
Jul 27 20:48:42.936392 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:42.936169    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55f5c64d95-rfdss" event={"ID":"e53fe4de-f981-4dd5-9016-9f32563aac1c","Type":"ContainerStarted","Data":"6357b672dd63d0a6a5d55532d0660faa06a415330b354ccb491fd16dac803894"}
Jul 27 20:48:42.954023 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:42.953971    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55f5c64d95-rfdss" podStartSLOduration=1.5203273290000001 podStartE2EDuration="1.953953566s" totalImagesPullingTime="433.626237ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:48:42.952252971 +0000 UTC m=+862.592469411" watchObservedRunningTime="2026-07-27 20:48:42.953953566 +0000 UTC m=+862.594170006"
Jul 27 20:48:53.943294 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:48:53.943233    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55f5c64d95-rfdss"
Jul 27 20:49:20.827715 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:49:20.827633    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 20:49:20.831798 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:49:20.831774    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 20:49:20.833687 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:49:20.833668    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 20:49:20.837430 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:49:20.837397    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 20:49:20.842014 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:49:20.841996    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 20:49:20.846354 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:49:20.846338    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 20:54:20.859765 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:54:20.859736    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 20:54:20.860610 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:54:20.860591    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 20:54:20.865496 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:54:20.865468    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 20:54:20.866662 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:54:20.866636    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 20:54:20.874538 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:54:20.874514    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 20:54:20.875683 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:54:20.875659    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 20:59:20.890058 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:59:20.890030    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 20:59:20.891239 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:59:20.891216    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 20:59:20.895364 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:59:20.895342    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 20:59:20.896240 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:59:20.896223    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 20:59:20.905982 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:59:20.905964    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 20:59:20.906821 ip-10-0-143-205 kubenswrapper[2562]: I0727 20:59:20.906804    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 21:01:44.834721 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:44.834690    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"]
Jul 27 21:01:44.838429 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:44.838405    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"
Jul 27 21:01:44.841231 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:44.841196    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-dcdeec0f-serving-cert\""
Jul 27 21:01:44.855499 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:44.855461    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"]
Jul 27 21:01:44.920857 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:44.920822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lh8b\" (UniqueName: \"kubernetes.io/projected/dcb3e515-8963-4624-8bae-8ad5e4a73227-kube-api-access-2lh8b\") pod \"maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2\" (UID: \"dcb3e515-8963-4624-8bae-8ad5e4a73227\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"
Jul 27 21:01:44.920857 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:44.920862    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcb3e515-8963-4624-8bae-8ad5e4a73227-openshift-service-ca\") pod \"maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2\" (UID: \"dcb3e515-8963-4624-8bae-8ad5e4a73227\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"
Jul 27 21:01:44.921071 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:44.920887    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcb3e515-8963-4624-8bae-8ad5e4a73227-maas-api-tls\") pod \"maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2\" (UID: \"dcb3e515-8963-4624-8bae-8ad5e4a73227\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"
Jul 27 21:01:45.022183 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.022151    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcb3e515-8963-4624-8bae-8ad5e4a73227-openshift-service-ca\") pod \"maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2\" (UID: \"dcb3e515-8963-4624-8bae-8ad5e4a73227\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"
Jul 27 21:01:45.022183 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.022196    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcb3e515-8963-4624-8bae-8ad5e4a73227-maas-api-tls\") pod \"maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2\" (UID: \"dcb3e515-8963-4624-8bae-8ad5e4a73227\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"
Jul 27 21:01:45.022484 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.022305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lh8b\" (UniqueName: \"kubernetes.io/projected/dcb3e515-8963-4624-8bae-8ad5e4a73227-kube-api-access-2lh8b\") pod \"maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2\" (UID: \"dcb3e515-8963-4624-8bae-8ad5e4a73227\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"
Jul 27 21:01:45.022885 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.022861    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcb3e515-8963-4624-8bae-8ad5e4a73227-openshift-service-ca\") pod \"maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2\" (UID: \"dcb3e515-8963-4624-8bae-8ad5e4a73227\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"
Jul 27 21:01:45.024651 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.024634    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcb3e515-8963-4624-8bae-8ad5e4a73227-maas-api-tls\") pod \"maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2\" (UID: \"dcb3e515-8963-4624-8bae-8ad5e4a73227\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"
Jul 27 21:01:45.030089 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.030072    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lh8b\" (UniqueName: \"kubernetes.io/projected/dcb3e515-8963-4624-8bae-8ad5e4a73227-kube-api-access-2lh8b\") pod \"maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2\" (UID: \"dcb3e515-8963-4624-8bae-8ad5e4a73227\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"
Jul 27 21:01:45.148914 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.148830    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"
Jul 27 21:01:45.297209 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.297180    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"]
Jul 27 21:01:45.299155 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:01:45.299128    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcb3e515_8963_4624_8bae_8ad5e4a73227.slice/crio-41ded34d00a5b464420d748c268bc2a60e473f32c7179c51950c2c1d5b902272 WatchSource:0}: Error finding container 41ded34d00a5b464420d748c268bc2a60e473f32c7179c51950c2c1d5b902272: Status 404 returned error can't find the container with id 41ded34d00a5b464420d748c268bc2a60e473f32c7179c51950c2c1d5b902272
Jul 27 21:01:45.300431 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.300412    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:01:45.584475 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.584439    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546"]
Jul 27 21:01:45.589157 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.589133    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546"
Jul 27 21:01:45.591691 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.591665    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-dcdeec0f-dockercfg-8t82q\""
Jul 27 21:01:45.591820 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.591710    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-dcdeec0f\""
Jul 27 21:01:45.600007 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.599982    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546"]
Jul 27 21:01:45.623887 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.623855    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2" event={"ID":"dcb3e515-8963-4624-8bae-8ad5e4a73227","Type":"ContainerStarted","Data":"41ded34d00a5b464420d748c268bc2a60e473f32c7179c51950c2c1d5b902272"}
Jul 27 21:01:45.729342 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.729252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk9dq\" (UniqueName: \"kubernetes.io/projected/c781c62e-6dc8-4832-9ad9-63c447a7b40b-kube-api-access-tk9dq\") pod \"payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546\" (UID: \"c781c62e-6dc8-4832-9ad9-63c447a7b40b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546"
Jul 27 21:01:45.729487 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.729469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c781c62e-6dc8-4832-9ad9-63c447a7b40b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546\" (UID: \"c781c62e-6dc8-4832-9ad9-63c447a7b40b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546"
Jul 27 21:01:45.830072 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.830040    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk9dq\" (UniqueName: \"kubernetes.io/projected/c781c62e-6dc8-4832-9ad9-63c447a7b40b-kube-api-access-tk9dq\") pod \"payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546\" (UID: \"c781c62e-6dc8-4832-9ad9-63c447a7b40b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546"
Jul 27 21:01:45.830253 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.830120    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c781c62e-6dc8-4832-9ad9-63c447a7b40b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546\" (UID: \"c781c62e-6dc8-4832-9ad9-63c447a7b40b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546"
Jul 27 21:01:45.830813 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.830795    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c781c62e-6dc8-4832-9ad9-63c447a7b40b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546\" (UID: \"c781c62e-6dc8-4832-9ad9-63c447a7b40b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546"
Jul 27 21:01:45.839613 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.839550    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk9dq\" (UniqueName: \"kubernetes.io/projected/c781c62e-6dc8-4832-9ad9-63c447a7b40b-kube-api-access-tk9dq\") pod \"payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546\" (UID: \"c781c62e-6dc8-4832-9ad9-63c447a7b40b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546"
Jul 27 21:01:45.901036 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:45.901005    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546"
Jul 27 21:01:46.039215 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:46.039185    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546"]
Jul 27 21:01:46.040921 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:01:46.040890    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc781c62e_6dc8_4832_9ad9_63c447a7b40b.slice/crio-c2c85e193a2b0f8c408c65ca31ecdac7412a2153c12e8f1e08a35da344e89528 WatchSource:0}: Error finding container c2c85e193a2b0f8c408c65ca31ecdac7412a2153c12e8f1e08a35da344e89528: Status 404 returned error can't find the container with id c2c85e193a2b0f8c408c65ca31ecdac7412a2153c12e8f1e08a35da344e89528
Jul 27 21:01:46.630181 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:46.630144    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546" event={"ID":"c781c62e-6dc8-4832-9ad9-63c447a7b40b","Type":"ContainerStarted","Data":"4933978c994e66531f1d71fcecdfa6364a2c7688df00c489e027ce1f1d056894"}
Jul 27 21:01:46.630405 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:46.630202    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546" event={"ID":"c781c62e-6dc8-4832-9ad9-63c447a7b40b","Type":"ContainerStarted","Data":"c2c85e193a2b0f8c408c65ca31ecdac7412a2153c12e8f1e08a35da344e89528"}
Jul 27 21:01:46.630405 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:46.630228    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546"
Jul 27 21:01:46.631732 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:46.631704    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2" event={"ID":"dcb3e515-8963-4624-8bae-8ad5e4a73227","Type":"ContainerStarted","Data":"61704e5e7fc129856a576829fb676490d060782cd98cb2f5b04c463097dcc9a7"}
Jul 27 21:01:46.631843 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:46.631754    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"
Jul 27 21:01:46.646618 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:46.646571    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546" podStartSLOduration=1.646557734 podStartE2EDuration="1.646557734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:01:46.644987614 +0000 UTC m=+1646.285204081" watchObservedRunningTime="2026-07-27 21:01:46.646557734 +0000 UTC m=+1646.286774172"
Jul 27 21:01:46.663649 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:46.663609    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2" podStartSLOduration=2.273555929 podStartE2EDuration="2.663595082s" totalImagesPullingTime="390.039153ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:01:46.661139333 +0000 UTC m=+1646.301355776" watchObservedRunningTime="2026-07-27 21:01:46.663595082 +0000 UTC m=+1646.303811520"
Jul 27 21:01:52.641768 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:52.641739    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"
Jul 27 21:01:57.638701 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:01:57.638668    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546"
Jul 27 21:02:20.849330 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:20.849296    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"]
Jul 27 21:02:20.849929 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:20.849633    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2" podUID="dcb3e515-8963-4624-8bae-8ad5e4a73227" containerName="maas-api" containerID="cri-o://61704e5e7fc129856a576829fb676490d060782cd98cb2f5b04c463097dcc9a7" gracePeriod=30
Jul 27 21:02:20.913604 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:20.913570    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546"]
Jul 27 21:02:20.913851 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:20.913824    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546" podUID="c781c62e-6dc8-4832-9ad9-63c447a7b40b" containerName="payload-pre-processing" containerID="cri-o://4933978c994e66531f1d71fcecdfa6364a2c7688df00c489e027ce1f1d056894" gracePeriod=30
Jul 27 21:02:21.166655 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.166631    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"
Jul 27 21:02:21.191672 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.191648    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546"
Jul 27 21:02:21.249584 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.249550    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lh8b\" (UniqueName: \"kubernetes.io/projected/dcb3e515-8963-4624-8bae-8ad5e4a73227-kube-api-access-2lh8b\") pod \"dcb3e515-8963-4624-8bae-8ad5e4a73227\" (UID: \"dcb3e515-8963-4624-8bae-8ad5e4a73227\") "
Jul 27 21:02:21.249753 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.249652    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcb3e515-8963-4624-8bae-8ad5e4a73227-openshift-service-ca\") pod \"dcb3e515-8963-4624-8bae-8ad5e4a73227\" (UID: \"dcb3e515-8963-4624-8bae-8ad5e4a73227\") "
Jul 27 21:02:21.249753 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.249673    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcb3e515-8963-4624-8bae-8ad5e4a73227-maas-api-tls\") pod \"dcb3e515-8963-4624-8bae-8ad5e4a73227\" (UID: \"dcb3e515-8963-4624-8bae-8ad5e4a73227\") "
Jul 27 21:02:21.250071 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.250044    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcb3e515-8963-4624-8bae-8ad5e4a73227-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dcb3e515-8963-4624-8bae-8ad5e4a73227" (UID: "dcb3e515-8963-4624-8bae-8ad5e4a73227"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:02:21.251800 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.251775    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcb3e515-8963-4624-8bae-8ad5e4a73227-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dcb3e515-8963-4624-8bae-8ad5e4a73227" (UID: "dcb3e515-8963-4624-8bae-8ad5e4a73227"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:02:21.251911 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.251805    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcb3e515-8963-4624-8bae-8ad5e4a73227-kube-api-access-2lh8b" (OuterVolumeSpecName: "kube-api-access-2lh8b") pod "dcb3e515-8963-4624-8bae-8ad5e4a73227" (UID: "dcb3e515-8963-4624-8bae-8ad5e4a73227"). InnerVolumeSpecName "kube-api-access-2lh8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:02:21.351157 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.351124    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk9dq\" (UniqueName: \"kubernetes.io/projected/c781c62e-6dc8-4832-9ad9-63c447a7b40b-kube-api-access-tk9dq\") pod \"c781c62e-6dc8-4832-9ad9-63c447a7b40b\" (UID: \"c781c62e-6dc8-4832-9ad9-63c447a7b40b\") "
Jul 27 21:02:21.351325 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.351169    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c781c62e-6dc8-4832-9ad9-63c447a7b40b-plugins-config-volume\") pod \"c781c62e-6dc8-4832-9ad9-63c447a7b40b\" (UID: \"c781c62e-6dc8-4832-9ad9-63c447a7b40b\") "
Jul 27 21:02:21.351525 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.351506    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcb3e515-8963-4624-8bae-8ad5e4a73227-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:02:21.351569 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.351535    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcb3e515-8963-4624-8bae-8ad5e4a73227-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:02:21.351569 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.351551    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lh8b\" (UniqueName: \"kubernetes.io/projected/dcb3e515-8963-4624-8bae-8ad5e4a73227-kube-api-access-2lh8b\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:02:21.351637 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.351619    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c781c62e-6dc8-4832-9ad9-63c447a7b40b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c781c62e-6dc8-4832-9ad9-63c447a7b40b" (UID: "c781c62e-6dc8-4832-9ad9-63c447a7b40b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:02:21.353303 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.353282    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c781c62e-6dc8-4832-9ad9-63c447a7b40b-kube-api-access-tk9dq" (OuterVolumeSpecName: "kube-api-access-tk9dq") pod "c781c62e-6dc8-4832-9ad9-63c447a7b40b" (UID: "c781c62e-6dc8-4832-9ad9-63c447a7b40b"). InnerVolumeSpecName "kube-api-access-tk9dq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:02:21.452203 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.452134    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk9dq\" (UniqueName: \"kubernetes.io/projected/c781c62e-6dc8-4832-9ad9-63c447a7b40b-kube-api-access-tk9dq\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:02:21.452203 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.452157    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c781c62e-6dc8-4832-9ad9-63c447a7b40b-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:02:21.806042 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.805948    2562 generic.go:356] "Generic (PLEG): container finished" podID="dcb3e515-8963-4624-8bae-8ad5e4a73227" containerID="61704e5e7fc129856a576829fb676490d060782cd98cb2f5b04c463097dcc9a7" exitCode=0
Jul 27 21:02:21.806042 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.805990    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"
Jul 27 21:02:21.806288 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.806034    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2" event={"ID":"dcb3e515-8963-4624-8bae-8ad5e4a73227","Type":"ContainerDied","Data":"61704e5e7fc129856a576829fb676490d060782cd98cb2f5b04c463097dcc9a7"}
Jul 27 21:02:21.806288 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.806090    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2" event={"ID":"dcb3e515-8963-4624-8bae-8ad5e4a73227","Type":"ContainerDied","Data":"41ded34d00a5b464420d748c268bc2a60e473f32c7179c51950c2c1d5b902272"}
Jul 27 21:02:21.806288 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.806118    2562 scope.go:117] "RemoveContainer" containerID="61704e5e7fc129856a576829fb676490d060782cd98cb2f5b04c463097dcc9a7"
Jul 27 21:02:21.807467 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.807439    2562 generic.go:356] "Generic (PLEG): container finished" podID="c781c62e-6dc8-4832-9ad9-63c447a7b40b" containerID="4933978c994e66531f1d71fcecdfa6364a2c7688df00c489e027ce1f1d056894" exitCode=0
Jul 27 21:02:21.807602 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.807471    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546"
Jul 27 21:02:21.807602 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.807484    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546" event={"ID":"c781c62e-6dc8-4832-9ad9-63c447a7b40b","Type":"ContainerDied","Data":"4933978c994e66531f1d71fcecdfa6364a2c7688df00c489e027ce1f1d056894"}
Jul 27 21:02:21.807602 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.807528    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546" event={"ID":"c781c62e-6dc8-4832-9ad9-63c447a7b40b","Type":"ContainerDied","Data":"c2c85e193a2b0f8c408c65ca31ecdac7412a2153c12e8f1e08a35da344e89528"}
Jul 27 21:02:21.815402 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.815380    2562 scope.go:117] "RemoveContainer" containerID="61704e5e7fc129856a576829fb676490d060782cd98cb2f5b04c463097dcc9a7"
Jul 27 21:02:21.815658 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:02:21.815637    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61704e5e7fc129856a576829fb676490d060782cd98cb2f5b04c463097dcc9a7\": container with ID starting with 61704e5e7fc129856a576829fb676490d060782cd98cb2f5b04c463097dcc9a7 not found: ID does not exist" containerID="61704e5e7fc129856a576829fb676490d060782cd98cb2f5b04c463097dcc9a7"
Jul 27 21:02:21.815719 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.815671    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61704e5e7fc129856a576829fb676490d060782cd98cb2f5b04c463097dcc9a7"} err="failed to get container status \"61704e5e7fc129856a576829fb676490d060782cd98cb2f5b04c463097dcc9a7\": rpc error: code = NotFound desc = could not find container \"61704e5e7fc129856a576829fb676490d060782cd98cb2f5b04c463097dcc9a7\": container with ID starting with 61704e5e7fc129856a576829fb676490d060782cd98cb2f5b04c463097dcc9a7 not found: ID does not exist"
Jul 27 21:02:21.815719 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.815694    2562 scope.go:117] "RemoveContainer" containerID="4933978c994e66531f1d71fcecdfa6364a2c7688df00c489e027ce1f1d056894"
Jul 27 21:02:21.823319 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.823303    2562 scope.go:117] "RemoveContainer" containerID="4933978c994e66531f1d71fcecdfa6364a2c7688df00c489e027ce1f1d056894"
Jul 27 21:02:21.823540 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:02:21.823522    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4933978c994e66531f1d71fcecdfa6364a2c7688df00c489e027ce1f1d056894\": container with ID starting with 4933978c994e66531f1d71fcecdfa6364a2c7688df00c489e027ce1f1d056894 not found: ID does not exist" containerID="4933978c994e66531f1d71fcecdfa6364a2c7688df00c489e027ce1f1d056894"
Jul 27 21:02:21.823594 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.823547    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4933978c994e66531f1d71fcecdfa6364a2c7688df00c489e027ce1f1d056894"} err="failed to get container status \"4933978c994e66531f1d71fcecdfa6364a2c7688df00c489e027ce1f1d056894\": rpc error: code = NotFound desc = could not find container \"4933978c994e66531f1d71fcecdfa6364a2c7688df00c489e027ce1f1d056894\": container with ID starting with 4933978c994e66531f1d71fcecdfa6364a2c7688df00c489e027ce1f1d056894 not found: ID does not exist"
Jul 27 21:02:21.828482 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.828461    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"]
Jul 27 21:02:21.832697 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.832680    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dcdeec0f-787cbc7d47-ppgp2"]
Jul 27 21:02:21.842412 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.842391    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546"]
Jul 27 21:02:21.845908 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:21.845891    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-dcdeec0f-78567cd7c6-8f546"]
Jul 27 21:02:22.869254 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:22.869220    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c781c62e-6dc8-4832-9ad9-63c447a7b40b" path="/var/lib/kubelet/pods/c781c62e-6dc8-4832-9ad9-63c447a7b40b/volumes"
Jul 27 21:02:22.869660 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:22.869618    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcb3e515-8963-4624-8bae-8ad5e4a73227" path="/var/lib/kubelet/pods/dcb3e515-8963-4624-8bae-8ad5e4a73227/volumes"
Jul 27 21:02:29.136670 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.136637    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"]
Jul 27 21:02:29.137204 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.137184    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcb3e515-8963-4624-8bae-8ad5e4a73227" containerName="maas-api"
Jul 27 21:02:29.137319 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.137206    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcb3e515-8963-4624-8bae-8ad5e4a73227" containerName="maas-api"
Jul 27 21:02:29.137319 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.137242    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c781c62e-6dc8-4832-9ad9-63c447a7b40b" containerName="payload-pre-processing"
Jul 27 21:02:29.137319 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.137251    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c781c62e-6dc8-4832-9ad9-63c447a7b40b" containerName="payload-pre-processing"
Jul 27 21:02:29.137483 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.137367    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcb3e515-8963-4624-8bae-8ad5e4a73227" containerName="maas-api"
Jul 27 21:02:29.137483 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.137383    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c781c62e-6dc8-4832-9ad9-63c447a7b40b" containerName="payload-pre-processing"
Jul 27 21:02:29.140786 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.140763    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"
Jul 27 21:02:29.143104 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.143080    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-4d77cbc3-serving-cert\""
Jul 27 21:02:29.150732 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.150711    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"]
Jul 27 21:02:29.220479 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.220451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db3aafed-9372-495d-a304-7d32f6b2ec18-openshift-service-ca\") pod \"maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s\" (UID: \"db3aafed-9372-495d-a304-7d32f6b2ec18\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"
Jul 27 21:02:29.220634 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.220543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwxlj\" (UniqueName: \"kubernetes.io/projected/db3aafed-9372-495d-a304-7d32f6b2ec18-kube-api-access-nwxlj\") pod \"maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s\" (UID: \"db3aafed-9372-495d-a304-7d32f6b2ec18\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"
Jul 27 21:02:29.220634 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.220575    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db3aafed-9372-495d-a304-7d32f6b2ec18-maas-api-tls\") pod \"maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s\" (UID: \"db3aafed-9372-495d-a304-7d32f6b2ec18\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"
Jul 27 21:02:29.321066 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.321037    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db3aafed-9372-495d-a304-7d32f6b2ec18-openshift-service-ca\") pod \"maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s\" (UID: \"db3aafed-9372-495d-a304-7d32f6b2ec18\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"
Jul 27 21:02:29.321299 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.321142    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwxlj\" (UniqueName: \"kubernetes.io/projected/db3aafed-9372-495d-a304-7d32f6b2ec18-kube-api-access-nwxlj\") pod \"maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s\" (UID: \"db3aafed-9372-495d-a304-7d32f6b2ec18\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"
Jul 27 21:02:29.321299 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.321186    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db3aafed-9372-495d-a304-7d32f6b2ec18-maas-api-tls\") pod \"maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s\" (UID: \"db3aafed-9372-495d-a304-7d32f6b2ec18\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"
Jul 27 21:02:29.321421 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:02:29.321353    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-serving-cert: secret "maas-api-e2e-migrate-4d77cbc3-serving-cert" not found
Jul 27 21:02:29.321471 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:02:29.321420    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db3aafed-9372-495d-a304-7d32f6b2ec18-maas-api-tls podName:db3aafed-9372-495d-a304-7d32f6b2ec18 nodeName:}" failed. No retries permitted until 2026-07-27 21:02:29.821404201 +0000 UTC m=+1689.461620619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/db3aafed-9372-495d-a304-7d32f6b2ec18-maas-api-tls") pod "maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s" (UID: "db3aafed-9372-495d-a304-7d32f6b2ec18") : secret "maas-api-e2e-migrate-4d77cbc3-serving-cert" not found
Jul 27 21:02:29.321716 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.321699    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db3aafed-9372-495d-a304-7d32f6b2ec18-openshift-service-ca\") pod \"maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s\" (UID: \"db3aafed-9372-495d-a304-7d32f6b2ec18\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"
Jul 27 21:02:29.330680 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.330654    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwxlj\" (UniqueName: \"kubernetes.io/projected/db3aafed-9372-495d-a304-7d32f6b2ec18-kube-api-access-nwxlj\") pod \"maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s\" (UID: \"db3aafed-9372-495d-a304-7d32f6b2ec18\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"
Jul 27 21:02:29.825112 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.825079    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db3aafed-9372-495d-a304-7d32f6b2ec18-maas-api-tls\") pod \"maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s\" (UID: \"db3aafed-9372-495d-a304-7d32f6b2ec18\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"
Jul 27 21:02:29.827602 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.827572    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db3aafed-9372-495d-a304-7d32f6b2ec18-maas-api-tls\") pod \"maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s\" (UID: \"db3aafed-9372-495d-a304-7d32f6b2ec18\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"
Jul 27 21:02:29.889843 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.889811    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84"]
Jul 27 21:02:29.893351 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.893335    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84"
Jul 27 21:02:29.895759 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.895738    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-4d77cbc3\""
Jul 27 21:02:29.895887 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.895740    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-4d77cbc3-dockercfg-pp69c\""
Jul 27 21:02:29.906393 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.906370    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84"]
Jul 27 21:02:29.922771 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.922747    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt"]
Jul 27 21:02:29.926306 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.926284    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt"
Jul 27 21:02:29.933976 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:29.933955    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt"]
Jul 27 21:02:30.026865 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.026833    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twhs4\" (UniqueName: \"kubernetes.io/projected/74ab7796-efe8-4d9a-8414-441b77170d03-kube-api-access-twhs4\") pod \"payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt\" (UID: \"74ab7796-efe8-4d9a-8414-441b77170d03\") " pod="openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt"
Jul 27 21:02:30.027033 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.026944    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38b2c055-7d39-4b09-9557-e0407c763889-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84\" (UID: \"38b2c055-7d39-4b09-9557-e0407c763889\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84"
Jul 27 21:02:30.027142 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.027116    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trwdv\" (UniqueName: \"kubernetes.io/projected/38b2c055-7d39-4b09-9557-e0407c763889-kube-api-access-trwdv\") pod \"payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84\" (UID: \"38b2c055-7d39-4b09-9557-e0407c763889\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84"
Jul 27 21:02:30.027192 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.027154    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74ab7796-efe8-4d9a-8414-441b77170d03-plugins-config-volume\") pod \"payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt\" (UID: \"74ab7796-efe8-4d9a-8414-441b77170d03\") " pod="openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt"
Jul 27 21:02:30.052876 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.052848    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"
Jul 27 21:02:30.128391 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.128348    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twhs4\" (UniqueName: \"kubernetes.io/projected/74ab7796-efe8-4d9a-8414-441b77170d03-kube-api-access-twhs4\") pod \"payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt\" (UID: \"74ab7796-efe8-4d9a-8414-441b77170d03\") " pod="openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt"
Jul 27 21:02:30.128820 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.128405    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38b2c055-7d39-4b09-9557-e0407c763889-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84\" (UID: \"38b2c055-7d39-4b09-9557-e0407c763889\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84"
Jul 27 21:02:30.128820 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.128469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trwdv\" (UniqueName: \"kubernetes.io/projected/38b2c055-7d39-4b09-9557-e0407c763889-kube-api-access-trwdv\") pod \"payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84\" (UID: \"38b2c055-7d39-4b09-9557-e0407c763889\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84"
Jul 27 21:02:30.128820 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.128488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74ab7796-efe8-4d9a-8414-441b77170d03-plugins-config-volume\") pod \"payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt\" (UID: \"74ab7796-efe8-4d9a-8414-441b77170d03\") " pod="openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt"
Jul 27 21:02:30.129622 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.129324    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74ab7796-efe8-4d9a-8414-441b77170d03-plugins-config-volume\") pod \"payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt\" (UID: \"74ab7796-efe8-4d9a-8414-441b77170d03\") " pod="openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt"
Jul 27 21:02:30.129735 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.129618    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38b2c055-7d39-4b09-9557-e0407c763889-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84\" (UID: \"38b2c055-7d39-4b09-9557-e0407c763889\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84"
Jul 27 21:02:30.136133 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.136106    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twhs4\" (UniqueName: \"kubernetes.io/projected/74ab7796-efe8-4d9a-8414-441b77170d03-kube-api-access-twhs4\") pod \"payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt\" (UID: \"74ab7796-efe8-4d9a-8414-441b77170d03\") " pod="openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt"
Jul 27 21:02:30.136133 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.136126    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trwdv\" (UniqueName: \"kubernetes.io/projected/38b2c055-7d39-4b09-9557-e0407c763889-kube-api-access-trwdv\") pod \"payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84\" (UID: \"38b2c055-7d39-4b09-9557-e0407c763889\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84"
Jul 27 21:02:30.197113 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.197085    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"]
Jul 27 21:02:30.199225 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:02:30.199201    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb3aafed_9372_495d_a304_7d32f6b2ec18.slice/crio-a8c31f59153f9f5c5ff619afcec133235fefeb73aed96c4180c75271d9e5a69a WatchSource:0}: Error finding container a8c31f59153f9f5c5ff619afcec133235fefeb73aed96c4180c75271d9e5a69a: Status 404 returned error can't find the container with id a8c31f59153f9f5c5ff619afcec133235fefeb73aed96c4180c75271d9e5a69a
Jul 27 21:02:30.206145 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.206127    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84"
Jul 27 21:02:30.238303 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.238257    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt"
Jul 27 21:02:30.350731 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.350702    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84"]
Jul 27 21:02:30.352820 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:02:30.352773    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38b2c055_7d39_4b09_9557_e0407c763889.slice/crio-7c7cff0f0f1e5dd67afc96198482ba5fc224b7636c22c92d25826e5130ec4949 WatchSource:0}: Error finding container 7c7cff0f0f1e5dd67afc96198482ba5fc224b7636c22c92d25826e5130ec4949: Status 404 returned error can't find the container with id 7c7cff0f0f1e5dd67afc96198482ba5fc224b7636c22c92d25826e5130ec4949
Jul 27 21:02:30.390608 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.390584    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt"]
Jul 27 21:02:30.392299 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:02:30.392261    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74ab7796_efe8_4d9a_8414_441b77170d03.slice/crio-f65406b4a8e176d9f5dd416c2ba50a9400278de3986b82ef904917b54ce9d508 WatchSource:0}: Error finding container f65406b4a8e176d9f5dd416c2ba50a9400278de3986b82ef904917b54ce9d508: Status 404 returned error can't find the container with id f65406b4a8e176d9f5dd416c2ba50a9400278de3986b82ef904917b54ce9d508
Jul 27 21:02:30.854749 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.854478    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s" event={"ID":"db3aafed-9372-495d-a304-7d32f6b2ec18","Type":"ContainerStarted","Data":"52a05ed207461f1609a0fe6db667e4861e69f3b98191943a6cb3006439cef9ca"}
Jul 27 21:02:30.854749 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.854555    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s" event={"ID":"db3aafed-9372-495d-a304-7d32f6b2ec18","Type":"ContainerStarted","Data":"a8c31f59153f9f5c5ff619afcec133235fefeb73aed96c4180c75271d9e5a69a"}
Jul 27 21:02:30.855069 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.855045    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"
Jul 27 21:02:30.856482 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.856457    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt" event={"ID":"74ab7796-efe8-4d9a-8414-441b77170d03","Type":"ContainerStarted","Data":"1b16a538739ae630932846afdb43959cbef65ccd737150aaf915357894db4a15"}
Jul 27 21:02:30.856593 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.856502    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt" event={"ID":"74ab7796-efe8-4d9a-8414-441b77170d03","Type":"ContainerStarted","Data":"f65406b4a8e176d9f5dd416c2ba50a9400278de3986b82ef904917b54ce9d508"}
Jul 27 21:02:30.856593 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.856531    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt"
Jul 27 21:02:30.858283 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.858245    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84" event={"ID":"38b2c055-7d39-4b09-9557-e0407c763889","Type":"ContainerStarted","Data":"d852b07e9d6761715eeef60a657f8277b0ca486bff762e6dbad80b1ade376b5c"}
Jul 27 21:02:30.858393 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.858310    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84" event={"ID":"38b2c055-7d39-4b09-9557-e0407c763889","Type":"ContainerStarted","Data":"7c7cff0f0f1e5dd67afc96198482ba5fc224b7636c22c92d25826e5130ec4949"}
Jul 27 21:02:30.858393 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.858370    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84"
Jul 27 21:02:30.872980 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.872935    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s" podStartSLOduration=1.33255447 podStartE2EDuration="1.872920375s" totalImagesPullingTime="540.365905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:30.87106427 +0000 UTC m=+1690.511280710" watchObservedRunningTime="2026-07-27 21:02:30.872920375 +0000 UTC m=+1690.513136822"
Jul 27 21:02:30.888983 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.888937    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84" podStartSLOduration=1.888921069 podStartE2EDuration="1.888921069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:30.887895279 +0000 UTC m=+1690.528111742" watchObservedRunningTime="2026-07-27 21:02:30.888921069 +0000 UTC m=+1690.529137513"
Jul 27 21:02:30.904857 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:30.904812    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt" podStartSLOduration=1.904800425 podStartE2EDuration="1.904800425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:30.903325107 +0000 UTC m=+1690.543541566" watchObservedRunningTime="2026-07-27 21:02:30.904800425 +0000 UTC m=+1690.545016891"
Jul 27 21:02:36.872023 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:36.871994    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"
Jul 27 21:02:41.865487 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:41.865430    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84" podUID="38b2c055-7d39-4b09-9557-e0407c763889" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.47:9004: connect: connection refused"
Jul 27 21:02:41.865955 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:41.865782    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt"
Jul 27 21:02:51.864051 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:02:51.863859    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84"
Jul 27 21:03:04.631630 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:04.631596    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"]
Jul 27 21:03:04.632123 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:04.631839    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s" podUID="db3aafed-9372-495d-a304-7d32f6b2ec18" containerName="maas-api" containerID="cri-o://52a05ed207461f1609a0fe6db667e4861e69f3b98191943a6cb3006439cef9ca" gracePeriod=30
Jul 27 21:03:04.676085 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:04.676051    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt"]
Jul 27 21:03:04.676333 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:04.676304    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt" podUID="74ab7796-efe8-4d9a-8414-441b77170d03" containerName="payload-processing" containerID="cri-o://1b16a538739ae630932846afdb43959cbef65ccd737150aaf915357894db4a15" gracePeriod=30
Jul 27 21:03:04.683823 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:04.683791    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84"]
Jul 27 21:03:04.684024 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:04.683997    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84" podUID="38b2c055-7d39-4b09-9557-e0407c763889" containerName="payload-pre-processing" containerID="cri-o://d852b07e9d6761715eeef60a657f8277b0ca486bff762e6dbad80b1ade376b5c" gracePeriod=30
Jul 27 21:03:04.957469 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:04.957418    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"
Jul 27 21:03:04.961286 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:04.961252    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt"
Jul 27 21:03:04.984311 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:04.984288    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84"
Jul 27 21:03:05.031637 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.031611    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twhs4\" (UniqueName: \"kubernetes.io/projected/74ab7796-efe8-4d9a-8414-441b77170d03-kube-api-access-twhs4\") pod \"74ab7796-efe8-4d9a-8414-441b77170d03\" (UID: \"74ab7796-efe8-4d9a-8414-441b77170d03\") "
Jul 27 21:03:05.031802 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.031667    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74ab7796-efe8-4d9a-8414-441b77170d03-plugins-config-volume\") pod \"74ab7796-efe8-4d9a-8414-441b77170d03\" (UID: \"74ab7796-efe8-4d9a-8414-441b77170d03\") "
Jul 27 21:03:05.031802 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.031691    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38b2c055-7d39-4b09-9557-e0407c763889-plugins-config-volume\") pod \"38b2c055-7d39-4b09-9557-e0407c763889\" (UID: \"38b2c055-7d39-4b09-9557-e0407c763889\") "
Jul 27 21:03:05.031802 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.031715    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trwdv\" (UniqueName: \"kubernetes.io/projected/38b2c055-7d39-4b09-9557-e0407c763889-kube-api-access-trwdv\") pod \"38b2c055-7d39-4b09-9557-e0407c763889\" (UID: \"38b2c055-7d39-4b09-9557-e0407c763889\") "
Jul 27 21:03:05.031802 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.031774    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db3aafed-9372-495d-a304-7d32f6b2ec18-maas-api-tls\") pod \"db3aafed-9372-495d-a304-7d32f6b2ec18\" (UID: \"db3aafed-9372-495d-a304-7d32f6b2ec18\") "
Jul 27 21:03:05.032033 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.031803    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwxlj\" (UniqueName: \"kubernetes.io/projected/db3aafed-9372-495d-a304-7d32f6b2ec18-kube-api-access-nwxlj\") pod \"db3aafed-9372-495d-a304-7d32f6b2ec18\" (UID: \"db3aafed-9372-495d-a304-7d32f6b2ec18\") "
Jul 27 21:03:05.032033 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.031859    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db3aafed-9372-495d-a304-7d32f6b2ec18-openshift-service-ca\") pod \"db3aafed-9372-495d-a304-7d32f6b2ec18\" (UID: \"db3aafed-9372-495d-a304-7d32f6b2ec18\") "
Jul 27 21:03:05.032140 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.032070    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74ab7796-efe8-4d9a-8414-441b77170d03-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "74ab7796-efe8-4d9a-8414-441b77170d03" (UID: "74ab7796-efe8-4d9a-8414-441b77170d03"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:03:05.032140 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.032094    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38b2c055-7d39-4b09-9557-e0407c763889-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "38b2c055-7d39-4b09-9557-e0407c763889" (UID: "38b2c055-7d39-4b09-9557-e0407c763889"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:03:05.032252 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.032191    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74ab7796-efe8-4d9a-8414-441b77170d03-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:03:05.032540 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.032367    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38b2c055-7d39-4b09-9557-e0407c763889-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:03:05.032540 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.032377    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db3aafed-9372-495d-a304-7d32f6b2ec18-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "db3aafed-9372-495d-a304-7d32f6b2ec18" (UID: "db3aafed-9372-495d-a304-7d32f6b2ec18"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:03:05.034328 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.034266    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74ab7796-efe8-4d9a-8414-441b77170d03-kube-api-access-twhs4" (OuterVolumeSpecName: "kube-api-access-twhs4") pod "74ab7796-efe8-4d9a-8414-441b77170d03" (UID: "74ab7796-efe8-4d9a-8414-441b77170d03"). InnerVolumeSpecName "kube-api-access-twhs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:03:05.034533 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.034513    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db3aafed-9372-495d-a304-7d32f6b2ec18-kube-api-access-nwxlj" (OuterVolumeSpecName: "kube-api-access-nwxlj") pod "db3aafed-9372-495d-a304-7d32f6b2ec18" (UID: "db3aafed-9372-495d-a304-7d32f6b2ec18"). InnerVolumeSpecName "kube-api-access-nwxlj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:03:05.034659 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.034639    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db3aafed-9372-495d-a304-7d32f6b2ec18-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "db3aafed-9372-495d-a304-7d32f6b2ec18" (UID: "db3aafed-9372-495d-a304-7d32f6b2ec18"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:03:05.034715 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.034659    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38b2c055-7d39-4b09-9557-e0407c763889-kube-api-access-trwdv" (OuterVolumeSpecName: "kube-api-access-trwdv") pod "38b2c055-7d39-4b09-9557-e0407c763889" (UID: "38b2c055-7d39-4b09-9557-e0407c763889"). InnerVolumeSpecName "kube-api-access-trwdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:03:05.038881 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.038857    2562 generic.go:356] "Generic (PLEG): container finished" podID="74ab7796-efe8-4d9a-8414-441b77170d03" containerID="1b16a538739ae630932846afdb43959cbef65ccd737150aaf915357894db4a15" exitCode=0
Jul 27 21:03:05.038988 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.038911    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt"
Jul 27 21:03:05.038988 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.038935    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt" event={"ID":"74ab7796-efe8-4d9a-8414-441b77170d03","Type":"ContainerDied","Data":"1b16a538739ae630932846afdb43959cbef65ccd737150aaf915357894db4a15"}
Jul 27 21:03:05.038988 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.038984    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt" event={"ID":"74ab7796-efe8-4d9a-8414-441b77170d03","Type":"ContainerDied","Data":"f65406b4a8e176d9f5dd416c2ba50a9400278de3986b82ef904917b54ce9d508"}
Jul 27 21:03:05.039144 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.039010    2562 scope.go:117] "RemoveContainer" containerID="1b16a538739ae630932846afdb43959cbef65ccd737150aaf915357894db4a15"
Jul 27 21:03:05.044391 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.044365    2562 generic.go:356] "Generic (PLEG): container finished" podID="38b2c055-7d39-4b09-9557-e0407c763889" containerID="d852b07e9d6761715eeef60a657f8277b0ca486bff762e6dbad80b1ade376b5c" exitCode=0
Jul 27 21:03:05.044499 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.044408    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84"
Jul 27 21:03:05.044499 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.044440    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84" event={"ID":"38b2c055-7d39-4b09-9557-e0407c763889","Type":"ContainerDied","Data":"d852b07e9d6761715eeef60a657f8277b0ca486bff762e6dbad80b1ade376b5c"}
Jul 27 21:03:05.044499 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.044483    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84" event={"ID":"38b2c055-7d39-4b09-9557-e0407c763889","Type":"ContainerDied","Data":"7c7cff0f0f1e5dd67afc96198482ba5fc224b7636c22c92d25826e5130ec4949"}
Jul 27 21:03:05.046066 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.046038    2562 generic.go:356] "Generic (PLEG): container finished" podID="db3aafed-9372-495d-a304-7d32f6b2ec18" containerID="52a05ed207461f1609a0fe6db667e4861e69f3b98191943a6cb3006439cef9ca" exitCode=0
Jul 27 21:03:05.046188 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.046082    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"
Jul 27 21:03:05.046188 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.046130    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s" event={"ID":"db3aafed-9372-495d-a304-7d32f6b2ec18","Type":"ContainerDied","Data":"52a05ed207461f1609a0fe6db667e4861e69f3b98191943a6cb3006439cef9ca"}
Jul 27 21:03:05.046188 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.046168    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s" event={"ID":"db3aafed-9372-495d-a304-7d32f6b2ec18","Type":"ContainerDied","Data":"a8c31f59153f9f5c5ff619afcec133235fefeb73aed96c4180c75271d9e5a69a"}
Jul 27 21:03:05.054950 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.054934    2562 scope.go:117] "RemoveContainer" containerID="1b16a538739ae630932846afdb43959cbef65ccd737150aaf915357894db4a15"
Jul 27 21:03:05.055207 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:03:05.055192    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b16a538739ae630932846afdb43959cbef65ccd737150aaf915357894db4a15\": container with ID starting with 1b16a538739ae630932846afdb43959cbef65ccd737150aaf915357894db4a15 not found: ID does not exist" containerID="1b16a538739ae630932846afdb43959cbef65ccd737150aaf915357894db4a15"
Jul 27 21:03:05.055261 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.055215    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b16a538739ae630932846afdb43959cbef65ccd737150aaf915357894db4a15"} err="failed to get container status \"1b16a538739ae630932846afdb43959cbef65ccd737150aaf915357894db4a15\": rpc error: code = NotFound desc = could not find container \"1b16a538739ae630932846afdb43959cbef65ccd737150aaf915357894db4a15\": container with ID starting with 1b16a538739ae630932846afdb43959cbef65ccd737150aaf915357894db4a15 not found: ID does not exist"
Jul 27 21:03:05.055261 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.055230    2562 scope.go:117] "RemoveContainer" containerID="d852b07e9d6761715eeef60a657f8277b0ca486bff762e6dbad80b1ade376b5c"
Jul 27 21:03:05.063770 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.063736    2562 scope.go:117] "RemoveContainer" containerID="d852b07e9d6761715eeef60a657f8277b0ca486bff762e6dbad80b1ade376b5c"
Jul 27 21:03:05.064115 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:03:05.064091    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d852b07e9d6761715eeef60a657f8277b0ca486bff762e6dbad80b1ade376b5c\": container with ID starting with d852b07e9d6761715eeef60a657f8277b0ca486bff762e6dbad80b1ade376b5c not found: ID does not exist" containerID="d852b07e9d6761715eeef60a657f8277b0ca486bff762e6dbad80b1ade376b5c"
Jul 27 21:03:05.064186 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.064123    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d852b07e9d6761715eeef60a657f8277b0ca486bff762e6dbad80b1ade376b5c"} err="failed to get container status \"d852b07e9d6761715eeef60a657f8277b0ca486bff762e6dbad80b1ade376b5c\": rpc error: code = NotFound desc = could not find container \"d852b07e9d6761715eeef60a657f8277b0ca486bff762e6dbad80b1ade376b5c\": container with ID starting with d852b07e9d6761715eeef60a657f8277b0ca486bff762e6dbad80b1ade376b5c not found: ID does not exist"
Jul 27 21:03:05.064186 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.064139    2562 scope.go:117] "RemoveContainer" containerID="52a05ed207461f1609a0fe6db667e4861e69f3b98191943a6cb3006439cef9ca"
Jul 27 21:03:05.066465 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.066444    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt"]
Jul 27 21:03:05.072153 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.072128    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4d77cbc3-6566c6b497-cslmt"]
Jul 27 21:03:05.072842 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.072827    2562 scope.go:117] "RemoveContainer" containerID="52a05ed207461f1609a0fe6db667e4861e69f3b98191943a6cb3006439cef9ca"
Jul 27 21:03:05.073062 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:03:05.073045    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52a05ed207461f1609a0fe6db667e4861e69f3b98191943a6cb3006439cef9ca\": container with ID starting with 52a05ed207461f1609a0fe6db667e4861e69f3b98191943a6cb3006439cef9ca not found: ID does not exist" containerID="52a05ed207461f1609a0fe6db667e4861e69f3b98191943a6cb3006439cef9ca"
Jul 27 21:03:05.073127 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.073067    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a05ed207461f1609a0fe6db667e4861e69f3b98191943a6cb3006439cef9ca"} err="failed to get container status \"52a05ed207461f1609a0fe6db667e4861e69f3b98191943a6cb3006439cef9ca\": rpc error: code = NotFound desc = could not find container \"52a05ed207461f1609a0fe6db667e4861e69f3b98191943a6cb3006439cef9ca\": container with ID starting with 52a05ed207461f1609a0fe6db667e4861e69f3b98191943a6cb3006439cef9ca not found: ID does not exist"
Jul 27 21:03:05.081987 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.081970    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"]
Jul 27 21:03:05.085828 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.085810    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4d77cbc3-dbcb687f-26w8s"]
Jul 27 21:03:05.095376 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.095356    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84"]
Jul 27 21:03:05.100873 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.100851    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-4d77cbc3-588c495dcb-62n84"]
Jul 27 21:03:05.133068 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.133049    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twhs4\" (UniqueName: \"kubernetes.io/projected/74ab7796-efe8-4d9a-8414-441b77170d03-kube-api-access-twhs4\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:03:05.133068 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.133068    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trwdv\" (UniqueName: \"kubernetes.io/projected/38b2c055-7d39-4b09-9557-e0407c763889-kube-api-access-trwdv\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:03:05.133191 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.133079    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db3aafed-9372-495d-a304-7d32f6b2ec18-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:03:05.133191 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.133089    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwxlj\" (UniqueName: \"kubernetes.io/projected/db3aafed-9372-495d-a304-7d32f6b2ec18-kube-api-access-nwxlj\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:03:05.133191 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:05.133098    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db3aafed-9372-495d-a304-7d32f6b2ec18-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:03:06.872944 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:06.872911    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38b2c055-7d39-4b09-9557-e0407c763889" path="/var/lib/kubelet/pods/38b2c055-7d39-4b09-9557-e0407c763889/volumes"
Jul 27 21:03:06.873326 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:06.873255    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74ab7796-efe8-4d9a-8414-441b77170d03" path="/var/lib/kubelet/pods/74ab7796-efe8-4d9a-8414-441b77170d03/volumes"
Jul 27 21:03:06.873630 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:06.873616    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db3aafed-9372-495d-a304-7d32f6b2ec18" path="/var/lib/kubelet/pods/db3aafed-9372-495d-a304-7d32f6b2ec18/volumes"
Jul 27 21:03:12.251364 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.251329    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"]
Jul 27 21:03:12.251833 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.251740    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38b2c055-7d39-4b09-9557-e0407c763889" containerName="payload-pre-processing"
Jul 27 21:03:12.251833 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.251758    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="38b2c055-7d39-4b09-9557-e0407c763889" containerName="payload-pre-processing"
Jul 27 21:03:12.251833 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.251793    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db3aafed-9372-495d-a304-7d32f6b2ec18" containerName="maas-api"
Jul 27 21:03:12.251833 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.251804    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="db3aafed-9372-495d-a304-7d32f6b2ec18" containerName="maas-api"
Jul 27 21:03:12.251833 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.251819    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74ab7796-efe8-4d9a-8414-441b77170d03" containerName="payload-processing"
Jul 27 21:03:12.251833 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.251825    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="74ab7796-efe8-4d9a-8414-441b77170d03" containerName="payload-processing"
Jul 27 21:03:12.252126 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.251909    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="74ab7796-efe8-4d9a-8414-441b77170d03" containerName="payload-processing"
Jul 27 21:03:12.252126 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.251920    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="db3aafed-9372-495d-a304-7d32f6b2ec18" containerName="maas-api"
Jul 27 21:03:12.252126 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.251930    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="38b2c055-7d39-4b09-9557-e0407c763889" containerName="payload-pre-processing"
Jul 27 21:03:12.256622 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.256601    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"
Jul 27 21:03:12.259181 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.259162    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-df7343e0-serving-cert\""
Jul 27 21:03:12.266675 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.266649    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"]
Jul 27 21:03:12.395463 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.395430    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-maas-api-tls\") pod \"maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6\" (UID: \"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"
Jul 27 21:03:12.395615 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.395481    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw6wx\" (UniqueName: \"kubernetes.io/projected/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-kube-api-access-qw6wx\") pod \"maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6\" (UID: \"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"
Jul 27 21:03:12.395615 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.395589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-openshift-service-ca\") pod \"maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6\" (UID: \"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"
Jul 27 21:03:12.497067 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.497035    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw6wx\" (UniqueName: \"kubernetes.io/projected/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-kube-api-access-qw6wx\") pod \"maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6\" (UID: \"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"
Jul 27 21:03:12.497226 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.497074    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-openshift-service-ca\") pod \"maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6\" (UID: \"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"
Jul 27 21:03:12.497323 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.497293    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-maas-api-tls\") pod \"maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6\" (UID: \"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"
Jul 27 21:03:12.497493 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:03:12.497366    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-serving-cert: secret "maas-api-e2e-ait-df7343e0-serving-cert" not found
Jul 27 21:03:12.497493 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:03:12.497424    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-maas-api-tls podName:75cdcbf8-ef9c-4bfc-9fd2-e10e619507db nodeName:}" failed. No retries permitted until 2026-07-27 21:03:12.997409892 +0000 UTC m=+1732.637626308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-maas-api-tls") pod "maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6" (UID: "75cdcbf8-ef9c-4bfc-9fd2-e10e619507db") : secret "maas-api-e2e-ait-df7343e0-serving-cert" not found
Jul 27 21:03:12.497689 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.497673    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-openshift-service-ca\") pod \"maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6\" (UID: \"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"
Jul 27 21:03:12.506225 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:12.506156    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw6wx\" (UniqueName: \"kubernetes.io/projected/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-kube-api-access-qw6wx\") pod \"maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6\" (UID: \"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"
Jul 27 21:03:13.001670 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.001639    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-maas-api-tls\") pod \"maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6\" (UID: \"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"
Jul 27 21:03:13.004585 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.004554    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-maas-api-tls\") pod \"maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6\" (UID: \"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"
Jul 27 21:03:13.083863 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.083819    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc"]
Jul 27 21:03:13.087671 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.087654    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc"
Jul 27 21:03:13.090540 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.090519    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-df7343e0\""
Jul 27 21:03:13.104184 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.104148    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc"]
Jul 27 21:03:13.107965 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.107940    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf"]
Jul 27 21:03:13.111447 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.111429    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf"
Jul 27 21:03:13.114249 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.114232    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-df7343e0-dockercfg-rrnf9\""
Jul 27 21:03:13.123110 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.123089    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf"]
Jul 27 21:03:13.171122 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.171092    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"
Jul 27 21:03:13.206397 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.206363    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vxl7\" (UniqueName: \"kubernetes.io/projected/e442a593-a024-4e78-8220-2364b015fa7a-kube-api-access-7vxl7\") pod \"payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc\" (UID: \"e442a593-a024-4e78-8220-2364b015fa7a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc"
Jul 27 21:03:13.206568 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.206473    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr5nx\" (UniqueName: \"kubernetes.io/projected/1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da-kube-api-access-rr5nx\") pod \"payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf\" (UID: \"1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da\") " pod="openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf"
Jul 27 21:03:13.206568 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.206523    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da-plugins-config-volume\") pod \"payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf\" (UID: \"1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da\") " pod="openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf"
Jul 27 21:03:13.206698 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.206642    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e442a593-a024-4e78-8220-2364b015fa7a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc\" (UID: \"e442a593-a024-4e78-8220-2364b015fa7a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc"
Jul 27 21:03:13.307862 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.307818    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vxl7\" (UniqueName: \"kubernetes.io/projected/e442a593-a024-4e78-8220-2364b015fa7a-kube-api-access-7vxl7\") pod \"payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc\" (UID: \"e442a593-a024-4e78-8220-2364b015fa7a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc"
Jul 27 21:03:13.307862 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.307859    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr5nx\" (UniqueName: \"kubernetes.io/projected/1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da-kube-api-access-rr5nx\") pod \"payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf\" (UID: \"1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da\") " pod="openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf"
Jul 27 21:03:13.308363 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.307894    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da-plugins-config-volume\") pod \"payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf\" (UID: \"1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da\") " pod="openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf"
Jul 27 21:03:13.308363 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.307975    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e442a593-a024-4e78-8220-2364b015fa7a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc\" (UID: \"e442a593-a024-4e78-8220-2364b015fa7a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc"
Jul 27 21:03:13.308712 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.308692    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da-plugins-config-volume\") pod \"payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf\" (UID: \"1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da\") " pod="openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf"
Jul 27 21:03:13.308758 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.308733    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e442a593-a024-4e78-8220-2364b015fa7a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc\" (UID: \"e442a593-a024-4e78-8220-2364b015fa7a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc"
Jul 27 21:03:13.315245 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.315219    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"]
Jul 27 21:03:13.316556 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:03:13.316507    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75cdcbf8_ef9c_4bfc_9fd2_e10e619507db.slice/crio-d032eafd57b7a8fdb292192870bd813495205da1946084c688b15e71f4cacdf4 WatchSource:0}: Error finding container d032eafd57b7a8fdb292192870bd813495205da1946084c688b15e71f4cacdf4: Status 404 returned error can't find the container with id d032eafd57b7a8fdb292192870bd813495205da1946084c688b15e71f4cacdf4
Jul 27 21:03:13.320033 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.320013    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr5nx\" (UniqueName: \"kubernetes.io/projected/1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da-kube-api-access-rr5nx\") pod \"payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf\" (UID: \"1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da\") " pod="openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf"
Jul 27 21:03:13.320201 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.320184    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vxl7\" (UniqueName: \"kubernetes.io/projected/e442a593-a024-4e78-8220-2364b015fa7a-kube-api-access-7vxl7\") pod \"payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc\" (UID: \"e442a593-a024-4e78-8220-2364b015fa7a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc"
Jul 27 21:03:13.408240 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.408208    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc"
Jul 27 21:03:13.422243 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.422219    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf"
Jul 27 21:03:13.557482 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.557449    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc"]
Jul 27 21:03:13.559641 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:03:13.559599    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode442a593_a024_4e78_8220_2364b015fa7a.slice/crio-63b84a81ebf91234a6a8c59fb60bf55868233da1af776d45006f122dac95f744 WatchSource:0}: Error finding container 63b84a81ebf91234a6a8c59fb60bf55868233da1af776d45006f122dac95f744: Status 404 returned error can't find the container with id 63b84a81ebf91234a6a8c59fb60bf55868233da1af776d45006f122dac95f744
Jul 27 21:03:13.795852 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:13.795825    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf"]
Jul 27 21:03:13.800557 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:03:13.800529    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d3fd5e0_7ffb_47e3_ad6c_0ea53cd510da.slice/crio-c9d25993fc8fdb0f6beee752fd549fa85bf061a3e7bdee940015f9896b9a4fc3 WatchSource:0}: Error finding container c9d25993fc8fdb0f6beee752fd549fa85bf061a3e7bdee940015f9896b9a4fc3: Status 404 returned error can't find the container with id c9d25993fc8fdb0f6beee752fd549fa85bf061a3e7bdee940015f9896b9a4fc3
Jul 27 21:03:14.092509 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:14.092468    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6" event={"ID":"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db","Type":"ContainerStarted","Data":"ff17bd2e0d3938ddac53b44c0dd2ef22422062c9f926a394287a2450afbdef3a"}
Jul 27 21:03:14.092717 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:14.092536    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6" event={"ID":"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db","Type":"ContainerStarted","Data":"d032eafd57b7a8fdb292192870bd813495205da1946084c688b15e71f4cacdf4"}
Jul 27 21:03:14.092717 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:14.092566    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"
Jul 27 21:03:14.093966 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:14.093939    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc" event={"ID":"e442a593-a024-4e78-8220-2364b015fa7a","Type":"ContainerStarted","Data":"7c691f964b9d097f514bb9fd35c93f6e2370bbf4c51c9b4ce28606001e6b3241"}
Jul 27 21:03:14.094092 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:14.093981    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc" event={"ID":"e442a593-a024-4e78-8220-2364b015fa7a","Type":"ContainerStarted","Data":"63b84a81ebf91234a6a8c59fb60bf55868233da1af776d45006f122dac95f744"}
Jul 27 21:03:14.094092 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:14.094032    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc"
Jul 27 21:03:14.095451 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:14.095417    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf" event={"ID":"1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da","Type":"ContainerStarted","Data":"5555dd931447f0225a16ef40cc1ed9002289a09b71f2d280f24669bcdf2d09a2"}
Jul 27 21:03:14.095568 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:14.095466    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf"
Jul 27 21:03:14.095568 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:14.095482    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf" event={"ID":"1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da","Type":"ContainerStarted","Data":"c9d25993fc8fdb0f6beee752fd549fa85bf061a3e7bdee940015f9896b9a4fc3"}
Jul 27 21:03:14.108042 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:14.108000    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6" podStartSLOduration=1.6232489 podStartE2EDuration="2.107985407s" totalImagesPullingTime="484.736507ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:03:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:03:14.107169634 +0000 UTC m=+1733.747386286" watchObservedRunningTime="2026-07-27 21:03:14.107985407 +0000 UTC m=+1733.748201846"
Jul 27 21:03:14.124650 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:14.124603    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc" podStartSLOduration=1.124584879 podStartE2EDuration="1.124584879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:03:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:03:14.121312709 +0000 UTC m=+1733.761529168" watchObservedRunningTime="2026-07-27 21:03:14.124584879 +0000 UTC m=+1733.764801320"
Jul 27 21:03:14.137348 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:14.137307    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf" podStartSLOduration=1.137294824 podStartE2EDuration="1.137294824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:03:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:03:14.135702751 +0000 UTC m=+1733.775919190" watchObservedRunningTime="2026-07-27 21:03:14.137294824 +0000 UTC m=+1733.777511288"
Jul 27 21:03:20.106949 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:20.106913    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"
Jul 27 21:03:25.103390 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:25.103353    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc"
Jul 27 21:03:25.103907 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:25.103573    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf"
Jul 27 21:03:49.711972 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:49.711936    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"]
Jul 27 21:03:49.712499 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:49.712188    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6" podUID="75cdcbf8-ef9c-4bfc-9fd2-e10e619507db" containerName="maas-api" containerID="cri-o://ff17bd2e0d3938ddac53b44c0dd2ef22422062c9f926a394287a2450afbdef3a" gracePeriod=30
Jul 27 21:03:49.763742 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:49.763717    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf"]
Jul 27 21:03:49.763931 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:49.763905    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf" podUID="1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da" containerName="payload-processing" containerID="cri-o://5555dd931447f0225a16ef40cc1ed9002289a09b71f2d280f24669bcdf2d09a2" gracePeriod=30
Jul 27 21:03:49.773608 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:49.773569    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc"]
Jul 27 21:03:49.774452 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:49.774028    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc" podUID="e442a593-a024-4e78-8220-2364b015fa7a" containerName="payload-pre-processing" containerID="cri-o://7c691f964b9d097f514bb9fd35c93f6e2370bbf4c51c9b4ce28606001e6b3241" gracePeriod=30
Jul 27 21:03:50.058840 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.058813    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf"
Jul 27 21:03:50.061518 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.061494    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"
Jul 27 21:03:50.078414 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.078336    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc"
Jul 27 21:03:50.134588 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.134559    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da-plugins-config-volume\") pod \"1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da\" (UID: \"1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da\") "
Jul 27 21:03:50.134588 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.134593    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-openshift-service-ca\") pod \"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db\" (UID: \"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db\") "
Jul 27 21:03:50.134858 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.134609    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rr5nx\" (UniqueName: \"kubernetes.io/projected/1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da-kube-api-access-rr5nx\") pod \"1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da\" (UID: \"1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da\") "
Jul 27 21:03:50.134858 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.134684    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e442a593-a024-4e78-8220-2364b015fa7a-plugins-config-volume\") pod \"e442a593-a024-4e78-8220-2364b015fa7a\" (UID: \"e442a593-a024-4e78-8220-2364b015fa7a\") "
Jul 27 21:03:50.134858 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.134737    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-maas-api-tls\") pod \"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db\" (UID: \"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db\") "
Jul 27 21:03:50.134858 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.134775    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vxl7\" (UniqueName: \"kubernetes.io/projected/e442a593-a024-4e78-8220-2364b015fa7a-kube-api-access-7vxl7\") pod \"e442a593-a024-4e78-8220-2364b015fa7a\" (UID: \"e442a593-a024-4e78-8220-2364b015fa7a\") "
Jul 27 21:03:50.134858 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.134805    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qw6wx\" (UniqueName: \"kubernetes.io/projected/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-kube-api-access-qw6wx\") pod \"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db\" (UID: \"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db\") "
Jul 27 21:03:50.135134 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.134915    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "75cdcbf8-ef9c-4bfc-9fd2-e10e619507db" (UID: "75cdcbf8-ef9c-4bfc-9fd2-e10e619507db"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:03:50.135134 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.135072    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e442a593-a024-4e78-8220-2364b015fa7a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e442a593-a024-4e78-8220-2364b015fa7a" (UID: "e442a593-a024-4e78-8220-2364b015fa7a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:03:50.135134 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.135118    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:03:50.135315 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.135224    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da" (UID: "1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:03:50.136984 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.136955    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-kube-api-access-qw6wx" (OuterVolumeSpecName: "kube-api-access-qw6wx") pod "75cdcbf8-ef9c-4bfc-9fd2-e10e619507db" (UID: "75cdcbf8-ef9c-4bfc-9fd2-e10e619507db"). InnerVolumeSpecName "kube-api-access-qw6wx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:03:50.136984 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.136969    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e442a593-a024-4e78-8220-2364b015fa7a-kube-api-access-7vxl7" (OuterVolumeSpecName: "kube-api-access-7vxl7") pod "e442a593-a024-4e78-8220-2364b015fa7a" (UID: "e442a593-a024-4e78-8220-2364b015fa7a"). InnerVolumeSpecName "kube-api-access-7vxl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:03:50.137218 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.137200    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "75cdcbf8-ef9c-4bfc-9fd2-e10e619507db" (UID: "75cdcbf8-ef9c-4bfc-9fd2-e10e619507db"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:03:50.137259 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.137228    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da-kube-api-access-rr5nx" (OuterVolumeSpecName: "kube-api-access-rr5nx") pod "1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da" (UID: "1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da"). InnerVolumeSpecName "kube-api-access-rr5nx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:03:50.236176 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.236117    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:03:50.236176 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.236139    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vxl7\" (UniqueName: \"kubernetes.io/projected/e442a593-a024-4e78-8220-2364b015fa7a-kube-api-access-7vxl7\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:03:50.236176 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.236149    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qw6wx\" (UniqueName: \"kubernetes.io/projected/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db-kube-api-access-qw6wx\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:03:50.236176 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.236159    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:03:50.236176 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.236167    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rr5nx\" (UniqueName: \"kubernetes.io/projected/1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da-kube-api-access-rr5nx\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:03:50.236176 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.236175    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e442a593-a024-4e78-8220-2364b015fa7a-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:03:50.276587 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.276555    2562 generic.go:356] "Generic (PLEG): container finished" podID="1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da" containerID="5555dd931447f0225a16ef40cc1ed9002289a09b71f2d280f24669bcdf2d09a2" exitCode=0
Jul 27 21:03:50.276752 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.276643    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf"
Jul 27 21:03:50.276752 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.276682    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf" event={"ID":"1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da","Type":"ContainerDied","Data":"5555dd931447f0225a16ef40cc1ed9002289a09b71f2d280f24669bcdf2d09a2"}
Jul 27 21:03:50.276752 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.276738    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf" event={"ID":"1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da","Type":"ContainerDied","Data":"c9d25993fc8fdb0f6beee752fd549fa85bf061a3e7bdee940015f9896b9a4fc3"}
Jul 27 21:03:50.276954 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.276764    2562 scope.go:117] "RemoveContainer" containerID="5555dd931447f0225a16ef40cc1ed9002289a09b71f2d280f24669bcdf2d09a2"
Jul 27 21:03:50.278106 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.278086    2562 generic.go:356] "Generic (PLEG): container finished" podID="75cdcbf8-ef9c-4bfc-9fd2-e10e619507db" containerID="ff17bd2e0d3938ddac53b44c0dd2ef22422062c9f926a394287a2450afbdef3a" exitCode=0
Jul 27 21:03:50.278207 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.278155    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"
Jul 27 21:03:50.278207 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.278163    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6" event={"ID":"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db","Type":"ContainerDied","Data":"ff17bd2e0d3938ddac53b44c0dd2ef22422062c9f926a394287a2450afbdef3a"}
Jul 27 21:03:50.278333 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.278213    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6" event={"ID":"75cdcbf8-ef9c-4bfc-9fd2-e10e619507db","Type":"ContainerDied","Data":"d032eafd57b7a8fdb292192870bd813495205da1946084c688b15e71f4cacdf4"}
Jul 27 21:03:50.279662 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.279639    2562 generic.go:356] "Generic (PLEG): container finished" podID="e442a593-a024-4e78-8220-2364b015fa7a" containerID="7c691f964b9d097f514bb9fd35c93f6e2370bbf4c51c9b4ce28606001e6b3241" exitCode=0
Jul 27 21:03:50.279765 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.279698    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc"
Jul 27 21:03:50.279841 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.279703    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc" event={"ID":"e442a593-a024-4e78-8220-2364b015fa7a","Type":"ContainerDied","Data":"7c691f964b9d097f514bb9fd35c93f6e2370bbf4c51c9b4ce28606001e6b3241"}
Jul 27 21:03:50.279841 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.279808    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc" event={"ID":"e442a593-a024-4e78-8220-2364b015fa7a","Type":"ContainerDied","Data":"63b84a81ebf91234a6a8c59fb60bf55868233da1af776d45006f122dac95f744"}
Jul 27 21:03:50.286069 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.286056    2562 scope.go:117] "RemoveContainer" containerID="5555dd931447f0225a16ef40cc1ed9002289a09b71f2d280f24669bcdf2d09a2"
Jul 27 21:03:50.286339 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:03:50.286312    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5555dd931447f0225a16ef40cc1ed9002289a09b71f2d280f24669bcdf2d09a2\": container with ID starting with 5555dd931447f0225a16ef40cc1ed9002289a09b71f2d280f24669bcdf2d09a2 not found: ID does not exist" containerID="5555dd931447f0225a16ef40cc1ed9002289a09b71f2d280f24669bcdf2d09a2"
Jul 27 21:03:50.286425 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.286348    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5555dd931447f0225a16ef40cc1ed9002289a09b71f2d280f24669bcdf2d09a2"} err="failed to get container status \"5555dd931447f0225a16ef40cc1ed9002289a09b71f2d280f24669bcdf2d09a2\": rpc error: code = NotFound desc = could not find container \"5555dd931447f0225a16ef40cc1ed9002289a09b71f2d280f24669bcdf2d09a2\": container with ID starting with 5555dd931447f0225a16ef40cc1ed9002289a09b71f2d280f24669bcdf2d09a2 not found: ID does not exist"
Jul 27 21:03:50.286425 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.286371    2562 scope.go:117] "RemoveContainer" containerID="ff17bd2e0d3938ddac53b44c0dd2ef22422062c9f926a394287a2450afbdef3a"
Jul 27 21:03:50.295302 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.295285    2562 scope.go:117] "RemoveContainer" containerID="ff17bd2e0d3938ddac53b44c0dd2ef22422062c9f926a394287a2450afbdef3a"
Jul 27 21:03:50.295556 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:03:50.295537    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff17bd2e0d3938ddac53b44c0dd2ef22422062c9f926a394287a2450afbdef3a\": container with ID starting with ff17bd2e0d3938ddac53b44c0dd2ef22422062c9f926a394287a2450afbdef3a not found: ID does not exist" containerID="ff17bd2e0d3938ddac53b44c0dd2ef22422062c9f926a394287a2450afbdef3a"
Jul 27 21:03:50.295605 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.295562    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff17bd2e0d3938ddac53b44c0dd2ef22422062c9f926a394287a2450afbdef3a"} err="failed to get container status \"ff17bd2e0d3938ddac53b44c0dd2ef22422062c9f926a394287a2450afbdef3a\": rpc error: code = NotFound desc = could not find container \"ff17bd2e0d3938ddac53b44c0dd2ef22422062c9f926a394287a2450afbdef3a\": container with ID starting with ff17bd2e0d3938ddac53b44c0dd2ef22422062c9f926a394287a2450afbdef3a not found: ID does not exist"
Jul 27 21:03:50.295605 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.295577    2562 scope.go:117] "RemoveContainer" containerID="7c691f964b9d097f514bb9fd35c93f6e2370bbf4c51c9b4ce28606001e6b3241"
Jul 27 21:03:50.306101 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.306082    2562 scope.go:117] "RemoveContainer" containerID="7c691f964b9d097f514bb9fd35c93f6e2370bbf4c51c9b4ce28606001e6b3241"
Jul 27 21:03:50.306448 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:03:50.306427    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c691f964b9d097f514bb9fd35c93f6e2370bbf4c51c9b4ce28606001e6b3241\": container with ID starting with 7c691f964b9d097f514bb9fd35c93f6e2370bbf4c51c9b4ce28606001e6b3241 not found: ID does not exist" containerID="7c691f964b9d097f514bb9fd35c93f6e2370bbf4c51c9b4ce28606001e6b3241"
Jul 27 21:03:50.306528 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.306450    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c691f964b9d097f514bb9fd35c93f6e2370bbf4c51c9b4ce28606001e6b3241"} err="failed to get container status \"7c691f964b9d097f514bb9fd35c93f6e2370bbf4c51c9b4ce28606001e6b3241\": rpc error: code = NotFound desc = could not find container \"7c691f964b9d097f514bb9fd35c93f6e2370bbf4c51c9b4ce28606001e6b3241\": container with ID starting with 7c691f964b9d097f514bb9fd35c93f6e2370bbf4c51c9b4ce28606001e6b3241 not found: ID does not exist"
Jul 27 21:03:50.307330 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.307317    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf"]
Jul 27 21:03:50.309681 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.309663    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-df7343e0-975bd47b8-ljlqf"]
Jul 27 21:03:50.317940 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.317921    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"]
Jul 27 21:03:50.321677 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.321659    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df7343e0-fb54f4f9-n9qd6"]
Jul 27 21:03:50.331309 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.331284    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc"]
Jul 27 21:03:50.333289 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.333262    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-df7343e0-79ff56d9c6-ln9tc"]
Jul 27 21:03:50.870242 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.870206    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da" path="/var/lib/kubelet/pods/1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da/volumes"
Jul 27 21:03:50.870619 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.870606    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75cdcbf8-ef9c-4bfc-9fd2-e10e619507db" path="/var/lib/kubelet/pods/75cdcbf8-ef9c-4bfc-9fd2-e10e619507db/volumes"
Jul 27 21:03:50.870927 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:50.870914    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e442a593-a024-4e78-8220-2364b015fa7a" path="/var/lib/kubelet/pods/e442a593-a024-4e78-8220-2364b015fa7a/volumes"
Jul 27 21:03:58.532374 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.532333    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"]
Jul 27 21:03:58.532938 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.532919    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e442a593-a024-4e78-8220-2364b015fa7a" containerName="payload-pre-processing"
Jul 27 21:03:58.533036 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.532939    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e442a593-a024-4e78-8220-2364b015fa7a" containerName="payload-pre-processing"
Jul 27 21:03:58.533036 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.532956    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75cdcbf8-ef9c-4bfc-9fd2-e10e619507db" containerName="maas-api"
Jul 27 21:03:58.533036 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.532965    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="75cdcbf8-ef9c-4bfc-9fd2-e10e619507db" containerName="maas-api"
Jul 27 21:03:58.533036 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.532978    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da" containerName="payload-processing"
Jul 27 21:03:58.533036 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.532984    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da" containerName="payload-processing"
Jul 27 21:03:58.533305 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.533052    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e442a593-a024-4e78-8220-2364b015fa7a" containerName="payload-pre-processing"
Jul 27 21:03:58.533305 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.533059    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d3fd5e0-7ffb-47e3-ad6c-0ea53cd510da" containerName="payload-processing"
Jul 27 21:03:58.533305 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.533069    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="75cdcbf8-ef9c-4bfc-9fd2-e10e619507db" containerName="maas-api"
Jul 27 21:03:58.536563 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.536545    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"
Jul 27 21:03:58.538881 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.538857    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-544e36ef-serving-cert\""
Jul 27 21:03:58.546630 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.546606    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"]
Jul 27 21:03:58.608586 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.608554    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-openshift-service-ca\") pod \"maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt\" (UID: \"cc8acfe8-b05a-4015-84b2-a1563d9de3d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"
Jul 27 21:03:58.608763 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.608622    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79p6g\" (UniqueName: \"kubernetes.io/projected/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-kube-api-access-79p6g\") pod \"maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt\" (UID: \"cc8acfe8-b05a-4015-84b2-a1563d9de3d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"
Jul 27 21:03:58.608763 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.608705    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-maas-api-tls\") pod \"maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt\" (UID: \"cc8acfe8-b05a-4015-84b2-a1563d9de3d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"
Jul 27 21:03:58.709412 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.709378    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79p6g\" (UniqueName: \"kubernetes.io/projected/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-kube-api-access-79p6g\") pod \"maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt\" (UID: \"cc8acfe8-b05a-4015-84b2-a1563d9de3d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"
Jul 27 21:03:58.709617 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.709423    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-maas-api-tls\") pod \"maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt\" (UID: \"cc8acfe8-b05a-4015-84b2-a1563d9de3d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"
Jul 27 21:03:58.709617 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.709464    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-openshift-service-ca\") pod \"maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt\" (UID: \"cc8acfe8-b05a-4015-84b2-a1563d9de3d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"
Jul 27 21:03:58.709617 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:03:58.709587    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-serving-cert: secret "maas-api-e2e-derive-544e36ef-serving-cert" not found
Jul 27 21:03:58.709794 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:03:58.709652    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-maas-api-tls podName:cc8acfe8-b05a-4015-84b2-a1563d9de3d4 nodeName:}" failed. No retries permitted until 2026-07-27 21:03:59.209636657 +0000 UTC m=+1778.849853074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-maas-api-tls") pod "maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt" (UID: "cc8acfe8-b05a-4015-84b2-a1563d9de3d4") : secret "maas-api-e2e-derive-544e36ef-serving-cert" not found
Jul 27 21:03:58.710045 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.710028    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-openshift-service-ca\") pod \"maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt\" (UID: \"cc8acfe8-b05a-4015-84b2-a1563d9de3d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"
Jul 27 21:03:58.729603 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:58.729574    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79p6g\" (UniqueName: \"kubernetes.io/projected/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-kube-api-access-79p6g\") pod \"maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt\" (UID: \"cc8acfe8-b05a-4015-84b2-a1563d9de3d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"
Jul 27 21:03:59.215681 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.215646    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-maas-api-tls\") pod \"maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt\" (UID: \"cc8acfe8-b05a-4015-84b2-a1563d9de3d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"
Jul 27 21:03:59.218244 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.218220    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-maas-api-tls\") pod \"maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt\" (UID: \"cc8acfe8-b05a-4015-84b2-a1563d9de3d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"
Jul 27 21:03:59.360443 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.360411    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm"]
Jul 27 21:03:59.364169 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.364147    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm"
Jul 27 21:03:59.367596 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.367573    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-544e36ef\""
Jul 27 21:03:59.367727 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.367704    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-544e36ef-dockercfg-ccmcj\""
Jul 27 21:03:59.376670 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.376643    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k"]
Jul 27 21:03:59.380494 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.380475    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm"]
Jul 27 21:03:59.380586 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.380562    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k"
Jul 27 21:03:59.397024 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.397001    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k"]
Jul 27 21:03:59.417580 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.417551    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf70c17e-6f80-45d7-a130-58b0dc3e5759-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm\" (UID: \"cf70c17e-6f80-45d7-a130-58b0dc3e5759\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm"
Jul 27 21:03:59.417749 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.417660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbz7h\" (UniqueName: \"kubernetes.io/projected/cf70c17e-6f80-45d7-a130-58b0dc3e5759-kube-api-access-nbz7h\") pod \"payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm\" (UID: \"cf70c17e-6f80-45d7-a130-58b0dc3e5759\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm"
Jul 27 21:03:59.449519 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.449491    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"
Jul 27 21:03:59.518334 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.518292    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbz7h\" (UniqueName: \"kubernetes.io/projected/cf70c17e-6f80-45d7-a130-58b0dc3e5759-kube-api-access-nbz7h\") pod \"payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm\" (UID: \"cf70c17e-6f80-45d7-a130-58b0dc3e5759\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm"
Jul 27 21:03:59.518464 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.518355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3-plugins-config-volume\") pod \"payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k\" (UID: \"184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3\") " pod="openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k"
Jul 27 21:03:59.518464 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.518385    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9hnt\" (UniqueName: \"kubernetes.io/projected/184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3-kube-api-access-m9hnt\") pod \"payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k\" (UID: \"184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3\") " pod="openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k"
Jul 27 21:03:59.518464 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.518451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf70c17e-6f80-45d7-a130-58b0dc3e5759-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm\" (UID: \"cf70c17e-6f80-45d7-a130-58b0dc3e5759\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm"
Jul 27 21:03:59.519317 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.519295    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf70c17e-6f80-45d7-a130-58b0dc3e5759-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm\" (UID: \"cf70c17e-6f80-45d7-a130-58b0dc3e5759\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm"
Jul 27 21:03:59.528644 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.528627    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbz7h\" (UniqueName: \"kubernetes.io/projected/cf70c17e-6f80-45d7-a130-58b0dc3e5759-kube-api-access-nbz7h\") pod \"payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm\" (UID: \"cf70c17e-6f80-45d7-a130-58b0dc3e5759\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm"
Jul 27 21:03:59.619632 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.619599    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3-plugins-config-volume\") pod \"payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k\" (UID: \"184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3\") " pod="openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k"
Jul 27 21:03:59.619632 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.619632    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9hnt\" (UniqueName: \"kubernetes.io/projected/184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3-kube-api-access-m9hnt\") pod \"payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k\" (UID: \"184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3\") " pod="openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k"
Jul 27 21:03:59.620357 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.620338    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3-plugins-config-volume\") pod \"payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k\" (UID: \"184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3\") " pod="openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k"
Jul 27 21:03:59.628016 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.627993    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9hnt\" (UniqueName: \"kubernetes.io/projected/184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3-kube-api-access-m9hnt\") pod \"payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k\" (UID: \"184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3\") " pod="openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k"
Jul 27 21:03:59.675737 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.675706    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm"
Jul 27 21:03:59.692996 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.692973    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k"
Jul 27 21:03:59.802628 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.802597    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"]
Jul 27 21:03:59.805126 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:03:59.805075    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8acfe8_b05a_4015_84b2_a1563d9de3d4.slice/crio-36580667a21b7a9d0ef95e8f5ffefac9d8fab6707dc1adb64acfe5c5a1fa7e36 WatchSource:0}: Error finding container 36580667a21b7a9d0ef95e8f5ffefac9d8fab6707dc1adb64acfe5c5a1fa7e36: Status 404 returned error can't find the container with id 36580667a21b7a9d0ef95e8f5ffefac9d8fab6707dc1adb64acfe5c5a1fa7e36
Jul 27 21:03:59.825945 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.825918    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm"]
Jul 27 21:03:59.829400 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:03:59.829364    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf70c17e_6f80_45d7_a130_58b0dc3e5759.slice/crio-809f862d57968dec182b761d030b1790d5f0b59f3a05fa5b8b50771519e3f943 WatchSource:0}: Error finding container 809f862d57968dec182b761d030b1790d5f0b59f3a05fa5b8b50771519e3f943: Status 404 returned error can't find the container with id 809f862d57968dec182b761d030b1790d5f0b59f3a05fa5b8b50771519e3f943
Jul 27 21:03:59.854372 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:03:59.854347    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k"]
Jul 27 21:03:59.856769 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:03:59.856740    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184e7c4f_05f5_4d9f_8b03_3c07a6fe46d3.slice/crio-80995c90c2a520923557799cfa3aa23360910797b5356e754db7a7a86820ebfc WatchSource:0}: Error finding container 80995c90c2a520923557799cfa3aa23360910797b5356e754db7a7a86820ebfc: Status 404 returned error can't find the container with id 80995c90c2a520923557799cfa3aa23360910797b5356e754db7a7a86820ebfc
Jul 27 21:04:00.333567 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:00.333528    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm" event={"ID":"cf70c17e-6f80-45d7-a130-58b0dc3e5759","Type":"ContainerStarted","Data":"225489e2d04803a7211ef5688a424b5cd9c31fbb0483495c8bbdb9e06d879a15"}
Jul 27 21:04:00.333773 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:00.333581    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm" event={"ID":"cf70c17e-6f80-45d7-a130-58b0dc3e5759","Type":"ContainerStarted","Data":"809f862d57968dec182b761d030b1790d5f0b59f3a05fa5b8b50771519e3f943"}
Jul 27 21:04:00.333773 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:00.333645    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm"
Jul 27 21:04:00.335075 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:00.335051    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k" event={"ID":"184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3","Type":"ContainerStarted","Data":"384031c00ee9d389f9a7eb80137704a6b281228e2a2b9fb1473316085e323717"}
Jul 27 21:04:00.335200 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:00.335101    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k"
Jul 27 21:04:00.335200 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:00.335124    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k" event={"ID":"184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3","Type":"ContainerStarted","Data":"80995c90c2a520923557799cfa3aa23360910797b5356e754db7a7a86820ebfc"}
Jul 27 21:04:00.336127 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:00.336108    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt" event={"ID":"cc8acfe8-b05a-4015-84b2-a1563d9de3d4","Type":"ContainerStarted","Data":"36580667a21b7a9d0ef95e8f5ffefac9d8fab6707dc1adb64acfe5c5a1fa7e36"}
Jul 27 21:04:00.350604 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:00.350561    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm" podStartSLOduration=1.350544479 podStartE2EDuration="1.350544479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:03:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:00.349400331 +0000 UTC m=+1779.989616787" watchObservedRunningTime="2026-07-27 21:04:00.350544479 +0000 UTC m=+1779.990760923"
Jul 27 21:04:00.367807 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:00.367757    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k" podStartSLOduration=1.367740674 podStartE2EDuration="1.367740674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:03:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:00.364565379 +0000 UTC m=+1780.004781845" watchObservedRunningTime="2026-07-27 21:04:00.367740674 +0000 UTC m=+1780.007957115"
Jul 27 21:04:01.342634 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:01.342595    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt" event={"ID":"cc8acfe8-b05a-4015-84b2-a1563d9de3d4","Type":"ContainerStarted","Data":"718ae49125c2af74b87f60929916e9497c96946209102faab8b7ada450bfa1b0"}
Jul 27 21:04:01.343094 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:01.342780    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"
Jul 27 21:04:01.368238 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:01.368172    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt" podStartSLOduration=2.79239589 podStartE2EDuration="3.368157048s" totalImagesPullingTime="575.761158ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:01.367573897 +0000 UTC m=+1781.007790336" watchObservedRunningTime="2026-07-27 21:04:01.368157048 +0000 UTC m=+1781.008373486"
Jul 27 21:04:07.353066 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:07.353033    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"
Jul 27 21:04:11.344749 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:11.344721    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k"
Jul 27 21:04:11.345136 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:11.344786    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm"
Jul 27 21:04:20.921502 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:20.921460    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 21:04:20.924476 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:20.924450    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 21:04:20.926947 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:20.926921    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 21:04:20.929609 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:20.929585    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 21:04:20.934634 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:20.934614    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 21:04:20.937324 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:20.937307    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 21:04:33.761633 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:33.761602    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"]
Jul 27 21:04:33.762150 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:33.761820    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt" podUID="cc8acfe8-b05a-4015-84b2-a1563d9de3d4" containerName="maas-api" containerID="cri-o://718ae49125c2af74b87f60929916e9497c96946209102faab8b7ada450bfa1b0" gracePeriod=30
Jul 27 21:04:33.808495 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:33.808467    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k"]
Jul 27 21:04:33.808693 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:33.808669    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k" podUID="184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3" containerName="payload-processing" containerID="cri-o://384031c00ee9d389f9a7eb80137704a6b281228e2a2b9fb1473316085e323717" gracePeriod=30
Jul 27 21:04:33.813613 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:33.813576    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm"]
Jul 27 21:04:33.813883 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:33.813837    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm" podUID="cf70c17e-6f80-45d7-a130-58b0dc3e5759" containerName="payload-pre-processing" containerID="cri-o://225489e2d04803a7211ef5688a424b5cd9c31fbb0483495c8bbdb9e06d879a15" gracePeriod=30
Jul 27 21:04:34.065412 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.065386    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"
Jul 27 21:04:34.114748 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.114701    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm"
Jul 27 21:04:34.117505 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.117486    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k"
Jul 27 21:04:34.132402 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.132376    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-maas-api-tls\") pod \"cc8acfe8-b05a-4015-84b2-a1563d9de3d4\" (UID: \"cc8acfe8-b05a-4015-84b2-a1563d9de3d4\") "
Jul 27 21:04:34.132540 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.132507    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-openshift-service-ca\") pod \"cc8acfe8-b05a-4015-84b2-a1563d9de3d4\" (UID: \"cc8acfe8-b05a-4015-84b2-a1563d9de3d4\") "
Jul 27 21:04:34.132611 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.132556    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79p6g\" (UniqueName: \"kubernetes.io/projected/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-kube-api-access-79p6g\") pod \"cc8acfe8-b05a-4015-84b2-a1563d9de3d4\" (UID: \"cc8acfe8-b05a-4015-84b2-a1563d9de3d4\") "
Jul 27 21:04:34.133008 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.132899    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cc8acfe8-b05a-4015-84b2-a1563d9de3d4" (UID: "cc8acfe8-b05a-4015-84b2-a1563d9de3d4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:04:34.134948 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.134911    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cc8acfe8-b05a-4015-84b2-a1563d9de3d4" (UID: "cc8acfe8-b05a-4015-84b2-a1563d9de3d4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:04:34.135424 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.135387    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-kube-api-access-79p6g" (OuterVolumeSpecName: "kube-api-access-79p6g") pod "cc8acfe8-b05a-4015-84b2-a1563d9de3d4" (UID: "cc8acfe8-b05a-4015-84b2-a1563d9de3d4"). InnerVolumeSpecName "kube-api-access-79p6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:04:34.233276 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.233252    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9hnt\" (UniqueName: \"kubernetes.io/projected/184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3-kube-api-access-m9hnt\") pod \"184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3\" (UID: \"184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3\") "
Jul 27 21:04:34.233413 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.233341    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf70c17e-6f80-45d7-a130-58b0dc3e5759-plugins-config-volume\") pod \"cf70c17e-6f80-45d7-a130-58b0dc3e5759\" (UID: \"cf70c17e-6f80-45d7-a130-58b0dc3e5759\") "
Jul 27 21:04:34.233413 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.233359    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3-plugins-config-volume\") pod \"184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3\" (UID: \"184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3\") "
Jul 27 21:04:34.233413 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.233398    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbz7h\" (UniqueName: \"kubernetes.io/projected/cf70c17e-6f80-45d7-a130-58b0dc3e5759-kube-api-access-nbz7h\") pod \"cf70c17e-6f80-45d7-a130-58b0dc3e5759\" (UID: \"cf70c17e-6f80-45d7-a130-58b0dc3e5759\") "
Jul 27 21:04:34.233632 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.233612    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:04:34.233632 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.233631    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79p6g\" (UniqueName: \"kubernetes.io/projected/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-kube-api-access-79p6g\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:04:34.233780 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.233645    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc8acfe8-b05a-4015-84b2-a1563d9de3d4-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:04:34.233780 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.233729    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf70c17e-6f80-45d7-a130-58b0dc3e5759-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cf70c17e-6f80-45d7-a130-58b0dc3e5759" (UID: "cf70c17e-6f80-45d7-a130-58b0dc3e5759"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:04:34.233849 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.233818    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3" (UID: "184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:04:34.235433 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.235406    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf70c17e-6f80-45d7-a130-58b0dc3e5759-kube-api-access-nbz7h" (OuterVolumeSpecName: "kube-api-access-nbz7h") pod "cf70c17e-6f80-45d7-a130-58b0dc3e5759" (UID: "cf70c17e-6f80-45d7-a130-58b0dc3e5759"). InnerVolumeSpecName "kube-api-access-nbz7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:04:34.235546 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.235445    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3-kube-api-access-m9hnt" (OuterVolumeSpecName: "kube-api-access-m9hnt") pod "184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3" (UID: "184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3"). InnerVolumeSpecName "kube-api-access-m9hnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:04:34.334231 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.334206    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf70c17e-6f80-45d7-a130-58b0dc3e5759-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:04:34.334231 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.334230    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:04:34.334414 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.334240    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbz7h\" (UniqueName: \"kubernetes.io/projected/cf70c17e-6f80-45d7-a130-58b0dc3e5759-kube-api-access-nbz7h\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:04:34.334414 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.334249    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9hnt\" (UniqueName: \"kubernetes.io/projected/184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3-kube-api-access-m9hnt\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:04:34.505525 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.505465    2562 generic.go:356] "Generic (PLEG): container finished" podID="184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3" containerID="384031c00ee9d389f9a7eb80137704a6b281228e2a2b9fb1473316085e323717" exitCode=0
Jul 27 21:04:34.505706 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.505535    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k"
Jul 27 21:04:34.505706 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.505560    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k" event={"ID":"184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3","Type":"ContainerDied","Data":"384031c00ee9d389f9a7eb80137704a6b281228e2a2b9fb1473316085e323717"}
Jul 27 21:04:34.505706 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.505617    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k" event={"ID":"184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3","Type":"ContainerDied","Data":"80995c90c2a520923557799cfa3aa23360910797b5356e754db7a7a86820ebfc"}
Jul 27 21:04:34.505706 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.505647    2562 scope.go:117] "RemoveContainer" containerID="384031c00ee9d389f9a7eb80137704a6b281228e2a2b9fb1473316085e323717"
Jul 27 21:04:34.506830 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.506810    2562 generic.go:356] "Generic (PLEG): container finished" podID="cc8acfe8-b05a-4015-84b2-a1563d9de3d4" containerID="718ae49125c2af74b87f60929916e9497c96946209102faab8b7ada450bfa1b0" exitCode=0
Jul 27 21:04:34.506914 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.506855    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"
Jul 27 21:04:34.506970 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.506904    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt" event={"ID":"cc8acfe8-b05a-4015-84b2-a1563d9de3d4","Type":"ContainerDied","Data":"718ae49125c2af74b87f60929916e9497c96946209102faab8b7ada450bfa1b0"}
Jul 27 21:04:34.506970 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.506951    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt" event={"ID":"cc8acfe8-b05a-4015-84b2-a1563d9de3d4","Type":"ContainerDied","Data":"36580667a21b7a9d0ef95e8f5ffefac9d8fab6707dc1adb64acfe5c5a1fa7e36"}
Jul 27 21:04:34.508352 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.508321    2562 generic.go:356] "Generic (PLEG): container finished" podID="cf70c17e-6f80-45d7-a130-58b0dc3e5759" containerID="225489e2d04803a7211ef5688a424b5cd9c31fbb0483495c8bbdb9e06d879a15" exitCode=0
Jul 27 21:04:34.508352 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.508349    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm" event={"ID":"cf70c17e-6f80-45d7-a130-58b0dc3e5759","Type":"ContainerDied","Data":"225489e2d04803a7211ef5688a424b5cd9c31fbb0483495c8bbdb9e06d879a15"}
Jul 27 21:04:34.508495 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.508369    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm"
Jul 27 21:04:34.508495 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.508396    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm" event={"ID":"cf70c17e-6f80-45d7-a130-58b0dc3e5759","Type":"ContainerDied","Data":"809f862d57968dec182b761d030b1790d5f0b59f3a05fa5b8b50771519e3f943"}
Jul 27 21:04:34.516617 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.516603    2562 scope.go:117] "RemoveContainer" containerID="384031c00ee9d389f9a7eb80137704a6b281228e2a2b9fb1473316085e323717"
Jul 27 21:04:34.516878 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:04:34.516861    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"384031c00ee9d389f9a7eb80137704a6b281228e2a2b9fb1473316085e323717\": container with ID starting with 384031c00ee9d389f9a7eb80137704a6b281228e2a2b9fb1473316085e323717 not found: ID does not exist" containerID="384031c00ee9d389f9a7eb80137704a6b281228e2a2b9fb1473316085e323717"
Jul 27 21:04:34.516928 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.516886    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"384031c00ee9d389f9a7eb80137704a6b281228e2a2b9fb1473316085e323717"} err="failed to get container status \"384031c00ee9d389f9a7eb80137704a6b281228e2a2b9fb1473316085e323717\": rpc error: code = NotFound desc = could not find container \"384031c00ee9d389f9a7eb80137704a6b281228e2a2b9fb1473316085e323717\": container with ID starting with 384031c00ee9d389f9a7eb80137704a6b281228e2a2b9fb1473316085e323717 not found: ID does not exist"
Jul 27 21:04:34.516928 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.516902    2562 scope.go:117] "RemoveContainer" containerID="718ae49125c2af74b87f60929916e9497c96946209102faab8b7ada450bfa1b0"
Jul 27 21:04:34.524603 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.524589    2562 scope.go:117] "RemoveContainer" containerID="718ae49125c2af74b87f60929916e9497c96946209102faab8b7ada450bfa1b0"
Jul 27 21:04:34.524851 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:04:34.524834    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"718ae49125c2af74b87f60929916e9497c96946209102faab8b7ada450bfa1b0\": container with ID starting with 718ae49125c2af74b87f60929916e9497c96946209102faab8b7ada450bfa1b0 not found: ID does not exist" containerID="718ae49125c2af74b87f60929916e9497c96946209102faab8b7ada450bfa1b0"
Jul 27 21:04:34.524923 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.524859    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"718ae49125c2af74b87f60929916e9497c96946209102faab8b7ada450bfa1b0"} err="failed to get container status \"718ae49125c2af74b87f60929916e9497c96946209102faab8b7ada450bfa1b0\": rpc error: code = NotFound desc = could not find container \"718ae49125c2af74b87f60929916e9497c96946209102faab8b7ada450bfa1b0\": container with ID starting with 718ae49125c2af74b87f60929916e9497c96946209102faab8b7ada450bfa1b0 not found: ID does not exist"
Jul 27 21:04:34.524923 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.524879    2562 scope.go:117] "RemoveContainer" containerID="225489e2d04803a7211ef5688a424b5cd9c31fbb0483495c8bbdb9e06d879a15"
Jul 27 21:04:34.532363 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.532343    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k"]
Jul 27 21:04:34.532745 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.532728    2562 scope.go:117] "RemoveContainer" containerID="225489e2d04803a7211ef5688a424b5cd9c31fbb0483495c8bbdb9e06d879a15"
Jul 27 21:04:34.533000 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:04:34.532978    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"225489e2d04803a7211ef5688a424b5cd9c31fbb0483495c8bbdb9e06d879a15\": container with ID starting with 225489e2d04803a7211ef5688a424b5cd9c31fbb0483495c8bbdb9e06d879a15 not found: ID does not exist" containerID="225489e2d04803a7211ef5688a424b5cd9c31fbb0483495c8bbdb9e06d879a15"
Jul 27 21:04:34.533078 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.533003    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"225489e2d04803a7211ef5688a424b5cd9c31fbb0483495c8bbdb9e06d879a15"} err="failed to get container status \"225489e2d04803a7211ef5688a424b5cd9c31fbb0483495c8bbdb9e06d879a15\": rpc error: code = NotFound desc = could not find container \"225489e2d04803a7211ef5688a424b5cd9c31fbb0483495c8bbdb9e06d879a15\": container with ID starting with 225489e2d04803a7211ef5688a424b5cd9c31fbb0483495c8bbdb9e06d879a15 not found: ID does not exist"
Jul 27 21:04:34.535852 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.535831    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-544e36ef-57ff85765d-f6x7k"]
Jul 27 21:04:34.545140 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.545121    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"]
Jul 27 21:04:34.547372 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.547354    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-544e36ef-6c7b5459d4-tfkjt"]
Jul 27 21:04:34.555960 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.555934    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm"]
Jul 27 21:04:34.558134 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.558116    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-544e36ef-5fd5958684-rk9nm"]
Jul 27 21:04:34.869080 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.869040    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3" path="/var/lib/kubelet/pods/184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3/volumes"
Jul 27 21:04:34.869640 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.869618    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc8acfe8-b05a-4015-84b2-a1563d9de3d4" path="/var/lib/kubelet/pods/cc8acfe8-b05a-4015-84b2-a1563d9de3d4/volumes"
Jul 27 21:04:34.869995 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:04:34.869978    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf70c17e-6f80-45d7-a130-58b0dc3e5759" path="/var/lib/kubelet/pods/cf70c17e-6f80-45d7-a130-58b0dc3e5759/volumes"
Jul 27 21:06:20.214930 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.214835    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"]
Jul 27 21:06:20.215534 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.215304    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf70c17e-6f80-45d7-a130-58b0dc3e5759" containerName="payload-pre-processing"
Jul 27 21:06:20.215534 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.215319    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf70c17e-6f80-45d7-a130-58b0dc3e5759" containerName="payload-pre-processing"
Jul 27 21:06:20.215534 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.215331    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3" containerName="payload-processing"
Jul 27 21:06:20.215534 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.215336    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3" containerName="payload-processing"
Jul 27 21:06:20.215534 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.215346    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8acfe8-b05a-4015-84b2-a1563d9de3d4" containerName="maas-api"
Jul 27 21:06:20.215534 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.215352    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8acfe8-b05a-4015-84b2-a1563d9de3d4" containerName="maas-api"
Jul 27 21:06:20.215534 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.215421    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf70c17e-6f80-45d7-a130-58b0dc3e5759" containerName="payload-pre-processing"
Jul 27 21:06:20.215534 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.215428    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="184e7c4f-05f5-4d9f-8b03-3c07a6fe46d3" containerName="payload-processing"
Jul 27 21:06:20.215534 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.215435    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc8acfe8-b05a-4015-84b2-a1563d9de3d4" containerName="maas-api"
Jul 27 21:06:20.218618 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.218599    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"
Jul 27 21:06:20.221067 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.221044    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ded28f10-serving-cert\""
Jul 27 21:06:20.228448 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.228402    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"]
Jul 27 21:06:20.270648 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.270618    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59cb0c45-164e-418f-8ad0-9a76e16a1566-maas-api-tls\") pod \"maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd\" (UID: \"59cb0c45-164e-418f-8ad0-9a76e16a1566\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"
Jul 27 21:06:20.270811 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.270686    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59cb0c45-164e-418f-8ad0-9a76e16a1566-openshift-service-ca\") pod \"maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd\" (UID: \"59cb0c45-164e-418f-8ad0-9a76e16a1566\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"
Jul 27 21:06:20.270811 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.270717    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccglp\" (UniqueName: \"kubernetes.io/projected/59cb0c45-164e-418f-8ad0-9a76e16a1566-kube-api-access-ccglp\") pod \"maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd\" (UID: \"59cb0c45-164e-418f-8ad0-9a76e16a1566\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"
Jul 27 21:06:20.371558 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.371528    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59cb0c45-164e-418f-8ad0-9a76e16a1566-openshift-service-ca\") pod \"maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd\" (UID: \"59cb0c45-164e-418f-8ad0-9a76e16a1566\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"
Jul 27 21:06:20.371745 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.371575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccglp\" (UniqueName: \"kubernetes.io/projected/59cb0c45-164e-418f-8ad0-9a76e16a1566-kube-api-access-ccglp\") pod \"maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd\" (UID: \"59cb0c45-164e-418f-8ad0-9a76e16a1566\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"
Jul 27 21:06:20.371745 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.371643    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59cb0c45-164e-418f-8ad0-9a76e16a1566-maas-api-tls\") pod \"maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd\" (UID: \"59cb0c45-164e-418f-8ad0-9a76e16a1566\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"
Jul 27 21:06:20.372401 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.372367    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59cb0c45-164e-418f-8ad0-9a76e16a1566-openshift-service-ca\") pod \"maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd\" (UID: \"59cb0c45-164e-418f-8ad0-9a76e16a1566\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"
Jul 27 21:06:20.374009 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.373988    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59cb0c45-164e-418f-8ad0-9a76e16a1566-maas-api-tls\") pod \"maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd\" (UID: \"59cb0c45-164e-418f-8ad0-9a76e16a1566\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"
Jul 27 21:06:20.379471 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.379449    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccglp\" (UniqueName: \"kubernetes.io/projected/59cb0c45-164e-418f-8ad0-9a76e16a1566-kube-api-access-ccglp\") pod \"maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd\" (UID: \"59cb0c45-164e-418f-8ad0-9a76e16a1566\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"
Jul 27 21:06:20.531761 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.531682    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"
Jul 27 21:06:20.668506 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:20.668478    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"]
Jul 27 21:06:20.670299 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:06:20.670247    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59cb0c45_164e_418f_8ad0_9a76e16a1566.slice/crio-b3d006b51acf0defa95abbb5127ad6a264827e71c3b413c95feb530f78ceee2a WatchSource:0}: Error finding container b3d006b51acf0defa95abbb5127ad6a264827e71c3b413c95feb530f78ceee2a: Status 404 returned error can't find the container with id b3d006b51acf0defa95abbb5127ad6a264827e71c3b413c95feb530f78ceee2a
Jul 27 21:06:21.036771 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:21.036736    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd" event={"ID":"59cb0c45-164e-418f-8ad0-9a76e16a1566","Type":"ContainerStarted","Data":"b3d006b51acf0defa95abbb5127ad6a264827e71c3b413c95feb530f78ceee2a"}
Jul 27 21:06:21.220638 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:21.220601    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr"]
Jul 27 21:06:21.224679 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:21.224660    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr"
Jul 27 21:06:21.227216 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:21.227196    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-ded28f10-dockercfg-xftw9\""
Jul 27 21:06:21.227432 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:21.227414    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-ded28f10\""
Jul 27 21:06:21.239186 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:21.239156    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr"]
Jul 27 21:06:21.280804 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:21.280778    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0b7275b-f5e7-498c-84ec-817957a0c715-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr\" (UID: \"e0b7275b-f5e7-498c-84ec-817957a0c715\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr"
Jul 27 21:06:21.280922 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:21.280811    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzhjh\" (UniqueName: \"kubernetes.io/projected/e0b7275b-f5e7-498c-84ec-817957a0c715-kube-api-access-lzhjh\") pod \"payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr\" (UID: \"e0b7275b-f5e7-498c-84ec-817957a0c715\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr"
Jul 27 21:06:21.382091 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:21.382050    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0b7275b-f5e7-498c-84ec-817957a0c715-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr\" (UID: \"e0b7275b-f5e7-498c-84ec-817957a0c715\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr"
Jul 27 21:06:21.382259 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:21.382097    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzhjh\" (UniqueName: \"kubernetes.io/projected/e0b7275b-f5e7-498c-84ec-817957a0c715-kube-api-access-lzhjh\") pod \"payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr\" (UID: \"e0b7275b-f5e7-498c-84ec-817957a0c715\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr"
Jul 27 21:06:21.382854 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:21.382832    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0b7275b-f5e7-498c-84ec-817957a0c715-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr\" (UID: \"e0b7275b-f5e7-498c-84ec-817957a0c715\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr"
Jul 27 21:06:21.390068 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:21.390039    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzhjh\" (UniqueName: \"kubernetes.io/projected/e0b7275b-f5e7-498c-84ec-817957a0c715-kube-api-access-lzhjh\") pod \"payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr\" (UID: \"e0b7275b-f5e7-498c-84ec-817957a0c715\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr"
Jul 27 21:06:21.552605 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:21.552571    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr"
Jul 27 21:06:21.689509 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:21.689481    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr"]
Jul 27 21:06:21.691030 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:06:21.691004    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0b7275b_f5e7_498c_84ec_817957a0c715.slice/crio-4cd67d8857201d1238bbbe15000afbd6a377146a3bb5cdf4ef1b10ef1a80f95e WatchSource:0}: Error finding container 4cd67d8857201d1238bbbe15000afbd6a377146a3bb5cdf4ef1b10ef1a80f95e: Status 404 returned error can't find the container with id 4cd67d8857201d1238bbbe15000afbd6a377146a3bb5cdf4ef1b10ef1a80f95e
Jul 27 21:06:22.043170 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:22.043076    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr" event={"ID":"e0b7275b-f5e7-498c-84ec-817957a0c715","Type":"ContainerStarted","Data":"071770d3ddfed934d727dd45250164f908f0bfcd6373d1ed46c8565535e83ab0"}
Jul 27 21:06:22.043170 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:22.043144    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr"
Jul 27 21:06:22.043170 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:22.043169    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr" event={"ID":"e0b7275b-f5e7-498c-84ec-817957a0c715","Type":"ContainerStarted","Data":"4cd67d8857201d1238bbbe15000afbd6a377146a3bb5cdf4ef1b10ef1a80f95e"}
Jul 27 21:06:22.044788 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:22.044764    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd" event={"ID":"59cb0c45-164e-418f-8ad0-9a76e16a1566","Type":"ContainerStarted","Data":"06469c2e860af09a38e31bf5cc4f9fc0f13406863a6e508d560798a06aca2599"}
Jul 27 21:06:22.044898 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:22.044888    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"
Jul 27 21:06:22.060435 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:22.060393    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr" podStartSLOduration=1.060381108 podStartE2EDuration="1.060381108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:06:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:22.057608114 +0000 UTC m=+1921.697824550" watchObservedRunningTime="2026-07-27 21:06:22.060381108 +0000 UTC m=+1921.700597524"
Jul 27 21:06:22.073700 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:22.073652    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd" podStartSLOduration=1.536941601 podStartE2EDuration="2.073636066s" totalImagesPullingTime="536.694465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:06:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:22.072545948 +0000 UTC m=+1921.712762388" watchObservedRunningTime="2026-07-27 21:06:22.073636066 +0000 UTC m=+1921.713852505"
Jul 27 21:06:28.056868 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:28.056837    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"
Jul 27 21:06:33.052874 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:33.052835    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr" podUID="e0b7275b-f5e7-498c-84ec-817957a0c715" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.56:9004: connect: connection refused"
Jul 27 21:06:41.923583 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:41.923551    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"]
Jul 27 21:06:41.924040 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:41.923774    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd" podUID="59cb0c45-164e-418f-8ad0-9a76e16a1566" containerName="maas-api" containerID="cri-o://06469c2e860af09a38e31bf5cc4f9fc0f13406863a6e508d560798a06aca2599" gracePeriod=30
Jul 27 21:06:41.984185 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:41.983784    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr"]
Jul 27 21:06:41.984185 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:41.984029    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr" podUID="e0b7275b-f5e7-498c-84ec-817957a0c715" containerName="payload-pre-processing" containerID="cri-o://071770d3ddfed934d727dd45250164f908f0bfcd6373d1ed46c8565535e83ab0" gracePeriod=30
Jul 27 21:06:41.984832 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:41.984782    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr"
Jul 27 21:06:42.148078 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.148039    2562 generic.go:356] "Generic (PLEG): container finished" podID="59cb0c45-164e-418f-8ad0-9a76e16a1566" containerID="06469c2e860af09a38e31bf5cc4f9fc0f13406863a6e508d560798a06aca2599" exitCode=0
Jul 27 21:06:42.148219 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.148106    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd" event={"ID":"59cb0c45-164e-418f-8ad0-9a76e16a1566","Type":"ContainerDied","Data":"06469c2e860af09a38e31bf5cc4f9fc0f13406863a6e508d560798a06aca2599"}
Jul 27 21:06:42.149763 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.149737    2562 generic.go:356] "Generic (PLEG): container finished" podID="e0b7275b-f5e7-498c-84ec-817957a0c715" containerID="071770d3ddfed934d727dd45250164f908f0bfcd6373d1ed46c8565535e83ab0" exitCode=0
Jul 27 21:06:42.149876 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.149783    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr" event={"ID":"e0b7275b-f5e7-498c-84ec-817957a0c715","Type":"ContainerDied","Data":"071770d3ddfed934d727dd45250164f908f0bfcd6373d1ed46c8565535e83ab0"}
Jul 27 21:06:42.242106 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.242083    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"
Jul 27 21:06:42.267685 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.267662    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr"
Jul 27 21:06:42.366340 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.366308    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzhjh\" (UniqueName: \"kubernetes.io/projected/e0b7275b-f5e7-498c-84ec-817957a0c715-kube-api-access-lzhjh\") pod \"e0b7275b-f5e7-498c-84ec-817957a0c715\" (UID: \"e0b7275b-f5e7-498c-84ec-817957a0c715\") "
Jul 27 21:06:42.366519 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.366436    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0b7275b-f5e7-498c-84ec-817957a0c715-plugins-config-volume\") pod \"e0b7275b-f5e7-498c-84ec-817957a0c715\" (UID: \"e0b7275b-f5e7-498c-84ec-817957a0c715\") "
Jul 27 21:06:42.366519 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.366472    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccglp\" (UniqueName: \"kubernetes.io/projected/59cb0c45-164e-418f-8ad0-9a76e16a1566-kube-api-access-ccglp\") pod \"59cb0c45-164e-418f-8ad0-9a76e16a1566\" (UID: \"59cb0c45-164e-418f-8ad0-9a76e16a1566\") "
Jul 27 21:06:42.366519 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.366502    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59cb0c45-164e-418f-8ad0-9a76e16a1566-openshift-service-ca\") pod \"59cb0c45-164e-418f-8ad0-9a76e16a1566\" (UID: \"59cb0c45-164e-418f-8ad0-9a76e16a1566\") "
Jul 27 21:06:42.366687 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.366559    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59cb0c45-164e-418f-8ad0-9a76e16a1566-maas-api-tls\") pod \"59cb0c45-164e-418f-8ad0-9a76e16a1566\" (UID: \"59cb0c45-164e-418f-8ad0-9a76e16a1566\") "
Jul 27 21:06:42.366880 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.366857    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0b7275b-f5e7-498c-84ec-817957a0c715-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e0b7275b-f5e7-498c-84ec-817957a0c715" (UID: "e0b7275b-f5e7-498c-84ec-817957a0c715"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:06:42.366958 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.366895    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59cb0c45-164e-418f-8ad0-9a76e16a1566-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "59cb0c45-164e-418f-8ad0-9a76e16a1566" (UID: "59cb0c45-164e-418f-8ad0-9a76e16a1566"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:06:42.368431 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.368408    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0b7275b-f5e7-498c-84ec-817957a0c715-kube-api-access-lzhjh" (OuterVolumeSpecName: "kube-api-access-lzhjh") pod "e0b7275b-f5e7-498c-84ec-817957a0c715" (UID: "e0b7275b-f5e7-498c-84ec-817957a0c715"). InnerVolumeSpecName "kube-api-access-lzhjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:06:42.368536 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.368466    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59cb0c45-164e-418f-8ad0-9a76e16a1566-kube-api-access-ccglp" (OuterVolumeSpecName: "kube-api-access-ccglp") pod "59cb0c45-164e-418f-8ad0-9a76e16a1566" (UID: "59cb0c45-164e-418f-8ad0-9a76e16a1566"). InnerVolumeSpecName "kube-api-access-ccglp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:06:42.368536 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.368509    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59cb0c45-164e-418f-8ad0-9a76e16a1566-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "59cb0c45-164e-418f-8ad0-9a76e16a1566" (UID: "59cb0c45-164e-418f-8ad0-9a76e16a1566"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:06:42.468009 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.467939    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0b7275b-f5e7-498c-84ec-817957a0c715-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:06:42.468009 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.467965    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccglp\" (UniqueName: \"kubernetes.io/projected/59cb0c45-164e-418f-8ad0-9a76e16a1566-kube-api-access-ccglp\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:06:42.468009 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.467975    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59cb0c45-164e-418f-8ad0-9a76e16a1566-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:06:42.468009 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.467984    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59cb0c45-164e-418f-8ad0-9a76e16a1566-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:06:42.468009 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:42.467993    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzhjh\" (UniqueName: \"kubernetes.io/projected/e0b7275b-f5e7-498c-84ec-817957a0c715-kube-api-access-lzhjh\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:06:43.156040 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:43.155955    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr"
Jul 27 21:06:43.156040 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:43.155992    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr" event={"ID":"e0b7275b-f5e7-498c-84ec-817957a0c715","Type":"ContainerDied","Data":"4cd67d8857201d1238bbbe15000afbd6a377146a3bb5cdf4ef1b10ef1a80f95e"}
Jul 27 21:06:43.156567 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:43.156054    2562 scope.go:117] "RemoveContainer" containerID="071770d3ddfed934d727dd45250164f908f0bfcd6373d1ed46c8565535e83ab0"
Jul 27 21:06:43.157495 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:43.157479    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"
Jul 27 21:06:43.157617 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:43.157492    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd" event={"ID":"59cb0c45-164e-418f-8ad0-9a76e16a1566","Type":"ContainerDied","Data":"b3d006b51acf0defa95abbb5127ad6a264827e71c3b413c95feb530f78ceee2a"}
Jul 27 21:06:43.174161 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:43.174138    2562 scope.go:117] "RemoveContainer" containerID="06469c2e860af09a38e31bf5cc4f9fc0f13406863a6e508d560798a06aca2599"
Jul 27 21:06:43.177380 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:43.177357    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr"]
Jul 27 21:06:43.184433 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:43.184415    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ded28f10-686658b996-94mfr"]
Jul 27 21:06:43.192655 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:43.192635    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"]
Jul 27 21:06:43.194741 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:43.194721    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ded28f10-6d79b9dcf6-tt7wd"]
Jul 27 21:06:44.870941 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:44.870903    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59cb0c45-164e-418f-8ad0-9a76e16a1566" path="/var/lib/kubelet/pods/59cb0c45-164e-418f-8ad0-9a76e16a1566/volumes"
Jul 27 21:06:44.871479 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:06:44.871456    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0b7275b-f5e7-498c-84ec-817957a0c715" path="/var/lib/kubelet/pods/e0b7275b-f5e7-498c-84ec-817957a0c715/volumes"
Jul 27 21:07:16.213815 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.213727    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"]
Jul 27 21:07:16.214395 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.214156    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59cb0c45-164e-418f-8ad0-9a76e16a1566" containerName="maas-api"
Jul 27 21:07:16.214395 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.214169    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="59cb0c45-164e-418f-8ad0-9a76e16a1566" containerName="maas-api"
Jul 27 21:07:16.214395 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.214180    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0b7275b-f5e7-498c-84ec-817957a0c715" containerName="payload-pre-processing"
Jul 27 21:07:16.214395 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.214185    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0b7275b-f5e7-498c-84ec-817957a0c715" containerName="payload-pre-processing"
Jul 27 21:07:16.214395 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.214254    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0b7275b-f5e7-498c-84ec-817957a0c715" containerName="payload-pre-processing"
Jul 27 21:07:16.214395 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.214263    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="59cb0c45-164e-418f-8ad0-9a76e16a1566" containerName="maas-api"
Jul 27 21:07:16.217385 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.217365    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"
Jul 27 21:07:16.219575 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.219555    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-9d99757d-serving-cert\""
Jul 27 21:07:16.225895 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.225865    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"]
Jul 27 21:07:16.360217 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.360179    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57c53570-ce29-4a71-9c9e-9465e05a77f1-maas-api-tls\") pod \"maas-api-e2e-mt-9d99757d-5b4945b974-xh46r\" (UID: \"57c53570-ce29-4a71-9c9e-9465e05a77f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"
Jul 27 21:07:16.360434 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.360229    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57c53570-ce29-4a71-9c9e-9465e05a77f1-openshift-service-ca\") pod \"maas-api-e2e-mt-9d99757d-5b4945b974-xh46r\" (UID: \"57c53570-ce29-4a71-9c9e-9465e05a77f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"
Jul 27 21:07:16.360434 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.360323    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpzq2\" (UniqueName: \"kubernetes.io/projected/57c53570-ce29-4a71-9c9e-9465e05a77f1-kube-api-access-dpzq2\") pod \"maas-api-e2e-mt-9d99757d-5b4945b974-xh46r\" (UID: \"57c53570-ce29-4a71-9c9e-9465e05a77f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"
Jul 27 21:07:16.460871 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.460843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57c53570-ce29-4a71-9c9e-9465e05a77f1-openshift-service-ca\") pod \"maas-api-e2e-mt-9d99757d-5b4945b974-xh46r\" (UID: \"57c53570-ce29-4a71-9c9e-9465e05a77f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"
Jul 27 21:07:16.461044 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.460890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpzq2\" (UniqueName: \"kubernetes.io/projected/57c53570-ce29-4a71-9c9e-9465e05a77f1-kube-api-access-dpzq2\") pod \"maas-api-e2e-mt-9d99757d-5b4945b974-xh46r\" (UID: \"57c53570-ce29-4a71-9c9e-9465e05a77f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"
Jul 27 21:07:16.461044 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.460949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57c53570-ce29-4a71-9c9e-9465e05a77f1-maas-api-tls\") pod \"maas-api-e2e-mt-9d99757d-5b4945b974-xh46r\" (UID: \"57c53570-ce29-4a71-9c9e-9465e05a77f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"
Jul 27 21:07:16.461649 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.461629    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57c53570-ce29-4a71-9c9e-9465e05a77f1-openshift-service-ca\") pod \"maas-api-e2e-mt-9d99757d-5b4945b974-xh46r\" (UID: \"57c53570-ce29-4a71-9c9e-9465e05a77f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"
Jul 27 21:07:16.463485 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.463463    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57c53570-ce29-4a71-9c9e-9465e05a77f1-maas-api-tls\") pod \"maas-api-e2e-mt-9d99757d-5b4945b974-xh46r\" (UID: \"57c53570-ce29-4a71-9c9e-9465e05a77f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"
Jul 27 21:07:16.468886 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.468828    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpzq2\" (UniqueName: \"kubernetes.io/projected/57c53570-ce29-4a71-9c9e-9465e05a77f1-kube-api-access-dpzq2\") pod \"maas-api-e2e-mt-9d99757d-5b4945b974-xh46r\" (UID: \"57c53570-ce29-4a71-9c9e-9465e05a77f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"
Jul 27 21:07:16.529516 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.529485    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"
Jul 27 21:07:16.668533 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.668507    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"]
Jul 27 21:07:16.670575 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:07:16.670542    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c53570_ce29_4a71_9c9e_9465e05a77f1.slice/crio-349eb6e2a572b8cf3f863c020bfc6dbec06006f01b49453fbe2977b98bb9c594 WatchSource:0}: Error finding container 349eb6e2a572b8cf3f863c020bfc6dbec06006f01b49453fbe2977b98bb9c594: Status 404 returned error can't find the container with id 349eb6e2a572b8cf3f863c020bfc6dbec06006f01b49453fbe2977b98bb9c594
Jul 27 21:07:16.672186 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.672164    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:07:16.886804 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.886775    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn"]
Jul 27 21:07:16.891457 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.891437    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn"
Jul 27 21:07:16.893679 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.893660    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-9d99757d\""
Jul 27 21:07:16.903710 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.903687    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn"]
Jul 27 21:07:16.965980 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.965949    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5wxw\" (UniqueName: \"kubernetes.io/projected/987dbefa-22c8-4939-86f0-fcddced49452-kube-api-access-l5wxw\") pod \"payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn\" (UID: \"987dbefa-22c8-4939-86f0-fcddced49452\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn"
Jul 27 21:07:16.966137 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:16.966101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/987dbefa-22c8-4939-86f0-fcddced49452-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn\" (UID: \"987dbefa-22c8-4939-86f0-fcddced49452\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn"
Jul 27 21:07:17.066493 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:17.066469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5wxw\" (UniqueName: \"kubernetes.io/projected/987dbefa-22c8-4939-86f0-fcddced49452-kube-api-access-l5wxw\") pod \"payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn\" (UID: \"987dbefa-22c8-4939-86f0-fcddced49452\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn"
Jul 27 21:07:17.066600 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:17.066565    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/987dbefa-22c8-4939-86f0-fcddced49452-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn\" (UID: \"987dbefa-22c8-4939-86f0-fcddced49452\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn"
Jul 27 21:07:17.067231 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:17.067207    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/987dbefa-22c8-4939-86f0-fcddced49452-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn\" (UID: \"987dbefa-22c8-4939-86f0-fcddced49452\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn"
Jul 27 21:07:17.075651 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:17.075628    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5wxw\" (UniqueName: \"kubernetes.io/projected/987dbefa-22c8-4939-86f0-fcddced49452-kube-api-access-l5wxw\") pod \"payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn\" (UID: \"987dbefa-22c8-4939-86f0-fcddced49452\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn"
Jul 27 21:07:17.202910 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:17.202842    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn"
Jul 27 21:07:17.329583 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:17.329542    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r" event={"ID":"57c53570-ce29-4a71-9c9e-9465e05a77f1","Type":"ContainerStarted","Data":"93bc86a64a069e4318c0abad70c1ad31f737dfb1affe28c064c4d0a4148338f9"}
Jul 27 21:07:17.329980 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:17.329613    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r" event={"ID":"57c53570-ce29-4a71-9c9e-9465e05a77f1","Type":"ContainerStarted","Data":"349eb6e2a572b8cf3f863c020bfc6dbec06006f01b49453fbe2977b98bb9c594"}
Jul 27 21:07:17.329980 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:17.329670    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"
Jul 27 21:07:17.372127 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:17.372081    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r" podStartSLOduration=0.981289452 podStartE2EDuration="1.372065544s" totalImagesPullingTime="390.776092ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:17.371311301 +0000 UTC m=+1977.011527760" watchObservedRunningTime="2026-07-27 21:07:17.372065544 +0000 UTC m=+1977.012282024"
Jul 27 21:07:17.426201 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:17.426175    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn"]
Jul 27 21:07:17.427028 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:07:17.426999    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod987dbefa_22c8_4939_86f0_fcddced49452.slice/crio-da2a36a731cc91847907af4f3806dfb923337b428daebce19ad75412bcf81df0 WatchSource:0}: Error finding container da2a36a731cc91847907af4f3806dfb923337b428daebce19ad75412bcf81df0: Status 404 returned error can't find the container with id da2a36a731cc91847907af4f3806dfb923337b428daebce19ad75412bcf81df0
Jul 27 21:07:18.336037 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:18.336004    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn" event={"ID":"987dbefa-22c8-4939-86f0-fcddced49452","Type":"ContainerStarted","Data":"b818e0648c390995bf935a89e7d1e3563eb2f89e6ae0ab873324b4c3d7569024"}
Jul 27 21:07:18.336515 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:18.336058    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn" event={"ID":"987dbefa-22c8-4939-86f0-fcddced49452","Type":"ContainerStarted","Data":"da2a36a731cc91847907af4f3806dfb923337b428daebce19ad75412bcf81df0"}
Jul 27 21:07:18.336515 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:18.336287    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn"
Jul 27 21:07:18.355643 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:18.355603    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn" podStartSLOduration=2.3555881 podStartE2EDuration="2.3555881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:18.353379819 +0000 UTC m=+1977.993596258" watchObservedRunningTime="2026-07-27 21:07:18.3555881 +0000 UTC m=+1977.995804538"
Jul 27 21:07:23.342525 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:23.342497    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"
Jul 27 21:07:29.343845 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:07:29.343816    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn"
Jul 27 21:08:41.057304 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.057252    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"]
Jul 27 21:08:41.057950 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.057584    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r" podUID="57c53570-ce29-4a71-9c9e-9465e05a77f1" containerName="maas-api" containerID="cri-o://93bc86a64a069e4318c0abad70c1ad31f737dfb1affe28c064c4d0a4148338f9" gracePeriod=30
Jul 27 21:08:41.128067 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.128027    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn"]
Jul 27 21:08:41.128257 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.128232    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn" podUID="987dbefa-22c8-4939-86f0-fcddced49452" containerName="payload-pre-processing" containerID="cri-o://b818e0648c390995bf935a89e7d1e3563eb2f89e6ae0ab873324b4c3d7569024" gracePeriod=30
Jul 27 21:08:41.392358 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.392331    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"
Jul 27 21:08:41.414197 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.414172    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn"
Jul 27 21:08:41.500024 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.499994    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57c53570-ce29-4a71-9c9e-9465e05a77f1-maas-api-tls\") pod \"57c53570-ce29-4a71-9c9e-9465e05a77f1\" (UID: \"57c53570-ce29-4a71-9c9e-9465e05a77f1\") "
Jul 27 21:08:41.500210 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.500032    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57c53570-ce29-4a71-9c9e-9465e05a77f1-openshift-service-ca\") pod \"57c53570-ce29-4a71-9c9e-9465e05a77f1\" (UID: \"57c53570-ce29-4a71-9c9e-9465e05a77f1\") "
Jul 27 21:08:41.500210 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.500049    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5wxw\" (UniqueName: \"kubernetes.io/projected/987dbefa-22c8-4939-86f0-fcddced49452-kube-api-access-l5wxw\") pod \"987dbefa-22c8-4939-86f0-fcddced49452\" (UID: \"987dbefa-22c8-4939-86f0-fcddced49452\") "
Jul 27 21:08:41.500210 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.500064    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/987dbefa-22c8-4939-86f0-fcddced49452-plugins-config-volume\") pod \"987dbefa-22c8-4939-86f0-fcddced49452\" (UID: \"987dbefa-22c8-4939-86f0-fcddced49452\") "
Jul 27 21:08:41.500407 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.500208    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpzq2\" (UniqueName: \"kubernetes.io/projected/57c53570-ce29-4a71-9c9e-9465e05a77f1-kube-api-access-dpzq2\") pod \"57c53570-ce29-4a71-9c9e-9465e05a77f1\" (UID: \"57c53570-ce29-4a71-9c9e-9465e05a77f1\") "
Jul 27 21:08:41.500462 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.500414    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57c53570-ce29-4a71-9c9e-9465e05a77f1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "57c53570-ce29-4a71-9c9e-9465e05a77f1" (UID: "57c53570-ce29-4a71-9c9e-9465e05a77f1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:08:41.500531 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.500458    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/987dbefa-22c8-4939-86f0-fcddced49452-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "987dbefa-22c8-4939-86f0-fcddced49452" (UID: "987dbefa-22c8-4939-86f0-fcddced49452"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:08:41.500584 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.500539    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57c53570-ce29-4a71-9c9e-9465e05a77f1-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:08:41.500584 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.500551    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/987dbefa-22c8-4939-86f0-fcddced49452-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:08:41.502199 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.502174    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/987dbefa-22c8-4939-86f0-fcddced49452-kube-api-access-l5wxw" (OuterVolumeSpecName: "kube-api-access-l5wxw") pod "987dbefa-22c8-4939-86f0-fcddced49452" (UID: "987dbefa-22c8-4939-86f0-fcddced49452"). InnerVolumeSpecName "kube-api-access-l5wxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:08:41.502199 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.502192    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57c53570-ce29-4a71-9c9e-9465e05a77f1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "57c53570-ce29-4a71-9c9e-9465e05a77f1" (UID: "57c53570-ce29-4a71-9c9e-9465e05a77f1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:08:41.502338 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.502207    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57c53570-ce29-4a71-9c9e-9465e05a77f1-kube-api-access-dpzq2" (OuterVolumeSpecName: "kube-api-access-dpzq2") pod "57c53570-ce29-4a71-9c9e-9465e05a77f1" (UID: "57c53570-ce29-4a71-9c9e-9465e05a77f1"). InnerVolumeSpecName "kube-api-access-dpzq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:08:41.602009 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.601936    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57c53570-ce29-4a71-9c9e-9465e05a77f1-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:08:41.602009 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.601959    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5wxw\" (UniqueName: \"kubernetes.io/projected/987dbefa-22c8-4939-86f0-fcddced49452-kube-api-access-l5wxw\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:08:41.602009 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.601969    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpzq2\" (UniqueName: \"kubernetes.io/projected/57c53570-ce29-4a71-9c9e-9465e05a77f1-kube-api-access-dpzq2\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:08:41.749329 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.749294    2562 generic.go:356] "Generic (PLEG): container finished" podID="987dbefa-22c8-4939-86f0-fcddced49452" containerID="b818e0648c390995bf935a89e7d1e3563eb2f89e6ae0ab873324b4c3d7569024" exitCode=0
Jul 27 21:08:41.749498 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.749339    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn"
Jul 27 21:08:41.749498 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.749374    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn" event={"ID":"987dbefa-22c8-4939-86f0-fcddced49452","Type":"ContainerDied","Data":"b818e0648c390995bf935a89e7d1e3563eb2f89e6ae0ab873324b4c3d7569024"}
Jul 27 21:08:41.749498 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.749437    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn" event={"ID":"987dbefa-22c8-4939-86f0-fcddced49452","Type":"ContainerDied","Data":"da2a36a731cc91847907af4f3806dfb923337b428daebce19ad75412bcf81df0"}
Jul 27 21:08:41.749498 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.749468    2562 scope.go:117] "RemoveContainer" containerID="b818e0648c390995bf935a89e7d1e3563eb2f89e6ae0ab873324b4c3d7569024"
Jul 27 21:08:41.750741 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.750684    2562 generic.go:356] "Generic (PLEG): container finished" podID="57c53570-ce29-4a71-9c9e-9465e05a77f1" containerID="93bc86a64a069e4318c0abad70c1ad31f737dfb1affe28c064c4d0a4148338f9" exitCode=0
Jul 27 21:08:41.750823 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.750757    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"
Jul 27 21:08:41.750823 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.750757    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r" event={"ID":"57c53570-ce29-4a71-9c9e-9465e05a77f1","Type":"ContainerDied","Data":"93bc86a64a069e4318c0abad70c1ad31f737dfb1affe28c064c4d0a4148338f9"}
Jul 27 21:08:41.750823 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.750805    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r" event={"ID":"57c53570-ce29-4a71-9c9e-9465e05a77f1","Type":"ContainerDied","Data":"349eb6e2a572b8cf3f863c020bfc6dbec06006f01b49453fbe2977b98bb9c594"}
Jul 27 21:08:41.760727 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.760711    2562 scope.go:117] "RemoveContainer" containerID="b818e0648c390995bf935a89e7d1e3563eb2f89e6ae0ab873324b4c3d7569024"
Jul 27 21:08:41.761087 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:08:41.761062    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b818e0648c390995bf935a89e7d1e3563eb2f89e6ae0ab873324b4c3d7569024\": container with ID starting with b818e0648c390995bf935a89e7d1e3563eb2f89e6ae0ab873324b4c3d7569024 not found: ID does not exist" containerID="b818e0648c390995bf935a89e7d1e3563eb2f89e6ae0ab873324b4c3d7569024"
Jul 27 21:08:41.761172 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.761098    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b818e0648c390995bf935a89e7d1e3563eb2f89e6ae0ab873324b4c3d7569024"} err="failed to get container status \"b818e0648c390995bf935a89e7d1e3563eb2f89e6ae0ab873324b4c3d7569024\": rpc error: code = NotFound desc = could not find container \"b818e0648c390995bf935a89e7d1e3563eb2f89e6ae0ab873324b4c3d7569024\": container with ID starting with b818e0648c390995bf935a89e7d1e3563eb2f89e6ae0ab873324b4c3d7569024 not found: ID does not exist"
Jul 27 21:08:41.761172 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.761122    2562 scope.go:117] "RemoveContainer" containerID="93bc86a64a069e4318c0abad70c1ad31f737dfb1affe28c064c4d0a4148338f9"
Jul 27 21:08:41.772989 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.772965    2562 scope.go:117] "RemoveContainer" containerID="93bc86a64a069e4318c0abad70c1ad31f737dfb1affe28c064c4d0a4148338f9"
Jul 27 21:08:41.773333 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:08:41.773303    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93bc86a64a069e4318c0abad70c1ad31f737dfb1affe28c064c4d0a4148338f9\": container with ID starting with 93bc86a64a069e4318c0abad70c1ad31f737dfb1affe28c064c4d0a4148338f9 not found: ID does not exist" containerID="93bc86a64a069e4318c0abad70c1ad31f737dfb1affe28c064c4d0a4148338f9"
Jul 27 21:08:41.773455 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.773340    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93bc86a64a069e4318c0abad70c1ad31f737dfb1affe28c064c4d0a4148338f9"} err="failed to get container status \"93bc86a64a069e4318c0abad70c1ad31f737dfb1affe28c064c4d0a4148338f9\": rpc error: code = NotFound desc = could not find container \"93bc86a64a069e4318c0abad70c1ad31f737dfb1affe28c064c4d0a4148338f9\": container with ID starting with 93bc86a64a069e4318c0abad70c1ad31f737dfb1affe28c064c4d0a4148338f9 not found: ID does not exist"
Jul 27 21:08:41.773929 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.773901    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn"]
Jul 27 21:08:41.776320 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.776302    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9d99757d-5f8b5599c6-t64sn"]
Jul 27 21:08:41.786127 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.786103    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"]
Jul 27 21:08:41.789767 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:41.789750    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9d99757d-5b4945b974-xh46r"]
Jul 27 21:08:42.869556 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:42.869522    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57c53570-ce29-4a71-9c9e-9465e05a77f1" path="/var/lib/kubelet/pods/57c53570-ce29-4a71-9c9e-9465e05a77f1/volumes"
Jul 27 21:08:42.869932 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:08:42.869869    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="987dbefa-22c8-4939-86f0-fcddced49452" path="/var/lib/kubelet/pods/987dbefa-22c8-4939-86f0-fcddced49452/volumes"
Jul 27 21:09:20.948364 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:09:20.948329    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 21:09:20.952407 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:09:20.952382    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 21:09:20.954022 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:09:20.953999    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 21:09:20.957761 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:09:20.957741    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 21:09:20.962283 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:09:20.962250    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 21:09:20.966051 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:09:20.966033    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 21:10:36.418881 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.418847    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"]
Jul 27 21:10:36.419425 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.419252    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c53570-ce29-4a71-9c9e-9465e05a77f1" containerName="maas-api"
Jul 27 21:10:36.419425 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.419263    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c53570-ce29-4a71-9c9e-9465e05a77f1" containerName="maas-api"
Jul 27 21:10:36.419425 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.419290    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="987dbefa-22c8-4939-86f0-fcddced49452" containerName="payload-pre-processing"
Jul 27 21:10:36.419425 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.419296    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="987dbefa-22c8-4939-86f0-fcddced49452" containerName="payload-pre-processing"
Jul 27 21:10:36.419425 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.419358    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="57c53570-ce29-4a71-9c9e-9465e05a77f1" containerName="maas-api"
Jul 27 21:10:36.419425 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.419365    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="987dbefa-22c8-4939-86f0-fcddced49452" containerName="payload-pre-processing"
Jul 27 21:10:36.422670 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.422649    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"
Jul 27 21:10:36.424927 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.424908    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-00b3a2-serving-cert\""
Jul 27 21:10:36.434066 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.434045    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"]
Jul 27 21:10:36.503808 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.503778    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e04ce96-0c12-4646-ac7b-972f7ccbe67a-maas-api-tls\") pod \"maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2\" (UID: \"7e04ce96-0c12-4646-ac7b-972f7ccbe67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"
Jul 27 21:10:36.504011 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.503834    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sr64\" (UniqueName: \"kubernetes.io/projected/7e04ce96-0c12-4646-ac7b-972f7ccbe67a-kube-api-access-9sr64\") pod \"maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2\" (UID: \"7e04ce96-0c12-4646-ac7b-972f7ccbe67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"
Jul 27 21:10:36.504011 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.503857    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e04ce96-0c12-4646-ac7b-972f7ccbe67a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2\" (UID: \"7e04ce96-0c12-4646-ac7b-972f7ccbe67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"
Jul 27 21:10:36.604722 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.604687    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e04ce96-0c12-4646-ac7b-972f7ccbe67a-maas-api-tls\") pod \"maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2\" (UID: \"7e04ce96-0c12-4646-ac7b-972f7ccbe67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"
Jul 27 21:10:36.604891 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.604765    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sr64\" (UniqueName: \"kubernetes.io/projected/7e04ce96-0c12-4646-ac7b-972f7ccbe67a-kube-api-access-9sr64\") pod \"maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2\" (UID: \"7e04ce96-0c12-4646-ac7b-972f7ccbe67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"
Jul 27 21:10:36.604891 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.604795    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e04ce96-0c12-4646-ac7b-972f7ccbe67a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2\" (UID: \"7e04ce96-0c12-4646-ac7b-972f7ccbe67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"
Jul 27 21:10:36.605527 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.605508    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e04ce96-0c12-4646-ac7b-972f7ccbe67a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2\" (UID: \"7e04ce96-0c12-4646-ac7b-972f7ccbe67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"
Jul 27 21:10:36.607145 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.607125    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e04ce96-0c12-4646-ac7b-972f7ccbe67a-maas-api-tls\") pod \"maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2\" (UID: \"7e04ce96-0c12-4646-ac7b-972f7ccbe67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"
Jul 27 21:10:36.612698 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.612681    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sr64\" (UniqueName: \"kubernetes.io/projected/7e04ce96-0c12-4646-ac7b-972f7ccbe67a-kube-api-access-9sr64\") pod \"maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2\" (UID: \"7e04ce96-0c12-4646-ac7b-972f7ccbe67a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"
Jul 27 21:10:36.735431 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.735351    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"
Jul 27 21:10:36.896816 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:36.896786    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"]
Jul 27 21:10:36.898568 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:10:36.898528    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e04ce96_0c12_4646_ac7b_972f7ccbe67a.slice/crio-caa1ff6bb383443a506bbe73a83d9f3b7df05b5443ce142f6598d87250c32458 WatchSource:0}: Error finding container caa1ff6bb383443a506bbe73a83d9f3b7df05b5443ce142f6598d87250c32458: Status 404 returned error can't find the container with id caa1ff6bb383443a506bbe73a83d9f3b7df05b5443ce142f6598d87250c32458
Jul 27 21:10:37.033326 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:37.033223    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k"]
Jul 27 21:10:37.037836 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:37.037814    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k"
Jul 27 21:10:37.040473 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:37.040449    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-00b3a2\""
Jul 27 21:10:37.047058 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:37.047034    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k"]
Jul 27 21:10:37.108047 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:37.108016    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53717ca2-a32c-4ea5-9c9f-15dd0c630d17-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k\" (UID: \"53717ca2-a32c-4ea5-9c9f-15dd0c630d17\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k"
Jul 27 21:10:37.108226 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:37.108053    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hpjl\" (UniqueName: \"kubernetes.io/projected/53717ca2-a32c-4ea5-9c9f-15dd0c630d17-kube-api-access-2hpjl\") pod \"payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k\" (UID: \"53717ca2-a32c-4ea5-9c9f-15dd0c630d17\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k"
Jul 27 21:10:37.208760 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:37.208729    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53717ca2-a32c-4ea5-9c9f-15dd0c630d17-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k\" (UID: \"53717ca2-a32c-4ea5-9c9f-15dd0c630d17\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k"
Jul 27 21:10:37.208930 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:37.208767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hpjl\" (UniqueName: \"kubernetes.io/projected/53717ca2-a32c-4ea5-9c9f-15dd0c630d17-kube-api-access-2hpjl\") pod \"payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k\" (UID: \"53717ca2-a32c-4ea5-9c9f-15dd0c630d17\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k"
Jul 27 21:10:37.209494 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:37.209474    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53717ca2-a32c-4ea5-9c9f-15dd0c630d17-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k\" (UID: \"53717ca2-a32c-4ea5-9c9f-15dd0c630d17\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k"
Jul 27 21:10:37.216635 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:37.216609    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hpjl\" (UniqueName: \"kubernetes.io/projected/53717ca2-a32c-4ea5-9c9f-15dd0c630d17-kube-api-access-2hpjl\") pod \"payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k\" (UID: \"53717ca2-a32c-4ea5-9c9f-15dd0c630d17\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k"
Jul 27 21:10:37.307381 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:37.307286    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2" event={"ID":"7e04ce96-0c12-4646-ac7b-972f7ccbe67a","Type":"ContainerStarted","Data":"caa1ff6bb383443a506bbe73a83d9f3b7df05b5443ce142f6598d87250c32458"}
Jul 27 21:10:37.349873 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:37.349838    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k"
Jul 27 21:10:37.696490 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:37.696461    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k"]
Jul 27 21:10:37.697812 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:10:37.697780    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53717ca2_a32c_4ea5_9c9f_15dd0c630d17.slice/crio-0e43b70148ab1b03fb5939dc15ecd990e313571d5980436fc87bd8692e91765c WatchSource:0}: Error finding container 0e43b70148ab1b03fb5939dc15ecd990e313571d5980436fc87bd8692e91765c: Status 404 returned error can't find the container with id 0e43b70148ab1b03fb5939dc15ecd990e313571d5980436fc87bd8692e91765c
Jul 27 21:10:38.315078 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:38.315039    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2" event={"ID":"7e04ce96-0c12-4646-ac7b-972f7ccbe67a","Type":"ContainerStarted","Data":"cbef94d7b38bcbcf111f5f7fa4161a37843b13e1358c633a7d6c12010086a525"}
Jul 27 21:10:38.315299 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:38.315107    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"
Jul 27 21:10:38.316819 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:38.316789    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k" event={"ID":"53717ca2-a32c-4ea5-9c9f-15dd0c630d17","Type":"ContainerStarted","Data":"dc1a79a86d6e041ae235c6199bf3f3a88ae09f7fa4a4f646835831242393b184"}
Jul 27 21:10:38.316936 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:38.316835    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k"
Jul 27 21:10:38.316936 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:38.316853    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k" event={"ID":"53717ca2-a32c-4ea5-9c9f-15dd0c630d17","Type":"ContainerStarted","Data":"0e43b70148ab1b03fb5939dc15ecd990e313571d5980436fc87bd8692e91765c"}
Jul 27 21:10:38.333285 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:38.333229    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2" podStartSLOduration=1.813131249 podStartE2EDuration="2.333214854s" totalImagesPullingTime="520.083605ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:38.332030564 +0000 UTC m=+2177.972247003" watchObservedRunningTime="2026-07-27 21:10:38.333214854 +0000 UTC m=+2177.973431294"
Jul 27 21:10:38.353058 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:38.353013    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k" podStartSLOduration=1.352999923 podStartE2EDuration="1.352999923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:38.351390805 +0000 UTC m=+2177.991607271" watchObservedRunningTime="2026-07-27 21:10:38.352999923 +0000 UTC m=+2177.993216361"
Jul 27 21:10:44.327484 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:44.327456    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"
Jul 27 21:10:44.334158 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:44.334125    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"]
Jul 27 21:10:44.338037 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:44.338019    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"
Jul 27 21:10:44.340336 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:44.340318    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-c7d2ad-serving-cert\""
Jul 27 21:10:44.351357 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:44.350914    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"]
Jul 27 21:10:44.475222 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:44.475190    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b0c65f0-2602-4b27-8821-3435ed32aac5-maas-api-tls\") pod \"maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn\" (UID: \"4b0c65f0-2602-4b27-8821-3435ed32aac5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"
Jul 27 21:10:44.475405 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:44.475249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b0c65f0-2602-4b27-8821-3435ed32aac5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn\" (UID: \"4b0c65f0-2602-4b27-8821-3435ed32aac5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"
Jul 27 21:10:44.475462 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:44.475420    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqd5k\" (UniqueName: \"kubernetes.io/projected/4b0c65f0-2602-4b27-8821-3435ed32aac5-kube-api-access-jqd5k\") pod \"maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn\" (UID: \"4b0c65f0-2602-4b27-8821-3435ed32aac5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"
Jul 27 21:10:44.576078 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:44.576041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b0c65f0-2602-4b27-8821-3435ed32aac5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn\" (UID: \"4b0c65f0-2602-4b27-8821-3435ed32aac5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"
Jul 27 21:10:44.576283 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:44.576102    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqd5k\" (UniqueName: \"kubernetes.io/projected/4b0c65f0-2602-4b27-8821-3435ed32aac5-kube-api-access-jqd5k\") pod \"maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn\" (UID: \"4b0c65f0-2602-4b27-8821-3435ed32aac5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"
Jul 27 21:10:44.576283 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:44.576152    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b0c65f0-2602-4b27-8821-3435ed32aac5-maas-api-tls\") pod \"maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn\" (UID: \"4b0c65f0-2602-4b27-8821-3435ed32aac5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"
Jul 27 21:10:44.576283 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:10:44.576252    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-serving-cert: secret "maas-api-e2e-inf-b-c7d2ad-serving-cert" not found
Jul 27 21:10:44.576456 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:10:44.576326    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b0c65f0-2602-4b27-8821-3435ed32aac5-maas-api-tls podName:4b0c65f0-2602-4b27-8821-3435ed32aac5 nodeName:}" failed. No retries permitted until 2026-07-27 21:10:45.076309212 +0000 UTC m=+2184.716525630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4b0c65f0-2602-4b27-8821-3435ed32aac5-maas-api-tls") pod "maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn" (UID: "4b0c65f0-2602-4b27-8821-3435ed32aac5") : secret "maas-api-e2e-inf-b-c7d2ad-serving-cert" not found
Jul 27 21:10:44.576839 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:44.576811    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b0c65f0-2602-4b27-8821-3435ed32aac5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn\" (UID: \"4b0c65f0-2602-4b27-8821-3435ed32aac5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"
Jul 27 21:10:44.586914 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:44.586845    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqd5k\" (UniqueName: \"kubernetes.io/projected/4b0c65f0-2602-4b27-8821-3435ed32aac5-kube-api-access-jqd5k\") pod \"maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn\" (UID: \"4b0c65f0-2602-4b27-8821-3435ed32aac5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"
Jul 27 21:10:45.048682 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.048600    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8"]
Jul 27 21:10:45.052369 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.052347    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8"
Jul 27 21:10:45.055124 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.055100    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-c7d2ad-dockercfg-n5brm\""
Jul 27 21:10:45.055236 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.055100    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-c7d2ad\""
Jul 27 21:10:45.063312 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.063289    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8"]
Jul 27 21:10:45.079208 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.079187    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8"]
Jul 27 21:10:45.081066 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.081041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b0c65f0-2602-4b27-8821-3435ed32aac5-maas-api-tls\") pod \"maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn\" (UID: \"4b0c65f0-2602-4b27-8821-3435ed32aac5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"
Jul 27 21:10:45.083058 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.083037    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8"
Jul 27 21:10:45.083524 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.083502    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b0c65f0-2602-4b27-8821-3435ed32aac5-maas-api-tls\") pod \"maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn\" (UID: \"4b0c65f0-2602-4b27-8821-3435ed32aac5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"
Jul 27 21:10:45.094485 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.094283    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8"]
Jul 27 21:10:45.182655 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.182621    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a76b6d16-93a1-44f1-8bcc-6766c5014270-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8\" (UID: \"a76b6d16-93a1-44f1-8bcc-6766c5014270\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8"
Jul 27 21:10:45.182821 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.182663    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1278b131-dbae-4bef-823e-691042c77814-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8\" (UID: \"1278b131-dbae-4bef-823e-691042c77814\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8"
Jul 27 21:10:45.182821 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.182686    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2mjp\" (UniqueName: \"kubernetes.io/projected/a76b6d16-93a1-44f1-8bcc-6766c5014270-kube-api-access-q2mjp\") pod \"payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8\" (UID: \"a76b6d16-93a1-44f1-8bcc-6766c5014270\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8"
Jul 27 21:10:45.182821 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.182715    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rwrr\" (UniqueName: \"kubernetes.io/projected/1278b131-dbae-4bef-823e-691042c77814-kube-api-access-9rwrr\") pod \"payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8\" (UID: \"1278b131-dbae-4bef-823e-691042c77814\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8"
Jul 27 21:10:45.257828 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.257792    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"
Jul 27 21:10:45.284058 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.284026    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a76b6d16-93a1-44f1-8bcc-6766c5014270-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8\" (UID: \"a76b6d16-93a1-44f1-8bcc-6766c5014270\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8"
Jul 27 21:10:45.284225 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.284201    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1278b131-dbae-4bef-823e-691042c77814-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8\" (UID: \"1278b131-dbae-4bef-823e-691042c77814\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8"
Jul 27 21:10:45.284301 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.284249    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2mjp\" (UniqueName: \"kubernetes.io/projected/a76b6d16-93a1-44f1-8bcc-6766c5014270-kube-api-access-q2mjp\") pod \"payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8\" (UID: \"a76b6d16-93a1-44f1-8bcc-6766c5014270\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8"
Jul 27 21:10:45.284301 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.284295    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rwrr\" (UniqueName: \"kubernetes.io/projected/1278b131-dbae-4bef-823e-691042c77814-kube-api-access-9rwrr\") pod \"payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8\" (UID: \"1278b131-dbae-4bef-823e-691042c77814\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8"
Jul 27 21:10:45.284778 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.284753    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a76b6d16-93a1-44f1-8bcc-6766c5014270-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8\" (UID: \"a76b6d16-93a1-44f1-8bcc-6766c5014270\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8"
Jul 27 21:10:45.284920 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.284894    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1278b131-dbae-4bef-823e-691042c77814-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8\" (UID: \"1278b131-dbae-4bef-823e-691042c77814\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8"
Jul 27 21:10:45.292119 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.292097    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rwrr\" (UniqueName: \"kubernetes.io/projected/1278b131-dbae-4bef-823e-691042c77814-kube-api-access-9rwrr\") pod \"payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8\" (UID: \"1278b131-dbae-4bef-823e-691042c77814\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8"
Jul 27 21:10:45.292640 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.292619    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2mjp\" (UniqueName: \"kubernetes.io/projected/a76b6d16-93a1-44f1-8bcc-6766c5014270-kube-api-access-q2mjp\") pod \"payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8\" (UID: \"a76b6d16-93a1-44f1-8bcc-6766c5014270\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8"
Jul 27 21:10:45.364347 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.364316    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8"
Jul 27 21:10:45.403435 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.403231    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"]
Jul 27 21:10:45.403435 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.403389    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8"
Jul 27 21:10:45.406679 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:10:45.406649    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b0c65f0_2602_4b27_8821_3435ed32aac5.slice/crio-503e1990e3f8f097e1f5d1ac7b3649f822b8d1b089ba435154e6deeb469f52bb WatchSource:0}: Error finding container 503e1990e3f8f097e1f5d1ac7b3649f822b8d1b089ba435154e6deeb469f52bb: Status 404 returned error can't find the container with id 503e1990e3f8f097e1f5d1ac7b3649f822b8d1b089ba435154e6deeb469f52bb
Jul 27 21:10:45.518703 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.518668    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8"]
Jul 27 21:10:45.519878 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:10:45.519845    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1278b131_dbae_4bef_823e_691042c77814.slice/crio-7dc195f2ec7218954044366538c53410fd30c83b5819064cddc7490d28a75440 WatchSource:0}: Error finding container 7dc195f2ec7218954044366538c53410fd30c83b5819064cddc7490d28a75440: Status 404 returned error can't find the container with id 7dc195f2ec7218954044366538c53410fd30c83b5819064cddc7490d28a75440
Jul 27 21:10:45.562815 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:45.562789    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8"]
Jul 27 21:10:45.566475 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:10:45.566445    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda76b6d16_93a1_44f1_8bcc_6766c5014270.slice/crio-9004ecdc3111bcd0b3ea3866ec5a2b67db1b9a93435b6b12b06c5c7dbc4fa8cc WatchSource:0}: Error finding container 9004ecdc3111bcd0b3ea3866ec5a2b67db1b9a93435b6b12b06c5c7dbc4fa8cc: Status 404 returned error can't find the container with id 9004ecdc3111bcd0b3ea3866ec5a2b67db1b9a93435b6b12b06c5c7dbc4fa8cc
Jul 27 21:10:46.369925 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:46.369883    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8" event={"ID":"a76b6d16-93a1-44f1-8bcc-6766c5014270","Type":"ContainerStarted","Data":"90ae4d67a4426229e83470913c359cc2421c610b4ce3af7f24e5c411f2b05a57"}
Jul 27 21:10:46.370414 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:46.369949    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8"
Jul 27 21:10:46.370414 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:46.369973    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8" event={"ID":"a76b6d16-93a1-44f1-8bcc-6766c5014270","Type":"ContainerStarted","Data":"9004ecdc3111bcd0b3ea3866ec5a2b67db1b9a93435b6b12b06c5c7dbc4fa8cc"}
Jul 27 21:10:46.371422 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:46.371386    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8" event={"ID":"1278b131-dbae-4bef-823e-691042c77814","Type":"ContainerStarted","Data":"14fbaa5ae4766993945373ef852938b3e7463f868b1e421d7bca3abea0ffab4a"}
Jul 27 21:10:46.371585 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:46.371443    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8" event={"ID":"1278b131-dbae-4bef-823e-691042c77814","Type":"ContainerStarted","Data":"7dc195f2ec7218954044366538c53410fd30c83b5819064cddc7490d28a75440"}
Jul 27 21:10:46.371585 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:46.371472    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8"
Jul 27 21:10:46.372891 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:46.372868    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn" event={"ID":"4b0c65f0-2602-4b27-8821-3435ed32aac5","Type":"ContainerStarted","Data":"67d188c60fa11b714366957f320eae5463bd4652ff2ba29759396b453ccf1b80"}
Jul 27 21:10:46.373015 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:46.372906    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn" event={"ID":"4b0c65f0-2602-4b27-8821-3435ed32aac5","Type":"ContainerStarted","Data":"503e1990e3f8f097e1f5d1ac7b3649f822b8d1b089ba435154e6deeb469f52bb"}
Jul 27 21:10:46.373015 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:46.372934    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"
Jul 27 21:10:46.389737 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:46.389692    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8" podStartSLOduration=1.389678115 podStartE2EDuration="1.389678115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:46.389200287 +0000 UTC m=+2186.029416747" watchObservedRunningTime="2026-07-27 21:10:46.389678115 +0000 UTC m=+2186.029894559"
Jul 27 21:10:46.407530 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:46.407485    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn" podStartSLOduration=2.030921332 podStartE2EDuration="2.407471738s" totalImagesPullingTime="376.550406ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:46.406124588 +0000 UTC m=+2186.046341056" watchObservedRunningTime="2026-07-27 21:10:46.407471738 +0000 UTC m=+2186.047688177"
Jul 27 21:10:46.426539 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:46.426494    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8" podStartSLOduration=1.4264775109999999 podStartE2EDuration="1.426477511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:46.425943222 +0000 UTC m=+2186.066159663" watchObservedRunningTime="2026-07-27 21:10:46.426477511 +0000 UTC m=+2186.066693949"
Jul 27 21:10:49.323908 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:49.323875    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k"
Jul 27 21:10:52.384851 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:52.384821    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"
Jul 27 21:10:57.381356 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:57.381324    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8"
Jul 27 21:10:57.381758 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:10:57.381407    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8"
Jul 27 21:12:21.753216 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:21.753121    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"]
Jul 27 21:12:21.753816 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:21.753366    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2" podUID="7e04ce96-0c12-4646-ac7b-972f7ccbe67a" containerName="maas-api" containerID="cri-o://cbef94d7b38bcbcf111f5f7fa4161a37843b13e1358c633a7d6c12010086a525" gracePeriod=30
Jul 27 21:12:21.818650 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:21.818614    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k"]
Jul 27 21:12:21.818905 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:21.818872    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k" podUID="53717ca2-a32c-4ea5-9c9f-15dd0c630d17" containerName="payload-pre-processing" containerID="cri-o://dc1a79a86d6e041ae235c6199bf3f3a88ae09f7fa4a4f646835831242393b184" gracePeriod=30
Jul 27 21:12:22.107128 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.107105    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k"
Jul 27 21:12:22.222830 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.222803    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53717ca2-a32c-4ea5-9c9f-15dd0c630d17-plugins-config-volume\") pod \"53717ca2-a32c-4ea5-9c9f-15dd0c630d17\" (UID: \"53717ca2-a32c-4ea5-9c9f-15dd0c630d17\") "
Jul 27 21:12:22.222963 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.222843    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hpjl\" (UniqueName: \"kubernetes.io/projected/53717ca2-a32c-4ea5-9c9f-15dd0c630d17-kube-api-access-2hpjl\") pod \"53717ca2-a32c-4ea5-9c9f-15dd0c630d17\" (UID: \"53717ca2-a32c-4ea5-9c9f-15dd0c630d17\") "
Jul 27 21:12:22.223201 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.223177    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53717ca2-a32c-4ea5-9c9f-15dd0c630d17-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "53717ca2-a32c-4ea5-9c9f-15dd0c630d17" (UID: "53717ca2-a32c-4ea5-9c9f-15dd0c630d17"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:12:22.225204 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.225175    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53717ca2-a32c-4ea5-9c9f-15dd0c630d17-kube-api-access-2hpjl" (OuterVolumeSpecName: "kube-api-access-2hpjl") pod "53717ca2-a32c-4ea5-9c9f-15dd0c630d17" (UID: "53717ca2-a32c-4ea5-9c9f-15dd0c630d17"). InnerVolumeSpecName "kube-api-access-2hpjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:12:22.227152 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.227135    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"
Jul 27 21:12:22.323569 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.323536    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e04ce96-0c12-4646-ac7b-972f7ccbe67a-maas-api-tls\") pod \"7e04ce96-0c12-4646-ac7b-972f7ccbe67a\" (UID: \"7e04ce96-0c12-4646-ac7b-972f7ccbe67a\") "
Jul 27 21:12:22.323752 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.323642    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e04ce96-0c12-4646-ac7b-972f7ccbe67a-openshift-service-ca\") pod \"7e04ce96-0c12-4646-ac7b-972f7ccbe67a\" (UID: \"7e04ce96-0c12-4646-ac7b-972f7ccbe67a\") "
Jul 27 21:12:22.323752 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.323693    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sr64\" (UniqueName: \"kubernetes.io/projected/7e04ce96-0c12-4646-ac7b-972f7ccbe67a-kube-api-access-9sr64\") pod \"7e04ce96-0c12-4646-ac7b-972f7ccbe67a\" (UID: \"7e04ce96-0c12-4646-ac7b-972f7ccbe67a\") "
Jul 27 21:12:22.323962 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.323945    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53717ca2-a32c-4ea5-9c9f-15dd0c630d17-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:12:22.324044 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.323966    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hpjl\" (UniqueName: \"kubernetes.io/projected/53717ca2-a32c-4ea5-9c9f-15dd0c630d17-kube-api-access-2hpjl\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:12:22.324088 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.324057    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e04ce96-0c12-4646-ac7b-972f7ccbe67a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7e04ce96-0c12-4646-ac7b-972f7ccbe67a" (UID: "7e04ce96-0c12-4646-ac7b-972f7ccbe67a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:12:22.325708 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.325685    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e04ce96-0c12-4646-ac7b-972f7ccbe67a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7e04ce96-0c12-4646-ac7b-972f7ccbe67a" (UID: "7e04ce96-0c12-4646-ac7b-972f7ccbe67a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:12:22.325813 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.325735    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e04ce96-0c12-4646-ac7b-972f7ccbe67a-kube-api-access-9sr64" (OuterVolumeSpecName: "kube-api-access-9sr64") pod "7e04ce96-0c12-4646-ac7b-972f7ccbe67a" (UID: "7e04ce96-0c12-4646-ac7b-972f7ccbe67a"). InnerVolumeSpecName "kube-api-access-9sr64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:12:22.425286 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.425252    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e04ce96-0c12-4646-ac7b-972f7ccbe67a-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:12:22.425286 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.425285    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sr64\" (UniqueName: \"kubernetes.io/projected/7e04ce96-0c12-4646-ac7b-972f7ccbe67a-kube-api-access-9sr64\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:12:22.425495 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.425296    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e04ce96-0c12-4646-ac7b-972f7ccbe67a-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:12:22.858089 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.858051    2562 generic.go:356] "Generic (PLEG): container finished" podID="53717ca2-a32c-4ea5-9c9f-15dd0c630d17" containerID="dc1a79a86d6e041ae235c6199bf3f3a88ae09f7fa4a4f646835831242393b184" exitCode=0
Jul 27 21:12:22.858527 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.858096    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k"
Jul 27 21:12:22.858527 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.858090    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k" event={"ID":"53717ca2-a32c-4ea5-9c9f-15dd0c630d17","Type":"ContainerDied","Data":"dc1a79a86d6e041ae235c6199bf3f3a88ae09f7fa4a4f646835831242393b184"}
Jul 27 21:12:22.858527 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.858216    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k" event={"ID":"53717ca2-a32c-4ea5-9c9f-15dd0c630d17","Type":"ContainerDied","Data":"0e43b70148ab1b03fb5939dc15ecd990e313571d5980436fc87bd8692e91765c"}
Jul 27 21:12:22.858527 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.858249    2562 scope.go:117] "RemoveContainer" containerID="dc1a79a86d6e041ae235c6199bf3f3a88ae09f7fa4a4f646835831242393b184"
Jul 27 21:12:22.859686 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.859666    2562 generic.go:356] "Generic (PLEG): container finished" podID="7e04ce96-0c12-4646-ac7b-972f7ccbe67a" containerID="cbef94d7b38bcbcf111f5f7fa4161a37843b13e1358c633a7d6c12010086a525" exitCode=0
Jul 27 21:12:22.859792 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.859724    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"
Jul 27 21:12:22.859850 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.859724    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2" event={"ID":"7e04ce96-0c12-4646-ac7b-972f7ccbe67a","Type":"ContainerDied","Data":"cbef94d7b38bcbcf111f5f7fa4161a37843b13e1358c633a7d6c12010086a525"}
Jul 27 21:12:22.859899 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.859859    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2" event={"ID":"7e04ce96-0c12-4646-ac7b-972f7ccbe67a","Type":"ContainerDied","Data":"caa1ff6bb383443a506bbe73a83d9f3b7df05b5443ce142f6598d87250c32458"}
Jul 27 21:12:22.871067 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.871037    2562 scope.go:117] "RemoveContainer" containerID="dc1a79a86d6e041ae235c6199bf3f3a88ae09f7fa4a4f646835831242393b184"
Jul 27 21:12:22.871358 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:12:22.871337    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc1a79a86d6e041ae235c6199bf3f3a88ae09f7fa4a4f646835831242393b184\": container with ID starting with dc1a79a86d6e041ae235c6199bf3f3a88ae09f7fa4a4f646835831242393b184 not found: ID does not exist" containerID="dc1a79a86d6e041ae235c6199bf3f3a88ae09f7fa4a4f646835831242393b184"
Jul 27 21:12:22.871441 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.871371    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc1a79a86d6e041ae235c6199bf3f3a88ae09f7fa4a4f646835831242393b184"} err="failed to get container status \"dc1a79a86d6e041ae235c6199bf3f3a88ae09f7fa4a4f646835831242393b184\": rpc error: code = NotFound desc = could not find container \"dc1a79a86d6e041ae235c6199bf3f3a88ae09f7fa4a4f646835831242393b184\": container with ID starting with dc1a79a86d6e041ae235c6199bf3f3a88ae09f7fa4a4f646835831242393b184 not found: ID does not exist"
Jul 27 21:12:22.871441 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.871392    2562 scope.go:117] "RemoveContainer" containerID="cbef94d7b38bcbcf111f5f7fa4161a37843b13e1358c633a7d6c12010086a525"
Jul 27 21:12:22.879749 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.879732    2562 scope.go:117] "RemoveContainer" containerID="cbef94d7b38bcbcf111f5f7fa4161a37843b13e1358c633a7d6c12010086a525"
Jul 27 21:12:22.879984 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:12:22.879967    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbef94d7b38bcbcf111f5f7fa4161a37843b13e1358c633a7d6c12010086a525\": container with ID starting with cbef94d7b38bcbcf111f5f7fa4161a37843b13e1358c633a7d6c12010086a525 not found: ID does not exist" containerID="cbef94d7b38bcbcf111f5f7fa4161a37843b13e1358c633a7d6c12010086a525"
Jul 27 21:12:22.880020 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.879991    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbef94d7b38bcbcf111f5f7fa4161a37843b13e1358c633a7d6c12010086a525"} err="failed to get container status \"cbef94d7b38bcbcf111f5f7fa4161a37843b13e1358c633a7d6c12010086a525\": rpc error: code = NotFound desc = could not find container \"cbef94d7b38bcbcf111f5f7fa4161a37843b13e1358c633a7d6c12010086a525\": container with ID starting with cbef94d7b38bcbcf111f5f7fa4161a37843b13e1358c633a7d6c12010086a525 not found: ID does not exist"
Jul 27 21:12:22.885242 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.885223    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"]
Jul 27 21:12:22.888935 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.888914    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-00b3a2-5f5456446-92vc2"]
Jul 27 21:12:22.898508 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.898488    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k"]
Jul 27 21:12:22.900845 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:22.900827    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-00b3a2-5fc4fd8744-tzm7k"]
Jul 27 21:12:24.870124 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:24.870087    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53717ca2-a32c-4ea5-9c9f-15dd0c630d17" path="/var/lib/kubelet/pods/53717ca2-a32c-4ea5-9c9f-15dd0c630d17/volumes"
Jul 27 21:12:24.870740 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:24.870717    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e04ce96-0c12-4646-ac7b-972f7ccbe67a" path="/var/lib/kubelet/pods/7e04ce96-0c12-4646-ac7b-972f7ccbe67a/volumes"
Jul 27 21:12:44.490422 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.490386    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"]
Jul 27 21:12:44.490886 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.490644    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn" podUID="4b0c65f0-2602-4b27-8821-3435ed32aac5" containerName="maas-api" containerID="cri-o://67d188c60fa11b714366957f320eae5463bd4652ff2ba29759396b453ccf1b80" gracePeriod=30
Jul 27 21:12:44.557001 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.556965    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8"]
Jul 27 21:12:44.557262 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.557213    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8" podUID="a76b6d16-93a1-44f1-8bcc-6766c5014270" containerName="payload-processing" containerID="cri-o://90ae4d67a4426229e83470913c359cc2421c610b4ce3af7f24e5c411f2b05a57" gracePeriod=30
Jul 27 21:12:44.573631 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.573600    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8"]
Jul 27 21:12:44.581247 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.581199    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8" podUID="1278b131-dbae-4bef-823e-691042c77814" containerName="payload-pre-processing" containerID="cri-o://14fbaa5ae4766993945373ef852938b3e7463f868b1e421d7bca3abea0ffab4a" gracePeriod=30
Jul 27 21:12:44.814646 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.814618    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"
Jul 27 21:12:44.830198 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.830162    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b0c65f0-2602-4b27-8821-3435ed32aac5-maas-api-tls\") pod \"4b0c65f0-2602-4b27-8821-3435ed32aac5\" (UID: \"4b0c65f0-2602-4b27-8821-3435ed32aac5\") "
Jul 27 21:12:44.830389 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.830287    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b0c65f0-2602-4b27-8821-3435ed32aac5-openshift-service-ca\") pod \"4b0c65f0-2602-4b27-8821-3435ed32aac5\" (UID: \"4b0c65f0-2602-4b27-8821-3435ed32aac5\") "
Jul 27 21:12:44.830389 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.830341    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqd5k\" (UniqueName: \"kubernetes.io/projected/4b0c65f0-2602-4b27-8821-3435ed32aac5-kube-api-access-jqd5k\") pod \"4b0c65f0-2602-4b27-8821-3435ed32aac5\" (UID: \"4b0c65f0-2602-4b27-8821-3435ed32aac5\") "
Jul 27 21:12:44.830694 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.830660    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b0c65f0-2602-4b27-8821-3435ed32aac5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4b0c65f0-2602-4b27-8821-3435ed32aac5" (UID: "4b0c65f0-2602-4b27-8821-3435ed32aac5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:12:44.833464 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.833379    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b0c65f0-2602-4b27-8821-3435ed32aac5-kube-api-access-jqd5k" (OuterVolumeSpecName: "kube-api-access-jqd5k") pod "4b0c65f0-2602-4b27-8821-3435ed32aac5" (UID: "4b0c65f0-2602-4b27-8821-3435ed32aac5"). InnerVolumeSpecName "kube-api-access-jqd5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:12:44.835063 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.835021    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b0c65f0-2602-4b27-8821-3435ed32aac5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4b0c65f0-2602-4b27-8821-3435ed32aac5" (UID: "4b0c65f0-2602-4b27-8821-3435ed32aac5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:12:44.869207 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.869180    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8"
Jul 27 21:12:44.872537 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.872515    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8"
Jul 27 21:12:44.931091 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.931061    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a76b6d16-93a1-44f1-8bcc-6766c5014270-plugins-config-volume\") pod \"a76b6d16-93a1-44f1-8bcc-6766c5014270\" (UID: \"a76b6d16-93a1-44f1-8bcc-6766c5014270\") "
Jul 27 21:12:44.931257 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.931137    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2mjp\" (UniqueName: \"kubernetes.io/projected/a76b6d16-93a1-44f1-8bcc-6766c5014270-kube-api-access-q2mjp\") pod \"a76b6d16-93a1-44f1-8bcc-6766c5014270\" (UID: \"a76b6d16-93a1-44f1-8bcc-6766c5014270\") "
Jul 27 21:12:44.931257 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.931161    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rwrr\" (UniqueName: \"kubernetes.io/projected/1278b131-dbae-4bef-823e-691042c77814-kube-api-access-9rwrr\") pod \"1278b131-dbae-4bef-823e-691042c77814\" (UID: \"1278b131-dbae-4bef-823e-691042c77814\") "
Jul 27 21:12:44.931257 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.931196    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1278b131-dbae-4bef-823e-691042c77814-plugins-config-volume\") pod \"1278b131-dbae-4bef-823e-691042c77814\" (UID: \"1278b131-dbae-4bef-823e-691042c77814\") "
Jul 27 21:12:44.931527 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.931500    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b0c65f0-2602-4b27-8821-3435ed32aac5-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:12:44.931612 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.931526    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b0c65f0-2602-4b27-8821-3435ed32aac5-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:12:44.931612 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.931527    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a76b6d16-93a1-44f1-8bcc-6766c5014270-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a76b6d16-93a1-44f1-8bcc-6766c5014270" (UID: "a76b6d16-93a1-44f1-8bcc-6766c5014270"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:12:44.931612 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.931541    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqd5k\" (UniqueName: \"kubernetes.io/projected/4b0c65f0-2602-4b27-8821-3435ed32aac5-kube-api-access-jqd5k\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:12:44.931754 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.931626    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1278b131-dbae-4bef-823e-691042c77814-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1278b131-dbae-4bef-823e-691042c77814" (UID: "1278b131-dbae-4bef-823e-691042c77814"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:12:44.933752 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.933731    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a76b6d16-93a1-44f1-8bcc-6766c5014270-kube-api-access-q2mjp" (OuterVolumeSpecName: "kube-api-access-q2mjp") pod "a76b6d16-93a1-44f1-8bcc-6766c5014270" (UID: "a76b6d16-93a1-44f1-8bcc-6766c5014270"). InnerVolumeSpecName "kube-api-access-q2mjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:12:44.934081 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.934061    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1278b131-dbae-4bef-823e-691042c77814-kube-api-access-9rwrr" (OuterVolumeSpecName: "kube-api-access-9rwrr") pod "1278b131-dbae-4bef-823e-691042c77814" (UID: "1278b131-dbae-4bef-823e-691042c77814"). InnerVolumeSpecName "kube-api-access-9rwrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:12:44.969723 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.969692    2562 generic.go:356] "Generic (PLEG): container finished" podID="a76b6d16-93a1-44f1-8bcc-6766c5014270" containerID="90ae4d67a4426229e83470913c359cc2421c610b4ce3af7f24e5c411f2b05a57" exitCode=0
Jul 27 21:12:44.969847 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.969744    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8"
Jul 27 21:12:44.969847 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.969772    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8" event={"ID":"a76b6d16-93a1-44f1-8bcc-6766c5014270","Type":"ContainerDied","Data":"90ae4d67a4426229e83470913c359cc2421c610b4ce3af7f24e5c411f2b05a57"}
Jul 27 21:12:44.969847 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.969825    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8" event={"ID":"a76b6d16-93a1-44f1-8bcc-6766c5014270","Type":"ContainerDied","Data":"9004ecdc3111bcd0b3ea3866ec5a2b67db1b9a93435b6b12b06c5c7dbc4fa8cc"}
Jul 27 21:12:44.969996 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.969853    2562 scope.go:117] "RemoveContainer" containerID="90ae4d67a4426229e83470913c359cc2421c610b4ce3af7f24e5c411f2b05a57"
Jul 27 21:12:44.971132 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.971109    2562 generic.go:356] "Generic (PLEG): container finished" podID="1278b131-dbae-4bef-823e-691042c77814" containerID="14fbaa5ae4766993945373ef852938b3e7463f868b1e421d7bca3abea0ffab4a" exitCode=0
Jul 27 21:12:44.971234 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.971161    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8"
Jul 27 21:12:44.971234 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.971184    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8" event={"ID":"1278b131-dbae-4bef-823e-691042c77814","Type":"ContainerDied","Data":"14fbaa5ae4766993945373ef852938b3e7463f868b1e421d7bca3abea0ffab4a"}
Jul 27 21:12:44.971234 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.971224    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8" event={"ID":"1278b131-dbae-4bef-823e-691042c77814","Type":"ContainerDied","Data":"7dc195f2ec7218954044366538c53410fd30c83b5819064cddc7490d28a75440"}
Jul 27 21:12:44.972510 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.972488    2562 generic.go:356] "Generic (PLEG): container finished" podID="4b0c65f0-2602-4b27-8821-3435ed32aac5" containerID="67d188c60fa11b714366957f320eae5463bd4652ff2ba29759396b453ccf1b80" exitCode=0
Jul 27 21:12:44.972603 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.972531    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"
Jul 27 21:12:44.972603 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.972538    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn" event={"ID":"4b0c65f0-2602-4b27-8821-3435ed32aac5","Type":"ContainerDied","Data":"67d188c60fa11b714366957f320eae5463bd4652ff2ba29759396b453ccf1b80"}
Jul 27 21:12:44.972603 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.972571    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn" event={"ID":"4b0c65f0-2602-4b27-8821-3435ed32aac5","Type":"ContainerDied","Data":"503e1990e3f8f097e1f5d1ac7b3649f822b8d1b089ba435154e6deeb469f52bb"}
Jul 27 21:12:44.981011 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.980997    2562 scope.go:117] "RemoveContainer" containerID="90ae4d67a4426229e83470913c359cc2421c610b4ce3af7f24e5c411f2b05a57"
Jul 27 21:12:44.981255 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:12:44.981238    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90ae4d67a4426229e83470913c359cc2421c610b4ce3af7f24e5c411f2b05a57\": container with ID starting with 90ae4d67a4426229e83470913c359cc2421c610b4ce3af7f24e5c411f2b05a57 not found: ID does not exist" containerID="90ae4d67a4426229e83470913c359cc2421c610b4ce3af7f24e5c411f2b05a57"
Jul 27 21:12:44.981333 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.981259    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90ae4d67a4426229e83470913c359cc2421c610b4ce3af7f24e5c411f2b05a57"} err="failed to get container status \"90ae4d67a4426229e83470913c359cc2421c610b4ce3af7f24e5c411f2b05a57\": rpc error: code = NotFound desc = could not find container \"90ae4d67a4426229e83470913c359cc2421c610b4ce3af7f24e5c411f2b05a57\": container with ID starting with 90ae4d67a4426229e83470913c359cc2421c610b4ce3af7f24e5c411f2b05a57 not found: ID does not exist"
Jul 27 21:12:44.981333 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.981304    2562 scope.go:117] "RemoveContainer" containerID="14fbaa5ae4766993945373ef852938b3e7463f868b1e421d7bca3abea0ffab4a"
Jul 27 21:12:44.988992 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.988978    2562 scope.go:117] "RemoveContainer" containerID="14fbaa5ae4766993945373ef852938b3e7463f868b1e421d7bca3abea0ffab4a"
Jul 27 21:12:44.989193 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:12:44.989179    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14fbaa5ae4766993945373ef852938b3e7463f868b1e421d7bca3abea0ffab4a\": container with ID starting with 14fbaa5ae4766993945373ef852938b3e7463f868b1e421d7bca3abea0ffab4a not found: ID does not exist" containerID="14fbaa5ae4766993945373ef852938b3e7463f868b1e421d7bca3abea0ffab4a"
Jul 27 21:12:44.989236 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.989199    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14fbaa5ae4766993945373ef852938b3e7463f868b1e421d7bca3abea0ffab4a"} err="failed to get container status \"14fbaa5ae4766993945373ef852938b3e7463f868b1e421d7bca3abea0ffab4a\": rpc error: code = NotFound desc = could not find container \"14fbaa5ae4766993945373ef852938b3e7463f868b1e421d7bca3abea0ffab4a\": container with ID starting with 14fbaa5ae4766993945373ef852938b3e7463f868b1e421d7bca3abea0ffab4a not found: ID does not exist"
Jul 27 21:12:44.989236 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.989212    2562 scope.go:117] "RemoveContainer" containerID="67d188c60fa11b714366957f320eae5463bd4652ff2ba29759396b453ccf1b80"
Jul 27 21:12:44.995391 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.995370    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"]
Jul 27 21:12:44.997072 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.997057    2562 scope.go:117] "RemoveContainer" containerID="67d188c60fa11b714366957f320eae5463bd4652ff2ba29759396b453ccf1b80"
Jul 27 21:12:44.997346 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:12:44.997326    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67d188c60fa11b714366957f320eae5463bd4652ff2ba29759396b453ccf1b80\": container with ID starting with 67d188c60fa11b714366957f320eae5463bd4652ff2ba29759396b453ccf1b80 not found: ID does not exist" containerID="67d188c60fa11b714366957f320eae5463bd4652ff2ba29759396b453ccf1b80"
Jul 27 21:12:44.997399 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:44.997352    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67d188c60fa11b714366957f320eae5463bd4652ff2ba29759396b453ccf1b80"} err="failed to get container status \"67d188c60fa11b714366957f320eae5463bd4652ff2ba29759396b453ccf1b80\": rpc error: code = NotFound desc = could not find container \"67d188c60fa11b714366957f320eae5463bd4652ff2ba29759396b453ccf1b80\": container with ID starting with 67d188c60fa11b714366957f320eae5463bd4652ff2ba29759396b453ccf1b80 not found: ID does not exist"
Jul 27 21:12:45.008021 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:45.007998    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c7d2ad-6cc9dddb9b-mtcdn"]
Jul 27 21:12:45.021497 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:45.021474    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8"]
Jul 27 21:12:45.027920 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:45.027900    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c7d2ad-8589955d7d-c4xb8"]
Jul 27 21:12:45.032757 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:45.032740    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2mjp\" (UniqueName: \"kubernetes.io/projected/a76b6d16-93a1-44f1-8bcc-6766c5014270-kube-api-access-q2mjp\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:12:45.032819 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:45.032763    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rwrr\" (UniqueName: \"kubernetes.io/projected/1278b131-dbae-4bef-823e-691042c77814-kube-api-access-9rwrr\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:12:45.032819 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:45.032776    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1278b131-dbae-4bef-823e-691042c77814-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:12:45.032819 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:45.032785    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a76b6d16-93a1-44f1-8bcc-6766c5014270-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:12:45.037967 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:45.037945    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8"]
Jul 27 21:12:45.043487 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:45.043469    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c7d2ad-548bc587f6-z7kd8"]
Jul 27 21:12:46.869905 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:46.869864    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1278b131-dbae-4bef-823e-691042c77814" path="/var/lib/kubelet/pods/1278b131-dbae-4bef-823e-691042c77814/volumes"
Jul 27 21:12:46.870475 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:46.870453    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b0c65f0-2602-4b27-8821-3435ed32aac5" path="/var/lib/kubelet/pods/4b0c65f0-2602-4b27-8821-3435ed32aac5/volumes"
Jul 27 21:12:46.870855 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:12:46.870836    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a76b6d16-93a1-44f1-8bcc-6766c5014270" path="/var/lib/kubelet/pods/a76b6d16-93a1-44f1-8bcc-6766c5014270/volumes"
Jul 27 21:13:00.311853 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.311818    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"]
Jul 27 21:13:00.312416 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.312400    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e04ce96-0c12-4646-ac7b-972f7ccbe67a" containerName="maas-api"
Jul 27 21:13:00.312469 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.312419    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e04ce96-0c12-4646-ac7b-972f7ccbe67a" containerName="maas-api"
Jul 27 21:13:00.312469 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.312432    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53717ca2-a32c-4ea5-9c9f-15dd0c630d17" containerName="payload-pre-processing"
Jul 27 21:13:00.312469 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.312441    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="53717ca2-a32c-4ea5-9c9f-15dd0c630d17" containerName="payload-pre-processing"
Jul 27 21:13:00.312469 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.312459    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a76b6d16-93a1-44f1-8bcc-6766c5014270" containerName="payload-processing"
Jul 27 21:13:00.312469 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.312468    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a76b6d16-93a1-44f1-8bcc-6766c5014270" containerName="payload-processing"
Jul 27 21:13:00.312625 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.312497    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1278b131-dbae-4bef-823e-691042c77814" containerName="payload-pre-processing"
Jul 27 21:13:00.312625 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.312506    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1278b131-dbae-4bef-823e-691042c77814" containerName="payload-pre-processing"
Jul 27 21:13:00.312625 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.312514    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b0c65f0-2602-4b27-8821-3435ed32aac5" containerName="maas-api"
Jul 27 21:13:00.312625 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.312523    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b0c65f0-2602-4b27-8821-3435ed32aac5" containerName="maas-api"
Jul 27 21:13:00.312625 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.312602    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e04ce96-0c12-4646-ac7b-972f7ccbe67a" containerName="maas-api"
Jul 27 21:13:00.312625 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.312614    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1278b131-dbae-4bef-823e-691042c77814" containerName="payload-pre-processing"
Jul 27 21:13:00.312625 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.312624    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b0c65f0-2602-4b27-8821-3435ed32aac5" containerName="maas-api"
Jul 27 21:13:00.312838 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.312633    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a76b6d16-93a1-44f1-8bcc-6766c5014270" containerName="payload-processing"
Jul 27 21:13:00.312838 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.312644    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="53717ca2-a32c-4ea5-9c9f-15dd0c630d17" containerName="payload-pre-processing"
Jul 27 21:13:00.316019 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.315999    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"
Jul 27 21:13:00.318519 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.318497    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-f47ead-serving-cert\""
Jul 27 21:13:00.326463 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.326424    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"]
Jul 27 21:13:00.365242 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.365210    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b9390cc-90e2-4417-99cd-c2d714a9e288-maas-api-tls\") pod \"maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f\" (UID: \"1b9390cc-90e2-4417-99cd-c2d714a9e288\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"
Jul 27 21:13:00.365489 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.365259    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtfdg\" (UniqueName: \"kubernetes.io/projected/1b9390cc-90e2-4417-99cd-c2d714a9e288-kube-api-access-qtfdg\") pod \"maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f\" (UID: \"1b9390cc-90e2-4417-99cd-c2d714a9e288\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"
Jul 27 21:13:00.365568 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.365501    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9390cc-90e2-4417-99cd-c2d714a9e288-openshift-service-ca\") pod \"maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f\" (UID: \"1b9390cc-90e2-4417-99cd-c2d714a9e288\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"
Jul 27 21:13:00.466430 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.466391    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9390cc-90e2-4417-99cd-c2d714a9e288-openshift-service-ca\") pod \"maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f\" (UID: \"1b9390cc-90e2-4417-99cd-c2d714a9e288\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"
Jul 27 21:13:00.466630 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.466449    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b9390cc-90e2-4417-99cd-c2d714a9e288-maas-api-tls\") pod \"maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f\" (UID: \"1b9390cc-90e2-4417-99cd-c2d714a9e288\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"
Jul 27 21:13:00.466630 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.466484    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtfdg\" (UniqueName: \"kubernetes.io/projected/1b9390cc-90e2-4417-99cd-c2d714a9e288-kube-api-access-qtfdg\") pod \"maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f\" (UID: \"1b9390cc-90e2-4417-99cd-c2d714a9e288\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"
Jul 27 21:13:00.467103 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.467078    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9390cc-90e2-4417-99cd-c2d714a9e288-openshift-service-ca\") pod \"maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f\" (UID: \"1b9390cc-90e2-4417-99cd-c2d714a9e288\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"
Jul 27 21:13:00.468829 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.468805    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b9390cc-90e2-4417-99cd-c2d714a9e288-maas-api-tls\") pod \"maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f\" (UID: \"1b9390cc-90e2-4417-99cd-c2d714a9e288\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"
Jul 27 21:13:00.478349 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.478323    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtfdg\" (UniqueName: \"kubernetes.io/projected/1b9390cc-90e2-4417-99cd-c2d714a9e288-kube-api-access-qtfdg\") pod \"maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f\" (UID: \"1b9390cc-90e2-4417-99cd-c2d714a9e288\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"
Jul 27 21:13:00.628923 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.628890    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"
Jul 27 21:13:00.777310 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.777261    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"]
Jul 27 21:13:00.778369 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:13:00.778344    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b9390cc_90e2_4417_99cd_c2d714a9e288.slice/crio-89e62ea8f24b83e8ecf78a34ab127f54f65a75a6a9ffaf1fb0f5d5c563ad3d03 WatchSource:0}: Error finding container 89e62ea8f24b83e8ecf78a34ab127f54f65a75a6a9ffaf1fb0f5d5c563ad3d03: Status 404 returned error can't find the container with id 89e62ea8f24b83e8ecf78a34ab127f54f65a75a6a9ffaf1fb0f5d5c563ad3d03
Jul 27 21:13:00.779705 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:00.779687    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:13:01.053267 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:01.053178    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f" event={"ID":"1b9390cc-90e2-4417-99cd-c2d714a9e288","Type":"ContainerStarted","Data":"89e62ea8f24b83e8ecf78a34ab127f54f65a75a6a9ffaf1fb0f5d5c563ad3d03"}
Jul 27 21:13:01.104692 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:01.104657    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6"]
Jul 27 21:13:01.109399 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:01.109380    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6"
Jul 27 21:13:01.112121 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:01.112104    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-f47ead-dockercfg-c5cwx\""
Jul 27 21:13:01.112456 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:01.112437    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-f47ead\""
Jul 27 21:13:01.130641 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:01.130611    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6"]
Jul 27 21:13:01.171968 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:01.171946    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8nsx\" (UniqueName: \"kubernetes.io/projected/7464c379-4092-4172-9a77-1ded1107262d-kube-api-access-b8nsx\") pod \"payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6\" (UID: \"7464c379-4092-4172-9a77-1ded1107262d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6"
Jul 27 21:13:01.172075 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:01.172055    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7464c379-4092-4172-9a77-1ded1107262d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6\" (UID: \"7464c379-4092-4172-9a77-1ded1107262d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6"
Jul 27 21:13:01.272566 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:01.272525    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8nsx\" (UniqueName: \"kubernetes.io/projected/7464c379-4092-4172-9a77-1ded1107262d-kube-api-access-b8nsx\") pod \"payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6\" (UID: \"7464c379-4092-4172-9a77-1ded1107262d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6"
Jul 27 21:13:01.272737 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:01.272649    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7464c379-4092-4172-9a77-1ded1107262d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6\" (UID: \"7464c379-4092-4172-9a77-1ded1107262d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6"
Jul 27 21:13:01.273347 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:01.273329    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7464c379-4092-4172-9a77-1ded1107262d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6\" (UID: \"7464c379-4092-4172-9a77-1ded1107262d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6"
Jul 27 21:13:01.289741 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:01.289707    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8nsx\" (UniqueName: \"kubernetes.io/projected/7464c379-4092-4172-9a77-1ded1107262d-kube-api-access-b8nsx\") pod \"payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6\" (UID: \"7464c379-4092-4172-9a77-1ded1107262d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6"
Jul 27 21:13:01.419669 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:01.419632    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6"
Jul 27 21:13:01.563783 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:01.563757    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6"]
Jul 27 21:13:01.565430 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:13:01.565387    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7464c379_4092_4172_9a77_1ded1107262d.slice/crio-96c859d322e9d9fa884d58e0af69c8778577f77931aac8ee782ea9e77e7595df WatchSource:0}: Error finding container 96c859d322e9d9fa884d58e0af69c8778577f77931aac8ee782ea9e77e7595df: Status 404 returned error can't find the container with id 96c859d322e9d9fa884d58e0af69c8778577f77931aac8ee782ea9e77e7595df
Jul 27 21:13:02.059629 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:02.059586    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6" event={"ID":"7464c379-4092-4172-9a77-1ded1107262d","Type":"ContainerStarted","Data":"087960e4c4ca546e2fec6345dc29024135d2e059f9b608b762a3dc44d16e0ae1"}
Jul 27 21:13:02.059838 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:02.059794    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6"
Jul 27 21:13:02.059838 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:02.059826    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6" event={"ID":"7464c379-4092-4172-9a77-1ded1107262d","Type":"ContainerStarted","Data":"96c859d322e9d9fa884d58e0af69c8778577f77931aac8ee782ea9e77e7595df"}
Jul 27 21:13:02.061306 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:02.061264    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f" event={"ID":"1b9390cc-90e2-4417-99cd-c2d714a9e288","Type":"ContainerStarted","Data":"6c03300db94511bee580f46962a262323c33b7e62d1cc36ff463dcd3c986ae30"}
Jul 27 21:13:02.061440 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:02.061394    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"
Jul 27 21:13:02.079098 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:02.079048    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6" podStartSLOduration=1.079033208 podStartE2EDuration="1.079033208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:13:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:13:02.077908611 +0000 UTC m=+2321.718125052" watchObservedRunningTime="2026-07-27 21:13:02.079033208 +0000 UTC m=+2321.719249647"
Jul 27 21:13:02.102070 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:02.102022    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f" podStartSLOduration=1.7140737289999999 podStartE2EDuration="2.102006163s" totalImagesPullingTime="387.932434ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:13:02.10053929 +0000 UTC m=+2321.740755753" watchObservedRunningTime="2026-07-27 21:13:02.102006163 +0000 UTC m=+2321.742222602"
Jul 27 21:13:08.072109 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:08.072075    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"
Jul 27 21:13:08.992620 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:08.992583    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f"]
Jul 27 21:13:08.996463 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:08.996440    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f"
Jul 27 21:13:08.998864 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:08.998842    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-965e57\""
Jul 27 21:13:08.998864 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:08.998853    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-965e57-dockercfg-mr8rm\""
Jul 27 21:13:09.009324 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.009295    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9"]
Jul 27 21:13:09.012967 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.012942    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f"]
Jul 27 21:13:09.013115 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.013032    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9"
Jul 27 21:13:09.028341 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.028263    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9"]
Jul 27 21:13:09.142991 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.142953    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/558b0695-f339-476f-95cf-1740fff66b45-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f\" (UID: \"558b0695-f339-476f-95cf-1740fff66b45\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f"
Jul 27 21:13:09.143438 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.143017    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bea32b4d-1112-4b46-8cfb-66832bb9c2b8-plugins-config-volume\") pod \"payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9\" (UID: \"bea32b4d-1112-4b46-8cfb-66832bb9c2b8\") " pod="openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9"
Jul 27 21:13:09.143438 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.143067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbjk8\" (UniqueName: \"kubernetes.io/projected/558b0695-f339-476f-95cf-1740fff66b45-kube-api-access-mbjk8\") pod \"payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f\" (UID: \"558b0695-f339-476f-95cf-1740fff66b45\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f"
Jul 27 21:13:09.143438 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.143159    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thb9c\" (UniqueName: \"kubernetes.io/projected/bea32b4d-1112-4b46-8cfb-66832bb9c2b8-kube-api-access-thb9c\") pod \"payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9\" (UID: \"bea32b4d-1112-4b46-8cfb-66832bb9c2b8\") " pod="openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9"
Jul 27 21:13:09.244685 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.244595    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/558b0695-f339-476f-95cf-1740fff66b45-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f\" (UID: \"558b0695-f339-476f-95cf-1740fff66b45\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f"
Jul 27 21:13:09.244685 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.244645    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bea32b4d-1112-4b46-8cfb-66832bb9c2b8-plugins-config-volume\") pod \"payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9\" (UID: \"bea32b4d-1112-4b46-8cfb-66832bb9c2b8\") " pod="openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9"
Jul 27 21:13:09.244685 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.244676    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbjk8\" (UniqueName: \"kubernetes.io/projected/558b0695-f339-476f-95cf-1740fff66b45-kube-api-access-mbjk8\") pod \"payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f\" (UID: \"558b0695-f339-476f-95cf-1740fff66b45\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f"
Jul 27 21:13:09.244916 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.244720    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thb9c\" (UniqueName: \"kubernetes.io/projected/bea32b4d-1112-4b46-8cfb-66832bb9c2b8-kube-api-access-thb9c\") pod \"payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9\" (UID: \"bea32b4d-1112-4b46-8cfb-66832bb9c2b8\") " pod="openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9"
Jul 27 21:13:09.245453 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.245434    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bea32b4d-1112-4b46-8cfb-66832bb9c2b8-plugins-config-volume\") pod \"payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9\" (UID: \"bea32b4d-1112-4b46-8cfb-66832bb9c2b8\") " pod="openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9"
Jul 27 21:13:09.245507 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.245488    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/558b0695-f339-476f-95cf-1740fff66b45-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f\" (UID: \"558b0695-f339-476f-95cf-1740fff66b45\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f"
Jul 27 21:13:09.253165 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.253138    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thb9c\" (UniqueName: \"kubernetes.io/projected/bea32b4d-1112-4b46-8cfb-66832bb9c2b8-kube-api-access-thb9c\") pod \"payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9\" (UID: \"bea32b4d-1112-4b46-8cfb-66832bb9c2b8\") " pod="openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9"
Jul 27 21:13:09.253353 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.253337    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbjk8\" (UniqueName: \"kubernetes.io/projected/558b0695-f339-476f-95cf-1740fff66b45-kube-api-access-mbjk8\") pod \"payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f\" (UID: \"558b0695-f339-476f-95cf-1740fff66b45\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f"
Jul 27 21:13:09.307457 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.307423    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f"
Jul 27 21:13:09.327403 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.327371    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9"
Jul 27 21:13:09.467170 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.466391    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f"]
Jul 27 21:13:09.470768 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:13:09.470723    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod558b0695_f339_476f_95cf_1740fff66b45.slice/crio-a74d36c19a3cb205df24cc87b2aca6ebf377fd6f866e17dc910b7f9b77d1856c WatchSource:0}: Error finding container a74d36c19a3cb205df24cc87b2aca6ebf377fd6f866e17dc910b7f9b77d1856c: Status 404 returned error can't find the container with id a74d36c19a3cb205df24cc87b2aca6ebf377fd6f866e17dc910b7f9b77d1856c
Jul 27 21:13:09.494930 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:09.494868    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9"]
Jul 27 21:13:09.495823 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:13:09.495774    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea32b4d_1112_4b46_8cfb_66832bb9c2b8.slice/crio-c61f6ec2b52b0c76ad9435557ca7e9508a5ffe145660601b8361a176749b532c WatchSource:0}: Error finding container c61f6ec2b52b0c76ad9435557ca7e9508a5ffe145660601b8361a176749b532c: Status 404 returned error can't find the container with id c61f6ec2b52b0c76ad9435557ca7e9508a5ffe145660601b8361a176749b532c
Jul 27 21:13:10.106438 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:10.106386    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9" event={"ID":"bea32b4d-1112-4b46-8cfb-66832bb9c2b8","Type":"ContainerStarted","Data":"952d841a08126d86cbd1a129f441639b5217f71521f7af317ec0ecac49ce6133"}
Jul 27 21:13:10.106665 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:10.106454    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9" event={"ID":"bea32b4d-1112-4b46-8cfb-66832bb9c2b8","Type":"ContainerStarted","Data":"c61f6ec2b52b0c76ad9435557ca7e9508a5ffe145660601b8361a176749b532c"}
Jul 27 21:13:10.106665 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:10.106585    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9"
Jul 27 21:13:10.108028 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:10.108004    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f" event={"ID":"558b0695-f339-476f-95cf-1740fff66b45","Type":"ContainerStarted","Data":"d63bd55a3947a18a15011b75fbf8541a0d525b5accd52b8b13bc92dd34f5caae"}
Jul 27 21:13:10.108150 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:10.108047    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f" event={"ID":"558b0695-f339-476f-95cf-1740fff66b45","Type":"ContainerStarted","Data":"a74d36c19a3cb205df24cc87b2aca6ebf377fd6f866e17dc910b7f9b77d1856c"}
Jul 27 21:13:10.108150 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:10.108069    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f"
Jul 27 21:13:10.124818 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:10.124748    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9" podStartSLOduration=2.124729214 podStartE2EDuration="2.124729214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:13:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:13:10.123419177 +0000 UTC m=+2329.763635635" watchObservedRunningTime="2026-07-27 21:13:10.124729214 +0000 UTC m=+2329.764945655"
Jul 27 21:13:10.141375 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:10.141322    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f" podStartSLOduration=2.141306569 podStartE2EDuration="2.141306569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:13:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:13:10.139324759 +0000 UTC m=+2329.779541230" watchObservedRunningTime="2026-07-27 21:13:10.141306569 +0000 UTC m=+2329.781523008"
Jul 27 21:13:13.068784 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:13.068755    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6"
Jul 27 21:13:21.114868 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:21.114839    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9"
Jul 27 21:13:21.115244 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:21.114915    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f"
Jul 27 21:13:36.027448 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.027400    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"]
Jul 27 21:13:36.030233 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.027674    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f" podUID="1b9390cc-90e2-4417-99cd-c2d714a9e288" containerName="maas-api" containerID="cri-o://6c03300db94511bee580f46962a262323c33b7e62d1cc36ff463dcd3c986ae30" gracePeriod=30
Jul 27 21:13:36.095788 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.095757    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6"]
Jul 27 21:13:36.095983 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.095951    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6" podUID="7464c379-4092-4172-9a77-1ded1107262d" containerName="payload-pre-processing" containerID="cri-o://087960e4c4ca546e2fec6345dc29024135d2e059f9b608b762a3dc44d16e0ae1" gracePeriod=30
Jul 27 21:13:36.241310 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.241255    2562 generic.go:356] "Generic (PLEG): container finished" podID="1b9390cc-90e2-4417-99cd-c2d714a9e288" containerID="6c03300db94511bee580f46962a262323c33b7e62d1cc36ff463dcd3c986ae30" exitCode=0
Jul 27 21:13:36.241513 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.241312    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f" event={"ID":"1b9390cc-90e2-4417-99cd-c2d714a9e288","Type":"ContainerDied","Data":"6c03300db94511bee580f46962a262323c33b7e62d1cc36ff463dcd3c986ae30"}
Jul 27 21:13:36.243151 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.243124    2562 generic.go:356] "Generic (PLEG): container finished" podID="7464c379-4092-4172-9a77-1ded1107262d" containerID="087960e4c4ca546e2fec6345dc29024135d2e059f9b608b762a3dc44d16e0ae1" exitCode=0
Jul 27 21:13:36.243311 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.243182    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6" event={"ID":"7464c379-4092-4172-9a77-1ded1107262d","Type":"ContainerDied","Data":"087960e4c4ca546e2fec6345dc29024135d2e059f9b608b762a3dc44d16e0ae1"}
Jul 27 21:13:36.350982 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.350955    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"
Jul 27 21:13:36.382691 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.382667    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6"
Jul 27 21:13:36.388126 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.388105    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8nsx\" (UniqueName: \"kubernetes.io/projected/7464c379-4092-4172-9a77-1ded1107262d-kube-api-access-b8nsx\") pod \"7464c379-4092-4172-9a77-1ded1107262d\" (UID: \"7464c379-4092-4172-9a77-1ded1107262d\") "
Jul 27 21:13:36.388253 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.388136    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b9390cc-90e2-4417-99cd-c2d714a9e288-maas-api-tls\") pod \"1b9390cc-90e2-4417-99cd-c2d714a9e288\" (UID: \"1b9390cc-90e2-4417-99cd-c2d714a9e288\") "
Jul 27 21:13:36.388253 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.388170    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtfdg\" (UniqueName: \"kubernetes.io/projected/1b9390cc-90e2-4417-99cd-c2d714a9e288-kube-api-access-qtfdg\") pod \"1b9390cc-90e2-4417-99cd-c2d714a9e288\" (UID: \"1b9390cc-90e2-4417-99cd-c2d714a9e288\") "
Jul 27 21:13:36.388388 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.388248    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7464c379-4092-4172-9a77-1ded1107262d-plugins-config-volume\") pod \"7464c379-4092-4172-9a77-1ded1107262d\" (UID: \"7464c379-4092-4172-9a77-1ded1107262d\") "
Jul 27 21:13:36.388388 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.388352    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9390cc-90e2-4417-99cd-c2d714a9e288-openshift-service-ca\") pod \"1b9390cc-90e2-4417-99cd-c2d714a9e288\" (UID: \"1b9390cc-90e2-4417-99cd-c2d714a9e288\") "
Jul 27 21:13:36.388669 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.388637    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7464c379-4092-4172-9a77-1ded1107262d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7464c379-4092-4172-9a77-1ded1107262d" (UID: "7464c379-4092-4172-9a77-1ded1107262d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:13:36.388669 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.388659    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b9390cc-90e2-4417-99cd-c2d714a9e288-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1b9390cc-90e2-4417-99cd-c2d714a9e288" (UID: "1b9390cc-90e2-4417-99cd-c2d714a9e288"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:13:36.390790 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.390771    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b9390cc-90e2-4417-99cd-c2d714a9e288-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1b9390cc-90e2-4417-99cd-c2d714a9e288" (UID: "1b9390cc-90e2-4417-99cd-c2d714a9e288"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:13:36.390873 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.390790    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b9390cc-90e2-4417-99cd-c2d714a9e288-kube-api-access-qtfdg" (OuterVolumeSpecName: "kube-api-access-qtfdg") pod "1b9390cc-90e2-4417-99cd-c2d714a9e288" (UID: "1b9390cc-90e2-4417-99cd-c2d714a9e288"). InnerVolumeSpecName "kube-api-access-qtfdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:13:36.390920 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.390884    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7464c379-4092-4172-9a77-1ded1107262d-kube-api-access-b8nsx" (OuterVolumeSpecName: "kube-api-access-b8nsx") pod "7464c379-4092-4172-9a77-1ded1107262d" (UID: "7464c379-4092-4172-9a77-1ded1107262d"). InnerVolumeSpecName "kube-api-access-b8nsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:13:36.489213 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.489175    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtfdg\" (UniqueName: \"kubernetes.io/projected/1b9390cc-90e2-4417-99cd-c2d714a9e288-kube-api-access-qtfdg\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:13:36.489213 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.489205    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7464c379-4092-4172-9a77-1ded1107262d-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:13:36.489213 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.489214    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9390cc-90e2-4417-99cd-c2d714a9e288-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:13:36.489213 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.489224    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8nsx\" (UniqueName: \"kubernetes.io/projected/7464c379-4092-4172-9a77-1ded1107262d-kube-api-access-b8nsx\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:13:36.489534 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:36.489232    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b9390cc-90e2-4417-99cd-c2d714a9e288-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:13:37.249682 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:37.249596    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6"
Jul 27 21:13:37.249682 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:37.249636    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6" event={"ID":"7464c379-4092-4172-9a77-1ded1107262d","Type":"ContainerDied","Data":"96c859d322e9d9fa884d58e0af69c8778577f77931aac8ee782ea9e77e7595df"}
Jul 27 21:13:37.250183 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:37.249699    2562 scope.go:117] "RemoveContainer" containerID="087960e4c4ca546e2fec6345dc29024135d2e059f9b608b762a3dc44d16e0ae1"
Jul 27 21:13:37.251080 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:37.250976    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f" event={"ID":"1b9390cc-90e2-4417-99cd-c2d714a9e288","Type":"ContainerDied","Data":"89e62ea8f24b83e8ecf78a34ab127f54f65a75a6a9ffaf1fb0f5d5c563ad3d03"}
Jul 27 21:13:37.251080 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:37.250987    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"
Jul 27 21:13:37.258347 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:37.258335    2562 scope.go:117] "RemoveContainer" containerID="6c03300db94511bee580f46962a262323c33b7e62d1cc36ff463dcd3c986ae30"
Jul 27 21:13:37.269535 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:37.269506    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6"]
Jul 27 21:13:37.271859 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:37.271837    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f47ead-6dff9bc85b-ngln6"]
Jul 27 21:13:37.282924 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:37.282896    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"]
Jul 27 21:13:37.287631 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:37.287610    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f47ead-846bddbd44-8dz9f"]
Jul 27 21:13:38.872185 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:38.872148    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b9390cc-90e2-4417-99cd-c2d714a9e288" path="/var/lib/kubelet/pods/1b9390cc-90e2-4417-99cd-c2d714a9e288/volumes"
Jul 27 21:13:38.872605 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:13:38.872541    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7464c379-4092-4172-9a77-1ded1107262d" path="/var/lib/kubelet/pods/7464c379-4092-4172-9a77-1ded1107262d/volumes"
Jul 27 21:14:03.358292 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:03.357408    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9"]
Jul 27 21:14:03.358292 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:03.357750    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9" podUID="bea32b4d-1112-4b46-8cfb-66832bb9c2b8" containerName="payload-processing" containerID="cri-o://952d841a08126d86cbd1a129f441639b5217f71521f7af317ec0ecac49ce6133" gracePeriod=30
Jul 27 21:14:03.363505 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:03.363471    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f"]
Jul 27 21:14:03.363986 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:03.363927    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f" podUID="558b0695-f339-476f-95cf-1740fff66b45" containerName="payload-pre-processing" containerID="cri-o://d63bd55a3947a18a15011b75fbf8541a0d525b5accd52b8b13bc92dd34f5caae" gracePeriod=30
Jul 27 21:14:03.652238 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:03.652209    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f"
Jul 27 21:14:03.655070 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:03.655049    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9"
Jul 27 21:14:03.741035 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:03.741009    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thb9c\" (UniqueName: \"kubernetes.io/projected/bea32b4d-1112-4b46-8cfb-66832bb9c2b8-kube-api-access-thb9c\") pod \"bea32b4d-1112-4b46-8cfb-66832bb9c2b8\" (UID: \"bea32b4d-1112-4b46-8cfb-66832bb9c2b8\") "
Jul 27 21:14:03.741213 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:03.741053    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/558b0695-f339-476f-95cf-1740fff66b45-plugins-config-volume\") pod \"558b0695-f339-476f-95cf-1740fff66b45\" (UID: \"558b0695-f339-476f-95cf-1740fff66b45\") "
Jul 27 21:14:03.741213 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:03.741078    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bea32b4d-1112-4b46-8cfb-66832bb9c2b8-plugins-config-volume\") pod \"bea32b4d-1112-4b46-8cfb-66832bb9c2b8\" (UID: \"bea32b4d-1112-4b46-8cfb-66832bb9c2b8\") "
Jul 27 21:14:03.741213 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:03.741108    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbjk8\" (UniqueName: \"kubernetes.io/projected/558b0695-f339-476f-95cf-1740fff66b45-kube-api-access-mbjk8\") pod \"558b0695-f339-476f-95cf-1740fff66b45\" (UID: \"558b0695-f339-476f-95cf-1740fff66b45\") "
Jul 27 21:14:03.741504 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:03.741471    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/558b0695-f339-476f-95cf-1740fff66b45-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "558b0695-f339-476f-95cf-1740fff66b45" (UID: "558b0695-f339-476f-95cf-1740fff66b45"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:14:03.741571 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:03.741522    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bea32b4d-1112-4b46-8cfb-66832bb9c2b8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bea32b4d-1112-4b46-8cfb-66832bb9c2b8" (UID: "bea32b4d-1112-4b46-8cfb-66832bb9c2b8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:14:03.743068 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:03.743043    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bea32b4d-1112-4b46-8cfb-66832bb9c2b8-kube-api-access-thb9c" (OuterVolumeSpecName: "kube-api-access-thb9c") pod "bea32b4d-1112-4b46-8cfb-66832bb9c2b8" (UID: "bea32b4d-1112-4b46-8cfb-66832bb9c2b8"). InnerVolumeSpecName "kube-api-access-thb9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:14:03.743164 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:03.743126    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/558b0695-f339-476f-95cf-1740fff66b45-kube-api-access-mbjk8" (OuterVolumeSpecName: "kube-api-access-mbjk8") pod "558b0695-f339-476f-95cf-1740fff66b45" (UID: "558b0695-f339-476f-95cf-1740fff66b45"). InnerVolumeSpecName "kube-api-access-mbjk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:14:03.842442 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:03.842411    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thb9c\" (UniqueName: \"kubernetes.io/projected/bea32b4d-1112-4b46-8cfb-66832bb9c2b8-kube-api-access-thb9c\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:14:03.842442 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:03.842438    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/558b0695-f339-476f-95cf-1740fff66b45-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:14:03.842442 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:03.842447    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bea32b4d-1112-4b46-8cfb-66832bb9c2b8-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:14:03.842650 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:03.842456    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbjk8\" (UniqueName: \"kubernetes.io/projected/558b0695-f339-476f-95cf-1740fff66b45-kube-api-access-mbjk8\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:14:04.391107 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.391078    2562 generic.go:356] "Generic (PLEG): container finished" podID="bea32b4d-1112-4b46-8cfb-66832bb9c2b8" containerID="952d841a08126d86cbd1a129f441639b5217f71521f7af317ec0ecac49ce6133" exitCode=0
Jul 27 21:14:04.391482 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.391124    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9"
Jul 27 21:14:04.391482 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.391155    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9" event={"ID":"bea32b4d-1112-4b46-8cfb-66832bb9c2b8","Type":"ContainerDied","Data":"952d841a08126d86cbd1a129f441639b5217f71521f7af317ec0ecac49ce6133"}
Jul 27 21:14:04.391482 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.391211    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9" event={"ID":"bea32b4d-1112-4b46-8cfb-66832bb9c2b8","Type":"ContainerDied","Data":"c61f6ec2b52b0c76ad9435557ca7e9508a5ffe145660601b8361a176749b532c"}
Jul 27 21:14:04.391482 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.391240    2562 scope.go:117] "RemoveContainer" containerID="952d841a08126d86cbd1a129f441639b5217f71521f7af317ec0ecac49ce6133"
Jul 27 21:14:04.392595 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.392481    2562 generic.go:356] "Generic (PLEG): container finished" podID="558b0695-f339-476f-95cf-1740fff66b45" containerID="d63bd55a3947a18a15011b75fbf8541a0d525b5accd52b8b13bc92dd34f5caae" exitCode=0
Jul 27 21:14:04.392595 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.392521    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f"
Jul 27 21:14:04.392595 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.392569    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f" event={"ID":"558b0695-f339-476f-95cf-1740fff66b45","Type":"ContainerDied","Data":"d63bd55a3947a18a15011b75fbf8541a0d525b5accd52b8b13bc92dd34f5caae"}
Jul 27 21:14:04.392775 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.392620    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f" event={"ID":"558b0695-f339-476f-95cf-1740fff66b45","Type":"ContainerDied","Data":"a74d36c19a3cb205df24cc87b2aca6ebf377fd6f866e17dc910b7f9b77d1856c"}
Jul 27 21:14:04.403491 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.403465    2562 scope.go:117] "RemoveContainer" containerID="952d841a08126d86cbd1a129f441639b5217f71521f7af317ec0ecac49ce6133"
Jul 27 21:14:04.403763 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:14:04.403739    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"952d841a08126d86cbd1a129f441639b5217f71521f7af317ec0ecac49ce6133\": container with ID starting with 952d841a08126d86cbd1a129f441639b5217f71521f7af317ec0ecac49ce6133 not found: ID does not exist" containerID="952d841a08126d86cbd1a129f441639b5217f71521f7af317ec0ecac49ce6133"
Jul 27 21:14:04.403821 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.403775    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"952d841a08126d86cbd1a129f441639b5217f71521f7af317ec0ecac49ce6133"} err="failed to get container status \"952d841a08126d86cbd1a129f441639b5217f71521f7af317ec0ecac49ce6133\": rpc error: code = NotFound desc = could not find container \"952d841a08126d86cbd1a129f441639b5217f71521f7af317ec0ecac49ce6133\": container with ID starting with 952d841a08126d86cbd1a129f441639b5217f71521f7af317ec0ecac49ce6133 not found: ID does not exist"
Jul 27 21:14:04.403821 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.403799    2562 scope.go:117] "RemoveContainer" containerID="d63bd55a3947a18a15011b75fbf8541a0d525b5accd52b8b13bc92dd34f5caae"
Jul 27 21:14:04.412092 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.412074    2562 scope.go:117] "RemoveContainer" containerID="d63bd55a3947a18a15011b75fbf8541a0d525b5accd52b8b13bc92dd34f5caae"
Jul 27 21:14:04.412333 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:14:04.412317    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d63bd55a3947a18a15011b75fbf8541a0d525b5accd52b8b13bc92dd34f5caae\": container with ID starting with d63bd55a3947a18a15011b75fbf8541a0d525b5accd52b8b13bc92dd34f5caae not found: ID does not exist" containerID="d63bd55a3947a18a15011b75fbf8541a0d525b5accd52b8b13bc92dd34f5caae"
Jul 27 21:14:04.412424 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.412340    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d63bd55a3947a18a15011b75fbf8541a0d525b5accd52b8b13bc92dd34f5caae"} err="failed to get container status \"d63bd55a3947a18a15011b75fbf8541a0d525b5accd52b8b13bc92dd34f5caae\": rpc error: code = NotFound desc = could not find container \"d63bd55a3947a18a15011b75fbf8541a0d525b5accd52b8b13bc92dd34f5caae\": container with ID starting with d63bd55a3947a18a15011b75fbf8541a0d525b5accd52b8b13bc92dd34f5caae not found: ID does not exist"
Jul 27 21:14:04.421102 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.421070    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f"]
Jul 27 21:14:04.427330 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.427297    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-965e57-d5df8db68-ls94f"]
Jul 27 21:14:04.437434 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.437414    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9"]
Jul 27 21:14:04.443672 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.443653    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-965e57-7c69c4fc76-4hxw9"]
Jul 27 21:14:04.870221 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.870187    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="558b0695-f339-476f-95cf-1740fff66b45" path="/var/lib/kubelet/pods/558b0695-f339-476f-95cf-1740fff66b45/volumes"
Jul 27 21:14:04.870578 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:04.870564    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bea32b4d-1112-4b46-8cfb-66832bb9c2b8" path="/var/lib/kubelet/pods/bea32b4d-1112-4b46-8cfb-66832bb9c2b8/volumes"
Jul 27 21:14:19.673249 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.673212    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9"]
Jul 27 21:14:19.673868 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.673622    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7464c379-4092-4172-9a77-1ded1107262d" containerName="payload-pre-processing"
Jul 27 21:14:19.673868 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.673634    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7464c379-4092-4172-9a77-1ded1107262d" containerName="payload-pre-processing"
Jul 27 21:14:19.673868 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.673644    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b9390cc-90e2-4417-99cd-c2d714a9e288" containerName="maas-api"
Jul 27 21:14:19.673868 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.673650    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b9390cc-90e2-4417-99cd-c2d714a9e288" containerName="maas-api"
Jul 27 21:14:19.673868 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.673655    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="558b0695-f339-476f-95cf-1740fff66b45" containerName="payload-pre-processing"
Jul 27 21:14:19.673868 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.673661    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="558b0695-f339-476f-95cf-1740fff66b45" containerName="payload-pre-processing"
Jul 27 21:14:19.673868 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.673672    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bea32b4d-1112-4b46-8cfb-66832bb9c2b8" containerName="payload-processing"
Jul 27 21:14:19.673868 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.673678    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bea32b4d-1112-4b46-8cfb-66832bb9c2b8" containerName="payload-processing"
Jul 27 21:14:19.673868 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.673733    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bea32b4d-1112-4b46-8cfb-66832bb9c2b8" containerName="payload-processing"
Jul 27 21:14:19.673868 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.673740    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7464c379-4092-4172-9a77-1ded1107262d" containerName="payload-pre-processing"
Jul 27 21:14:19.673868 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.673748    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b9390cc-90e2-4417-99cd-c2d714a9e288" containerName="maas-api"
Jul 27 21:14:19.673868 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.673755    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="558b0695-f339-476f-95cf-1740fff66b45" containerName="payload-pre-processing"
Jul 27 21:14:19.678230 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.678208    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9"
Jul 27 21:14:19.681441 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.681414    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-69909d\""
Jul 27 21:14:19.681571 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.681414    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-69909d-dockercfg-wl9rq\""
Jul 27 21:14:19.692601 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.692577    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9"]
Jul 27 21:14:19.734851 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.734818    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x"]
Jul 27 21:14:19.738252 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.738229    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x"
Jul 27 21:14:19.748296 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.748257    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x"]
Jul 27 21:14:19.782552 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.782523    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/536576e0-bc88-4213-9155-3a807c0e64f3-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9\" (UID: \"536576e0-bc88-4213-9155-3a807c0e64f3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9"
Jul 27 21:14:19.782721 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.782568    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42plm\" (UniqueName: \"kubernetes.io/projected/536576e0-bc88-4213-9155-3a807c0e64f3-kube-api-access-42plm\") pod \"payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9\" (UID: \"536576e0-bc88-4213-9155-3a807c0e64f3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9"
Jul 27 21:14:19.883581 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.883542    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9pcw\" (UniqueName: \"kubernetes.io/projected/9396334d-5b66-43d0-a8cd-6672852e1d15-kube-api-access-p9pcw\") pod \"payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x\" (UID: \"9396334d-5b66-43d0-a8cd-6672852e1d15\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x"
Jul 27 21:14:19.883785 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.883591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42plm\" (UniqueName: \"kubernetes.io/projected/536576e0-bc88-4213-9155-3a807c0e64f3-kube-api-access-42plm\") pod \"payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9\" (UID: \"536576e0-bc88-4213-9155-3a807c0e64f3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9"
Jul 27 21:14:19.883785 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.883619    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9396334d-5b66-43d0-a8cd-6672852e1d15-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x\" (UID: \"9396334d-5b66-43d0-a8cd-6672852e1d15\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x"
Jul 27 21:14:19.883785 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.883762    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/536576e0-bc88-4213-9155-3a807c0e64f3-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9\" (UID: \"536576e0-bc88-4213-9155-3a807c0e64f3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9"
Jul 27 21:14:19.884520 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.884497    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/536576e0-bc88-4213-9155-3a807c0e64f3-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9\" (UID: \"536576e0-bc88-4213-9155-3a807c0e64f3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9"
Jul 27 21:14:19.893182 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.893153    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42plm\" (UniqueName: \"kubernetes.io/projected/536576e0-bc88-4213-9155-3a807c0e64f3-kube-api-access-42plm\") pod \"payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9\" (UID: \"536576e0-bc88-4213-9155-3a807c0e64f3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9"
Jul 27 21:14:19.985032 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.984941    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9pcw\" (UniqueName: \"kubernetes.io/projected/9396334d-5b66-43d0-a8cd-6672852e1d15-kube-api-access-p9pcw\") pod \"payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x\" (UID: \"9396334d-5b66-43d0-a8cd-6672852e1d15\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x"
Jul 27 21:14:19.985032 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.984988    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9396334d-5b66-43d0-a8cd-6672852e1d15-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x\" (UID: \"9396334d-5b66-43d0-a8cd-6672852e1d15\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x"
Jul 27 21:14:19.985838 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.985811    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9396334d-5b66-43d0-a8cd-6672852e1d15-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x\" (UID: \"9396334d-5b66-43d0-a8cd-6672852e1d15\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x"
Jul 27 21:14:19.988807 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.988782    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9"
Jul 27 21:14:19.994326 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:19.994302    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9pcw\" (UniqueName: \"kubernetes.io/projected/9396334d-5b66-43d0-a8cd-6672852e1d15-kube-api-access-p9pcw\") pod \"payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x\" (UID: \"9396334d-5b66-43d0-a8cd-6672852e1d15\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x"
Jul 27 21:14:20.048976 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:20.048924    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x"
Jul 27 21:14:20.143838 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:20.143756    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9"]
Jul 27 21:14:20.145624 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:14:20.145592    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod536576e0_bc88_4213_9155_3a807c0e64f3.slice/crio-8005f156dc1b57c0413a480b328d4fd48e105f4f0d39e2d2380b2901f29a5544 WatchSource:0}: Error finding container 8005f156dc1b57c0413a480b328d4fd48e105f4f0d39e2d2380b2901f29a5544: Status 404 returned error can't find the container with id 8005f156dc1b57c0413a480b328d4fd48e105f4f0d39e2d2380b2901f29a5544
Jul 27 21:14:20.197160 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:20.197135    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x"]
Jul 27 21:14:20.203667 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:14:20.203646    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9396334d_5b66_43d0_a8cd_6672852e1d15.slice/crio-0d4f0866dfd8d4653ac12060a0d2d3ff47fe4560aa9a68de638584b22efc83ab WatchSource:0}: Error finding container 0d4f0866dfd8d4653ac12060a0d2d3ff47fe4560aa9a68de638584b22efc83ab: Status 404 returned error can't find the container with id 0d4f0866dfd8d4653ac12060a0d2d3ff47fe4560aa9a68de638584b22efc83ab
Jul 27 21:14:20.473698 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:20.473663    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9" event={"ID":"536576e0-bc88-4213-9155-3a807c0e64f3","Type":"ContainerStarted","Data":"13b51c74312c93504ed2232d495d8feb91836c530fad53e59b90a339862b7484"}
Jul 27 21:14:20.473905 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:20.473727    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9" event={"ID":"536576e0-bc88-4213-9155-3a807c0e64f3","Type":"ContainerStarted","Data":"8005f156dc1b57c0413a480b328d4fd48e105f4f0d39e2d2380b2901f29a5544"}
Jul 27 21:14:20.473905 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:20.473885    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9"
Jul 27 21:14:20.475330 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:20.475307    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x" event={"ID":"9396334d-5b66-43d0-a8cd-6672852e1d15","Type":"ContainerStarted","Data":"a19199adf4fb80dbbdb50580eb5d1ec92956ebe192b2e399b4bee8cdc8fedb21"}
Jul 27 21:14:20.475449 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:20.475344    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x" event={"ID":"9396334d-5b66-43d0-a8cd-6672852e1d15","Type":"ContainerStarted","Data":"0d4f0866dfd8d4653ac12060a0d2d3ff47fe4560aa9a68de638584b22efc83ab"}
Jul 27 21:14:20.475449 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:20.475392    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x"
Jul 27 21:14:20.494170 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:20.494094    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9" podStartSLOduration=1.4940805529999999 podStartE2EDuration="1.494080553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:14:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:14:20.492192538 +0000 UTC m=+2400.132408977" watchObservedRunningTime="2026-07-27 21:14:20.494080553 +0000 UTC m=+2400.134296991"
Jul 27 21:14:20.511151 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:20.511101    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x" podStartSLOduration=1.511092224 podStartE2EDuration="1.511092224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:14:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:14:20.510019788 +0000 UTC m=+2400.150236231" watchObservedRunningTime="2026-07-27 21:14:20.511092224 +0000 UTC m=+2400.151308663"
Jul 27 21:14:20.979931 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:20.979900    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 21:14:20.983908 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:20.983886    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 21:14:20.986088 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:20.986067    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 21:14:20.990244 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:20.990222    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 21:14:20.995757 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:20.995731    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 21:14:20.999505 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:20.999488    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 21:14:27.530978 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:27.530897    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p"]
Jul 27 21:14:27.535918 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:27.535896    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p"
Jul 27 21:14:27.538326 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:27.538303    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-ba2511-dockercfg-p7j48\""
Jul 27 21:14:27.538476 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:27.538332    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-ba2511\""
Jul 27 21:14:27.543856 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:27.543833    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p"]
Jul 27 21:14:27.554373 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:27.554349    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13c2dff6-cefd-4684-996d-e318ad3cb843-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p\" (UID: \"13c2dff6-cefd-4684-996d-e318ad3cb843\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p"
Jul 27 21:14:27.554502 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:27.554455    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4kqk\" (UniqueName: \"kubernetes.io/projected/13c2dff6-cefd-4684-996d-e318ad3cb843-kube-api-access-p4kqk\") pod \"payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p\" (UID: \"13c2dff6-cefd-4684-996d-e318ad3cb843\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p"
Jul 27 21:14:27.654989 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:27.654953    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4kqk\" (UniqueName: \"kubernetes.io/projected/13c2dff6-cefd-4684-996d-e318ad3cb843-kube-api-access-p4kqk\") pod \"payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p\" (UID: \"13c2dff6-cefd-4684-996d-e318ad3cb843\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p"
Jul 27 21:14:27.655175 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:27.655049    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13c2dff6-cefd-4684-996d-e318ad3cb843-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p\" (UID: \"13c2dff6-cefd-4684-996d-e318ad3cb843\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p"
Jul 27 21:14:27.655801 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:27.655779    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13c2dff6-cefd-4684-996d-e318ad3cb843-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p\" (UID: \"13c2dff6-cefd-4684-996d-e318ad3cb843\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p"
Jul 27 21:14:27.682945 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:27.682915    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4kqk\" (UniqueName: \"kubernetes.io/projected/13c2dff6-cefd-4684-996d-e318ad3cb843-kube-api-access-p4kqk\") pod \"payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p\" (UID: \"13c2dff6-cefd-4684-996d-e318ad3cb843\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p"
Jul 27 21:14:27.849053 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:27.849022    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p"
Jul 27 21:14:28.200752 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:28.200723    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p"]
Jul 27 21:14:28.202084 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:14:28.202050    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c2dff6_cefd_4684_996d_e318ad3cb843.slice/crio-742c1d8a8c5e89fec06913b37175434c46dd307aaf455765a25be1043691ad65 WatchSource:0}: Error finding container 742c1d8a8c5e89fec06913b37175434c46dd307aaf455765a25be1043691ad65: Status 404 returned error can't find the container with id 742c1d8a8c5e89fec06913b37175434c46dd307aaf455765a25be1043691ad65
Jul 27 21:14:28.517058 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:28.516972    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p" event={"ID":"13c2dff6-cefd-4684-996d-e318ad3cb843","Type":"ContainerStarted","Data":"3fc1cace523e23991c83b7ec23133d06c726d2e2c671b20ddae503f1958e2990"}
Jul 27 21:14:28.517058 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:28.517024    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p" event={"ID":"13c2dff6-cefd-4684-996d-e318ad3cb843","Type":"ContainerStarted","Data":"742c1d8a8c5e89fec06913b37175434c46dd307aaf455765a25be1043691ad65"}
Jul 27 21:14:28.517244 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:28.517087    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p"
Jul 27 21:14:28.534419 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:28.534374    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p" podStartSLOduration=1.5343624980000001 podStartE2EDuration="1.534362498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:14:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:14:28.532934131 +0000 UTC m=+2408.173150598" watchObservedRunningTime="2026-07-27 21:14:28.534362498 +0000 UTC m=+2408.174578937"
Jul 27 21:14:31.482620 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:31.482595    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9"
Jul 27 21:14:31.482995 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:31.482659    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x"
Jul 27 21:14:39.524177 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:14:39.524146    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p"
Jul 27 21:19:21.010864 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:19:21.010788    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 21:19:21.016117 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:19:21.016093    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 21:19:21.016256 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:19:21.016126    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 21:19:21.021851 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:19:21.021831    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 21:19:21.024856 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:19:21.024836    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 21:19:21.029487 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:19:21.029472    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 21:23:01.451400 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.451358    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj"]
Jul 27 21:23:01.454892 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.454874    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj"
Jul 27 21:23:01.457900 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.457871    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-91a310\""
Jul 27 21:23:01.463888 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.463864    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj"]
Jul 27 21:23:01.493139 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.493107    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4"]
Jul 27 21:23:01.498573 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.498550    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4"
Jul 27 21:23:01.501421 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.501390    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-91a310-dockercfg-sgc8w\""
Jul 27 21:23:01.506146 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.506127    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4"]
Jul 27 21:23:01.524795 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.524774    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6b6w\" (UniqueName: \"kubernetes.io/projected/e60c46e0-8fd9-4a61-a85c-7f0a745de818-kube-api-access-c6b6w\") pod \"payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4\" (UID: \"e60c46e0-8fd9-4a61-a85c-7f0a745de818\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4"
Jul 27 21:23:01.524894 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.524824    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e60c46e0-8fd9-4a61-a85c-7f0a745de818-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4\" (UID: \"e60c46e0-8fd9-4a61-a85c-7f0a745de818\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4"
Jul 27 21:23:01.625832 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.625795    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35312b30-2999-4240-8a9f-eb5948674955-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj\" (UID: \"35312b30-2999-4240-8a9f-eb5948674955\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj"
Jul 27 21:23:01.626008 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.625859    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlvpv\" (UniqueName: \"kubernetes.io/projected/35312b30-2999-4240-8a9f-eb5948674955-kube-api-access-wlvpv\") pod \"payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj\" (UID: \"35312b30-2999-4240-8a9f-eb5948674955\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj"
Jul 27 21:23:01.626008 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.625888    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6b6w\" (UniqueName: \"kubernetes.io/projected/e60c46e0-8fd9-4a61-a85c-7f0a745de818-kube-api-access-c6b6w\") pod \"payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4\" (UID: \"e60c46e0-8fd9-4a61-a85c-7f0a745de818\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4"
Jul 27 21:23:01.626008 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.625934    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e60c46e0-8fd9-4a61-a85c-7f0a745de818-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4\" (UID: \"e60c46e0-8fd9-4a61-a85c-7f0a745de818\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4"
Jul 27 21:23:01.626590 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.626571    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e60c46e0-8fd9-4a61-a85c-7f0a745de818-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4\" (UID: \"e60c46e0-8fd9-4a61-a85c-7f0a745de818\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4"
Jul 27 21:23:01.635573 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.635540    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6b6w\" (UniqueName: \"kubernetes.io/projected/e60c46e0-8fd9-4a61-a85c-7f0a745de818-kube-api-access-c6b6w\") pod \"payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4\" (UID: \"e60c46e0-8fd9-4a61-a85c-7f0a745de818\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4"
Jul 27 21:23:01.727247 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.727173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlvpv\" (UniqueName: \"kubernetes.io/projected/35312b30-2999-4240-8a9f-eb5948674955-kube-api-access-wlvpv\") pod \"payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj\" (UID: \"35312b30-2999-4240-8a9f-eb5948674955\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj"
Jul 27 21:23:01.727380 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.727247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35312b30-2999-4240-8a9f-eb5948674955-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj\" (UID: \"35312b30-2999-4240-8a9f-eb5948674955\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj"
Jul 27 21:23:01.727879 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.727859    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35312b30-2999-4240-8a9f-eb5948674955-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj\" (UID: \"35312b30-2999-4240-8a9f-eb5948674955\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj"
Jul 27 21:23:01.735120 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.735091    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlvpv\" (UniqueName: \"kubernetes.io/projected/35312b30-2999-4240-8a9f-eb5948674955-kube-api-access-wlvpv\") pod \"payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj\" (UID: \"35312b30-2999-4240-8a9f-eb5948674955\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj"
Jul 27 21:23:01.766841 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.766811    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj"
Jul 27 21:23:01.810367 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.810335    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4"
Jul 27 21:23:01.922175 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:23:01.922144    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35312b30_2999_4240_8a9f_eb5948674955.slice/crio-6f084a0e0bd6097bd9c96cc7ea83236712714e6e9a36c8d7ff8f17694cf9c754 WatchSource:0}: Error finding container 6f084a0e0bd6097bd9c96cc7ea83236712714e6e9a36c8d7ff8f17694cf9c754: Status 404 returned error can't find the container with id 6f084a0e0bd6097bd9c96cc7ea83236712714e6e9a36c8d7ff8f17694cf9c754
Jul 27 21:23:01.922496 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:01.922465    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj"]
Jul 27 21:23:02.015994 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:02.015963    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj" event={"ID":"35312b30-2999-4240-8a9f-eb5948674955","Type":"ContainerStarted","Data":"b3fce66f384218303d04561e7e464447349141a2188fc1ef2ff229e36bca8bc8"}
Jul 27 21:23:02.016111 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:02.016018    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj"
Jul 27 21:23:02.016111 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:02.016034    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj" event={"ID":"35312b30-2999-4240-8a9f-eb5948674955","Type":"ContainerStarted","Data":"6f084a0e0bd6097bd9c96cc7ea83236712714e6e9a36c8d7ff8f17694cf9c754"}
Jul 27 21:23:02.035529 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:02.035489    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj" podStartSLOduration=1.035475114 podStartE2EDuration="1.035475114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:23:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:23:02.0336553 +0000 UTC m=+2921.673871758" watchObservedRunningTime="2026-07-27 21:23:02.035475114 +0000 UTC m=+2921.675691553"
Jul 27 21:23:02.175284 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:02.175243    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4"]
Jul 27 21:23:02.176459 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:23:02.176432    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode60c46e0_8fd9_4a61_a85c_7f0a745de818.slice/crio-9bebdce7306e332f4344b1f007fdf70f805ce838b904201e943722aa60e9acca WatchSource:0}: Error finding container 9bebdce7306e332f4344b1f007fdf70f805ce838b904201e943722aa60e9acca: Status 404 returned error can't find the container with id 9bebdce7306e332f4344b1f007fdf70f805ce838b904201e943722aa60e9acca
Jul 27 21:23:03.022887 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:03.022848    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4" event={"ID":"e60c46e0-8fd9-4a61-a85c-7f0a745de818","Type":"ContainerStarted","Data":"67c42e9dcdce979063ce7792e0405c84c657e31c482868fc586788c2db54383b"}
Jul 27 21:23:03.023395 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:03.022912    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4" event={"ID":"e60c46e0-8fd9-4a61-a85c-7f0a745de818","Type":"ContainerStarted","Data":"9bebdce7306e332f4344b1f007fdf70f805ce838b904201e943722aa60e9acca"}
Jul 27 21:23:03.023395 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:03.022945    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4"
Jul 27 21:23:03.039923 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:03.039880    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4" podStartSLOduration=2.039865153 podStartE2EDuration="2.039865153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:23:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:23:03.038962051 +0000 UTC m=+2922.679178490" watchObservedRunningTime="2026-07-27 21:23:03.039865153 +0000 UTC m=+2922.680081591"
Jul 27 21:23:13.026101 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:13.026068    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj"
Jul 27 21:23:14.029900 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:14.029867    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4"
Jul 27 21:23:22.922462 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:22.922428    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"]
Jul 27 21:23:22.927386 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:22.927369    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"
Jul 27 21:23:22.931569 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:22.931541    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-85c5ed-serving-cert\""
Jul 27 21:23:22.949351 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:22.949299    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"]
Jul 27 21:23:23.013737 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:23.013702    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a2b4412-23a1-488f-8908-fff4f43ff856-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k\" (UID: \"2a2b4412-23a1-488f-8908-fff4f43ff856\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"
Jul 27 21:23:23.013737 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:23.013736    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwswb\" (UniqueName: \"kubernetes.io/projected/2a2b4412-23a1-488f-8908-fff4f43ff856-kube-api-access-fwswb\") pod \"maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k\" (UID: \"2a2b4412-23a1-488f-8908-fff4f43ff856\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"
Jul 27 21:23:23.013972 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:23.013835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a2b4412-23a1-488f-8908-fff4f43ff856-maas-api-tls\") pod \"maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k\" (UID: \"2a2b4412-23a1-488f-8908-fff4f43ff856\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"
Jul 27 21:23:23.115213 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:23.115181    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a2b4412-23a1-488f-8908-fff4f43ff856-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k\" (UID: \"2a2b4412-23a1-488f-8908-fff4f43ff856\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"
Jul 27 21:23:23.115213 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:23.115217    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwswb\" (UniqueName: \"kubernetes.io/projected/2a2b4412-23a1-488f-8908-fff4f43ff856-kube-api-access-fwswb\") pod \"maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k\" (UID: \"2a2b4412-23a1-488f-8908-fff4f43ff856\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"
Jul 27 21:23:23.115499 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:23.115247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a2b4412-23a1-488f-8908-fff4f43ff856-maas-api-tls\") pod \"maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k\" (UID: \"2a2b4412-23a1-488f-8908-fff4f43ff856\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"
Jul 27 21:23:23.115499 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:23:23.115362    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-serving-cert: secret "maas-api-e2e-ipp-b-85c5ed-serving-cert" not found
Jul 27 21:23:23.115499 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:23:23.115427    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a2b4412-23a1-488f-8908-fff4f43ff856-maas-api-tls podName:2a2b4412-23a1-488f-8908-fff4f43ff856 nodeName:}" failed. No retries permitted until 2026-07-27 21:23:23.615409041 +0000 UTC m=+2943.255625458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2a2b4412-23a1-488f-8908-fff4f43ff856-maas-api-tls") pod "maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k" (UID: "2a2b4412-23a1-488f-8908-fff4f43ff856") : secret "maas-api-e2e-ipp-b-85c5ed-serving-cert" not found
Jul 27 21:23:23.115818 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:23.115798    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a2b4412-23a1-488f-8908-fff4f43ff856-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k\" (UID: \"2a2b4412-23a1-488f-8908-fff4f43ff856\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"
Jul 27 21:23:23.129209 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:23.129163    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwswb\" (UniqueName: \"kubernetes.io/projected/2a2b4412-23a1-488f-8908-fff4f43ff856-kube-api-access-fwswb\") pod \"maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k\" (UID: \"2a2b4412-23a1-488f-8908-fff4f43ff856\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"
Jul 27 21:23:23.620955 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:23.620919    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a2b4412-23a1-488f-8908-fff4f43ff856-maas-api-tls\") pod \"maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k\" (UID: \"2a2b4412-23a1-488f-8908-fff4f43ff856\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"
Jul 27 21:23:23.623364 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:23.623331    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a2b4412-23a1-488f-8908-fff4f43ff856-maas-api-tls\") pod \"maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k\" (UID: \"2a2b4412-23a1-488f-8908-fff4f43ff856\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"
Jul 27 21:23:23.837629 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:23.837567    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"
Jul 27 21:23:23.987380 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:23.987352    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"]
Jul 27 21:23:23.990337 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:23:23.990304    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a2b4412_23a1_488f_8908_fff4f43ff856.slice/crio-f3dd0a2f6c441101c920d69c512d14a9a2c936fa2759b9a6f4767f94602ed403 WatchSource:0}: Error finding container f3dd0a2f6c441101c920d69c512d14a9a2c936fa2759b9a6f4767f94602ed403: Status 404 returned error can't find the container with id f3dd0a2f6c441101c920d69c512d14a9a2c936fa2759b9a6f4767f94602ed403
Jul 27 21:23:23.991841 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:23.991825    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:23:24.106037 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.106009    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5"]
Jul 27 21:23:24.110840 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.110825    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5"
Jul 27 21:23:24.116395 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.116370    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-85c5ed-dockercfg-pcx6l\""
Jul 27 21:23:24.116395 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.116388    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-85c5ed\""
Jul 27 21:23:24.123281 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.123246    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5"]
Jul 27 21:23:24.140153 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.140129    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k" event={"ID":"2a2b4412-23a1-488f-8908-fff4f43ff856","Type":"ContainerStarted","Data":"f3dd0a2f6c441101c920d69c512d14a9a2c936fa2759b9a6f4767f94602ed403"}
Jul 27 21:23:24.195962 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.195882    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz"]
Jul 27 21:23:24.199544 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.199523    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz"
Jul 27 21:23:24.228005 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.227970    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2p5w\" (UniqueName: \"kubernetes.io/projected/4d299f32-89b5-459c-ad6d-4dc954acfcea-kube-api-access-m2p5w\") pod \"payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5\" (UID: \"4d299f32-89b5-459c-ad6d-4dc954acfcea\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5"
Jul 27 21:23:24.228429 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.228409    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d299f32-89b5-459c-ad6d-4dc954acfcea-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5\" (UID: \"4d299f32-89b5-459c-ad6d-4dc954acfcea\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5"
Jul 27 21:23:24.229588 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.228298    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz"]
Jul 27 21:23:24.330401 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.330368    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2p5w\" (UniqueName: \"kubernetes.io/projected/4d299f32-89b5-459c-ad6d-4dc954acfcea-kube-api-access-m2p5w\") pod \"payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5\" (UID: \"4d299f32-89b5-459c-ad6d-4dc954acfcea\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5"
Jul 27 21:23:24.330594 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.330517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d299f32-89b5-459c-ad6d-4dc954acfcea-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5\" (UID: \"4d299f32-89b5-459c-ad6d-4dc954acfcea\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5"
Jul 27 21:23:24.330594 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.330565    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz\" (UID: \"98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz"
Jul 27 21:23:24.330709 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.330602    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2222b\" (UniqueName: \"kubernetes.io/projected/98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf-kube-api-access-2222b\") pod \"payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz\" (UID: \"98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz"
Jul 27 21:23:24.331218 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.331197    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d299f32-89b5-459c-ad6d-4dc954acfcea-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5\" (UID: \"4d299f32-89b5-459c-ad6d-4dc954acfcea\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5"
Jul 27 21:23:24.339645 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.339615    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2p5w\" (UniqueName: \"kubernetes.io/projected/4d299f32-89b5-459c-ad6d-4dc954acfcea-kube-api-access-m2p5w\") pod \"payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5\" (UID: \"4d299f32-89b5-459c-ad6d-4dc954acfcea\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5"
Jul 27 21:23:24.422385 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.422350    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5"
Jul 27 21:23:24.431796 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.431768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz\" (UID: \"98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz"
Jul 27 21:23:24.431915 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.431820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2222b\" (UniqueName: \"kubernetes.io/projected/98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf-kube-api-access-2222b\") pod \"payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz\" (UID: \"98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz"
Jul 27 21:23:24.432409 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.432390    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz\" (UID: \"98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz"
Jul 27 21:23:24.439940 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.439914    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2222b\" (UniqueName: \"kubernetes.io/projected/98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf-kube-api-access-2222b\") pod \"payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz\" (UID: \"98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz"
Jul 27 21:23:24.512374 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.512338    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz"
Jul 27 21:23:24.571063 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.571032    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5"]
Jul 27 21:23:24.573991 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:23:24.573951    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d299f32_89b5_459c_ad6d_4dc954acfcea.slice/crio-e2d35f30aa95b0e8f83cdd9cdc6bd83476bf9fbb5eff412f484e85089da86790 WatchSource:0}: Error finding container e2d35f30aa95b0e8f83cdd9cdc6bd83476bf9fbb5eff412f484e85089da86790: Status 404 returned error can't find the container with id e2d35f30aa95b0e8f83cdd9cdc6bd83476bf9fbb5eff412f484e85089da86790
Jul 27 21:23:24.879792 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:24.879769    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz"]
Jul 27 21:23:24.881434 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:23:24.881407    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a9a00d_51ea_4f59_bfa4_2828d8e3ceaf.slice/crio-0ec5a2965896a65a113c738400a7c637371bb5583c5cc7234f617f4822c6dfff WatchSource:0}: Error finding container 0ec5a2965896a65a113c738400a7c637371bb5583c5cc7234f617f4822c6dfff: Status 404 returned error can't find the container with id 0ec5a2965896a65a113c738400a7c637371bb5583c5cc7234f617f4822c6dfff
Jul 27 21:23:25.147189 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:25.147086    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz" event={"ID":"98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf","Type":"ContainerStarted","Data":"08a7b1c39ef44bbb13b0040f037678feb23f7513eaed086712d25620aa1cdd49"}
Jul 27 21:23:25.147189 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:25.147150    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz" event={"ID":"98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf","Type":"ContainerStarted","Data":"0ec5a2965896a65a113c738400a7c637371bb5583c5cc7234f617f4822c6dfff"}
Jul 27 21:23:25.147691 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:25.147294    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz"
Jul 27 21:23:25.148933 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:25.148903    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5" event={"ID":"4d299f32-89b5-459c-ad6d-4dc954acfcea","Type":"ContainerStarted","Data":"893616e4763df76b0f4f0065e87ebb420b19b6add7deb006e278cd49af0c009a"}
Jul 27 21:23:25.149077 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:25.148957    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5"
Jul 27 21:23:25.149077 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:25.148983    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5" event={"ID":"4d299f32-89b5-459c-ad6d-4dc954acfcea","Type":"ContainerStarted","Data":"e2d35f30aa95b0e8f83cdd9cdc6bd83476bf9fbb5eff412f484e85089da86790"}
Jul 27 21:23:25.150510 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:25.150479    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k" event={"ID":"2a2b4412-23a1-488f-8908-fff4f43ff856","Type":"ContainerStarted","Data":"b763b2da1362245f5c8929d74fff9bd0797502048ae3f27703b38495f8b0d846"}
Jul 27 21:23:25.150622 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:25.150544    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"
Jul 27 21:23:25.165827 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:25.165781    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz" podStartSLOduration=1.1657631450000001 podStartE2EDuration="1.165763145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:23:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:23:25.163083759 +0000 UTC m=+2944.803300218" watchObservedRunningTime="2026-07-27 21:23:25.165763145 +0000 UTC m=+2944.805979563"
Jul 27 21:23:25.180950 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:25.180907    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k" podStartSLOduration=2.773357869 podStartE2EDuration="3.180892844s" totalImagesPullingTime="407.534975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:23:25.179849004 +0000 UTC m=+2944.820065463" watchObservedRunningTime="2026-07-27 21:23:25.180892844 +0000 UTC m=+2944.821109323"
Jul 27 21:23:25.196865 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:25.196825    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5" podStartSLOduration=1.196811449 podStartE2EDuration="1.196811449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:23:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:23:25.196509643 +0000 UTC m=+2944.836726106" watchObservedRunningTime="2026-07-27 21:23:25.196811449 +0000 UTC m=+2944.837027888"
Jul 27 21:23:31.162079 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:31.162048    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"
Jul 27 21:23:36.159017 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:36.158988    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5"
Jul 27 21:23:36.159586 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:36.159058    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz"
Jul 27 21:23:44.726526 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:23:44.726453    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz_98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf/payload-processing/0.log"
Jul 27 21:24:21.041722 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:21.041610    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 21:24:21.047303 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:21.047282    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 21:24:21.048131 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:21.048108    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 21:24:21.053675 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:21.053657    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 21:24:21.056383 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:21.056367    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 21:24:21.062024 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:21.062009    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fphdr_70668bca-b3aa-4da9-a1a5-49c08d8abf0b/ovn-acl-logging/0.log"
Jul 27 21:24:47.097232 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:47.097193    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4_e60c46e0-8fd9-4a61-a85c-7f0a745de818/payload-processing/0.log"
Jul 27 21:24:47.359114 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:47.359041    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz_98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf/payload-processing/0.log"
Jul 27 21:24:51.342375 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:51.342339    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"]
Jul 27 21:24:51.346696 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:51.346676    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"
Jul 27 21:24:51.348974 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:51.348944    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-baf2d2-serving-cert\""
Jul 27 21:24:51.354018 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:51.353990    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"]
Jul 27 21:24:51.394167 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:51.394138    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5\" (UID: \"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"
Jul 27 21:24:51.394339 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:51.394173    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5\" (UID: \"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"
Jul 27 21:24:51.394339 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:51.394190    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbl5r\" (UniqueName: \"kubernetes.io/projected/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a-kube-api-access-fbl5r\") pod \"maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5\" (UID: \"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"
Jul 27 21:24:51.495683 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:51.495653    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5\" (UID: \"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"
Jul 27 21:24:51.495857 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:51.495691    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5\" (UID: \"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"
Jul 27 21:24:51.495857 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:51.495709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbl5r\" (UniqueName: \"kubernetes.io/projected/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a-kube-api-access-fbl5r\") pod \"maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5\" (UID: \"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"
Jul 27 21:24:51.496333 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:51.496310    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5\" (UID: \"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"
Jul 27 21:24:51.498170 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:51.498145    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5\" (UID: \"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"
Jul 27 21:24:51.505211 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:51.505184    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbl5r\" (UniqueName: \"kubernetes.io/projected/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a-kube-api-access-fbl5r\") pod \"maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5\" (UID: \"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"
Jul 27 21:24:51.661540 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:51.661436    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"
Jul 27 21:24:51.838266 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:51.838232    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"]
Jul 27 21:24:51.839893 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:24:51.839852    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce10e958_89cb_494e_b17a_9a7d0c8a3b0a.slice/crio-d2c4f4f5f481ca6bab6c39a899f4080a9cddbbfdd817f6bb68b270b3f43e9ecf WatchSource:0}: Error finding container d2c4f4f5f481ca6bab6c39a899f4080a9cddbbfdd817f6bb68b270b3f43e9ecf: Status 404 returned error can't find the container with id d2c4f4f5f481ca6bab6c39a899f4080a9cddbbfdd817f6bb68b270b3f43e9ecf
Jul 27 21:24:52.363419 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:52.363391    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq"]
Jul 27 21:24:52.367328 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:52.367304    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq"
Jul 27 21:24:52.370569 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:52.370547    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-baf2d2\""
Jul 27 21:24:52.370569 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:52.370561    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-baf2d2-dockercfg-5k8gl\""
Jul 27 21:24:52.382538 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:52.382502    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq"]
Jul 27 21:24:52.402145 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:52.402119    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvvmd\" (UniqueName: \"kubernetes.io/projected/01543c12-6b2d-46b0-8c51-4c892adc674c-kube-api-access-bvvmd\") pod \"payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq\" (UID: \"01543c12-6b2d-46b0-8c51-4c892adc674c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq"
Jul 27 21:24:52.402284 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:52.402167    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01543c12-6b2d-46b0-8c51-4c892adc674c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq\" (UID: \"01543c12-6b2d-46b0-8c51-4c892adc674c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq"
Jul 27 21:24:52.503682 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:52.503652    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvvmd\" (UniqueName: \"kubernetes.io/projected/01543c12-6b2d-46b0-8c51-4c892adc674c-kube-api-access-bvvmd\") pod \"payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq\" (UID: \"01543c12-6b2d-46b0-8c51-4c892adc674c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq"
Jul 27 21:24:52.503845 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:52.503693    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01543c12-6b2d-46b0-8c51-4c892adc674c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq\" (UID: \"01543c12-6b2d-46b0-8c51-4c892adc674c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq"
Jul 27 21:24:52.504339 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:52.504323    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01543c12-6b2d-46b0-8c51-4c892adc674c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq\" (UID: \"01543c12-6b2d-46b0-8c51-4c892adc674c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq"
Jul 27 21:24:52.512016 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:52.511994    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvvmd\" (UniqueName: \"kubernetes.io/projected/01543c12-6b2d-46b0-8c51-4c892adc674c-kube-api-access-bvvmd\") pod \"payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq\" (UID: \"01543c12-6b2d-46b0-8c51-4c892adc674c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq"
Jul 27 21:24:52.621062 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:52.620969    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5" event={"ID":"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a","Type":"ContainerStarted","Data":"caf9c0ca6597b1b40acb962bac7fff651e05218a852493d53e2b6452fcddf784"}
Jul 27 21:24:52.621062 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:52.621021    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5" event={"ID":"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a","Type":"ContainerStarted","Data":"d2c4f4f5f481ca6bab6c39a899f4080a9cddbbfdd817f6bb68b270b3f43e9ecf"}
Jul 27 21:24:52.621248 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:52.621117    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"
Jul 27 21:24:52.654133 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:52.654083    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5" podStartSLOduration=1.143024809 podStartE2EDuration="1.654068408s" totalImagesPullingTime="511.043599ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:24:52.651096562 +0000 UTC m=+3032.291313054" watchObservedRunningTime="2026-07-27 21:24:52.654068408 +0000 UTC m=+3032.294284847"
Jul 27 21:24:52.692840 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:52.692813    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq"
Jul 27 21:24:53.050763 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:53.050733    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq"]
Jul 27 21:24:53.051331 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:24:53.051302    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01543c12_6b2d_46b0_8c51_4c892adc674c.slice/crio-549a8acb3d9bb3550f54dd4482c6ba330ade698d1204d952fba864253cd6f7d6 WatchSource:0}: Error finding container 549a8acb3d9bb3550f54dd4482c6ba330ade698d1204d952fba864253cd6f7d6: Status 404 returned error can't find the container with id 549a8acb3d9bb3550f54dd4482c6ba330ade698d1204d952fba864253cd6f7d6
Jul 27 21:24:53.627619 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:53.627585    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq" event={"ID":"01543c12-6b2d-46b0-8c51-4c892adc674c","Type":"ContainerStarted","Data":"a8c54e556d58d54102599a0dd9e647d33adf171d63f8ed6bc22daed6f6181e1f"}
Jul 27 21:24:53.628109 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:53.627641    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq" event={"ID":"01543c12-6b2d-46b0-8c51-4c892adc674c","Type":"ContainerStarted","Data":"549a8acb3d9bb3550f54dd4482c6ba330ade698d1204d952fba864253cd6f7d6"}
Jul 27 21:24:53.628109 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:53.627829    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq"
Jul 27 21:24:53.647607 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:53.647563    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq" podStartSLOduration=1.647548949 podStartE2EDuration="1.647548949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:24:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:24:53.645818377 +0000 UTC m=+3033.286034817" watchObservedRunningTime="2026-07-27 21:24:53.647548949 +0000 UTC m=+3033.287765386"
Jul 27 21:24:58.633504 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:24:58.633472    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"
Jul 27 21:25:04.634817 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:04.634788    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq"
Jul 27 21:25:17.059315 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.059208    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"]
Jul 27 21:25:17.059761 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.059465    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5" podUID="ce10e958-89cb-494e-b17a-9a7d0c8a3b0a" containerName="maas-api" containerID="cri-o://caf9c0ca6597b1b40acb962bac7fff651e05218a852493d53e2b6452fcddf784" gracePeriod=30
Jul 27 21:25:17.122571 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.122538    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq"]
Jul 27 21:25:17.122845 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.122817    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq" podUID="01543c12-6b2d-46b0-8c51-4c892adc674c" containerName="payload-processing" containerID="cri-o://a8c54e556d58d54102599a0dd9e647d33adf171d63f8ed6bc22daed6f6181e1f" gracePeriod=30
Jul 27 21:25:17.385000 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.384979    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"
Jul 27 21:25:17.428952 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.428924    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq"
Jul 27 21:25:17.436348 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.436323    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbl5r\" (UniqueName: \"kubernetes.io/projected/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a-kube-api-access-fbl5r\") pod \"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a\" (UID: \"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a\") "
Jul 27 21:25:17.436448 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.436399    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a-openshift-service-ca\") pod \"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a\" (UID: \"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a\") "
Jul 27 21:25:17.436448 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.436425    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a-maas-api-tls\") pod \"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a\" (UID: \"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a\") "
Jul 27 21:25:17.436752 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.436730    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ce10e958-89cb-494e-b17a-9a7d0c8a3b0a" (UID: "ce10e958-89cb-494e-b17a-9a7d0c8a3b0a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:25:17.438471 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.438444    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ce10e958-89cb-494e-b17a-9a7d0c8a3b0a" (UID: "ce10e958-89cb-494e-b17a-9a7d0c8a3b0a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:25:17.438471 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.438459    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a-kube-api-access-fbl5r" (OuterVolumeSpecName: "kube-api-access-fbl5r") pod "ce10e958-89cb-494e-b17a-9a7d0c8a3b0a" (UID: "ce10e958-89cb-494e-b17a-9a7d0c8a3b0a"). InnerVolumeSpecName "kube-api-access-fbl5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:25:17.537122 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.537088    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01543c12-6b2d-46b0-8c51-4c892adc674c-plugins-config-volume\") pod \"01543c12-6b2d-46b0-8c51-4c892adc674c\" (UID: \"01543c12-6b2d-46b0-8c51-4c892adc674c\") "
Jul 27 21:25:17.537329 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.537128    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvvmd\" (UniqueName: \"kubernetes.io/projected/01543c12-6b2d-46b0-8c51-4c892adc674c-kube-api-access-bvvmd\") pod \"01543c12-6b2d-46b0-8c51-4c892adc674c\" (UID: \"01543c12-6b2d-46b0-8c51-4c892adc674c\") "
Jul 27 21:25:17.537421 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.537396    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbl5r\" (UniqueName: \"kubernetes.io/projected/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a-kube-api-access-fbl5r\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:25:17.537496 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.537426    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:25:17.537496 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.537440    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:25:17.537496 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.537443    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01543c12-6b2d-46b0-8c51-4c892adc674c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "01543c12-6b2d-46b0-8c51-4c892adc674c" (UID: "01543c12-6b2d-46b0-8c51-4c892adc674c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:25:17.539147 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.539128    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01543c12-6b2d-46b0-8c51-4c892adc674c-kube-api-access-bvvmd" (OuterVolumeSpecName: "kube-api-access-bvvmd") pod "01543c12-6b2d-46b0-8c51-4c892adc674c" (UID: "01543c12-6b2d-46b0-8c51-4c892adc674c"). InnerVolumeSpecName "kube-api-access-bvvmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:25:17.638256 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.638159    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01543c12-6b2d-46b0-8c51-4c892adc674c-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:25:17.638256 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.638200    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvvmd\" (UniqueName: \"kubernetes.io/projected/01543c12-6b2d-46b0-8c51-4c892adc674c-kube-api-access-bvvmd\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:25:17.755758 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.755723    2562 generic.go:356] "Generic (PLEG): container finished" podID="ce10e958-89cb-494e-b17a-9a7d0c8a3b0a" containerID="caf9c0ca6597b1b40acb962bac7fff651e05218a852493d53e2b6452fcddf784" exitCode=0
Jul 27 21:25:17.755948 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.755764    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"
Jul 27 21:25:17.755948 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.755808    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5" event={"ID":"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a","Type":"ContainerDied","Data":"caf9c0ca6597b1b40acb962bac7fff651e05218a852493d53e2b6452fcddf784"}
Jul 27 21:25:17.755948 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.755864    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5" event={"ID":"ce10e958-89cb-494e-b17a-9a7d0c8a3b0a","Type":"ContainerDied","Data":"d2c4f4f5f481ca6bab6c39a899f4080a9cddbbfdd817f6bb68b270b3f43e9ecf"}
Jul 27 21:25:17.755948 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.755894    2562 scope.go:117] "RemoveContainer" containerID="caf9c0ca6597b1b40acb962bac7fff651e05218a852493d53e2b6452fcddf784"
Jul 27 21:25:17.757096 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.757070    2562 generic.go:356] "Generic (PLEG): container finished" podID="01543c12-6b2d-46b0-8c51-4c892adc674c" containerID="a8c54e556d58d54102599a0dd9e647d33adf171d63f8ed6bc22daed6f6181e1f" exitCode=0
Jul 27 21:25:17.757209 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.757105    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq" event={"ID":"01543c12-6b2d-46b0-8c51-4c892adc674c","Type":"ContainerDied","Data":"a8c54e556d58d54102599a0dd9e647d33adf171d63f8ed6bc22daed6f6181e1f"}
Jul 27 21:25:17.757209 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.757124    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq"
Jul 27 21:25:17.757209 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.757202    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq" event={"ID":"01543c12-6b2d-46b0-8c51-4c892adc674c","Type":"ContainerDied","Data":"549a8acb3d9bb3550f54dd4482c6ba330ade698d1204d952fba864253cd6f7d6"}
Jul 27 21:25:17.770282 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.769156    2562 scope.go:117] "RemoveContainer" containerID="caf9c0ca6597b1b40acb962bac7fff651e05218a852493d53e2b6452fcddf784"
Jul 27 21:25:17.770282 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:25:17.769556    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caf9c0ca6597b1b40acb962bac7fff651e05218a852493d53e2b6452fcddf784\": container with ID starting with caf9c0ca6597b1b40acb962bac7fff651e05218a852493d53e2b6452fcddf784 not found: ID does not exist" containerID="caf9c0ca6597b1b40acb962bac7fff651e05218a852493d53e2b6452fcddf784"
Jul 27 21:25:17.770282 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.769614    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caf9c0ca6597b1b40acb962bac7fff651e05218a852493d53e2b6452fcddf784"} err="failed to get container status \"caf9c0ca6597b1b40acb962bac7fff651e05218a852493d53e2b6452fcddf784\": rpc error: code = NotFound desc = could not find container \"caf9c0ca6597b1b40acb962bac7fff651e05218a852493d53e2b6452fcddf784\": container with ID starting with caf9c0ca6597b1b40acb962bac7fff651e05218a852493d53e2b6452fcddf784 not found: ID does not exist"
Jul 27 21:25:17.770282 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.769640    2562 scope.go:117] "RemoveContainer" containerID="a8c54e556d58d54102599a0dd9e647d33adf171d63f8ed6bc22daed6f6181e1f"
Jul 27 21:25:17.778492 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.778475    2562 scope.go:117] "RemoveContainer" containerID="a8c54e556d58d54102599a0dd9e647d33adf171d63f8ed6bc22daed6f6181e1f"
Jul 27 21:25:17.778725 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:25:17.778706    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8c54e556d58d54102599a0dd9e647d33adf171d63f8ed6bc22daed6f6181e1f\": container with ID starting with a8c54e556d58d54102599a0dd9e647d33adf171d63f8ed6bc22daed6f6181e1f not found: ID does not exist" containerID="a8c54e556d58d54102599a0dd9e647d33adf171d63f8ed6bc22daed6f6181e1f"
Jul 27 21:25:17.778771 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.778732    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8c54e556d58d54102599a0dd9e647d33adf171d63f8ed6bc22daed6f6181e1f"} err="failed to get container status \"a8c54e556d58d54102599a0dd9e647d33adf171d63f8ed6bc22daed6f6181e1f\": rpc error: code = NotFound desc = could not find container \"a8c54e556d58d54102599a0dd9e647d33adf171d63f8ed6bc22daed6f6181e1f\": container with ID starting with a8c54e556d58d54102599a0dd9e647d33adf171d63f8ed6bc22daed6f6181e1f not found: ID does not exist"
Jul 27 21:25:17.789330 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.789311    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"]
Jul 27 21:25:17.794778 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.794757    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-baf2d2-6dc847f456-ppsc5"]
Jul 27 21:25:17.807724 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.807705    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq"]
Jul 27 21:25:17.813638 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:17.813621    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-baf2d2-775c68c746-rf8wq"]
Jul 27 21:25:18.870476 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:18.870438    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01543c12-6b2d-46b0-8c51-4c892adc674c" path="/var/lib/kubelet/pods/01543c12-6b2d-46b0-8c51-4c892adc674c/volumes"
Jul 27 21:25:18.870988 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:18.870973    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce10e958-89cb-494e-b17a-9a7d0c8a3b0a" path="/var/lib/kubelet/pods/ce10e958-89cb-494e-b17a-9a7d0c8a3b0a/volumes"
Jul 27 21:25:47.849189 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:47.849155    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4"]
Jul 27 21:25:47.849778 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:47.849380    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4" podUID="e60c46e0-8fd9-4a61-a85c-7f0a745de818" containerName="payload-processing" containerID="cri-o://67c42e9dcdce979063ce7792e0405c84c657e31c482868fc586788c2db54383b" gracePeriod=30
Jul 27 21:25:47.859687 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:47.859658    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj"]
Jul 27 21:25:47.859895 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:47.859871    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj" podUID="35312b30-2999-4240-8a9f-eb5948674955" containerName="payload-pre-processing" containerID="cri-o://b3fce66f384218303d04561e7e464447349141a2188fc1ef2ff229e36bca8bc8" gracePeriod=30
Jul 27 21:25:48.172575 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.172549    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4"
Jul 27 21:25:48.175338 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.175317    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj"
Jul 27 21:25:48.212505 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.212477    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlvpv\" (UniqueName: \"kubernetes.io/projected/35312b30-2999-4240-8a9f-eb5948674955-kube-api-access-wlvpv\") pod \"35312b30-2999-4240-8a9f-eb5948674955\" (UID: \"35312b30-2999-4240-8a9f-eb5948674955\") "
Jul 27 21:25:48.212640 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.212582    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6b6w\" (UniqueName: \"kubernetes.io/projected/e60c46e0-8fd9-4a61-a85c-7f0a745de818-kube-api-access-c6b6w\") pod \"e60c46e0-8fd9-4a61-a85c-7f0a745de818\" (UID: \"e60c46e0-8fd9-4a61-a85c-7f0a745de818\") "
Jul 27 21:25:48.212640 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.212617    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35312b30-2999-4240-8a9f-eb5948674955-plugins-config-volume\") pod \"35312b30-2999-4240-8a9f-eb5948674955\" (UID: \"35312b30-2999-4240-8a9f-eb5948674955\") "
Jul 27 21:25:48.212711 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.212640    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e60c46e0-8fd9-4a61-a85c-7f0a745de818-plugins-config-volume\") pod \"e60c46e0-8fd9-4a61-a85c-7f0a745de818\" (UID: \"e60c46e0-8fd9-4a61-a85c-7f0a745de818\") "
Jul 27 21:25:48.212995 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.212970    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35312b30-2999-4240-8a9f-eb5948674955-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "35312b30-2999-4240-8a9f-eb5948674955" (UID: "35312b30-2999-4240-8a9f-eb5948674955"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:25:48.213089 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.213068    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e60c46e0-8fd9-4a61-a85c-7f0a745de818-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e60c46e0-8fd9-4a61-a85c-7f0a745de818" (UID: "e60c46e0-8fd9-4a61-a85c-7f0a745de818"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:25:48.214593 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.214566    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35312b30-2999-4240-8a9f-eb5948674955-kube-api-access-wlvpv" (OuterVolumeSpecName: "kube-api-access-wlvpv") pod "35312b30-2999-4240-8a9f-eb5948674955" (UID: "35312b30-2999-4240-8a9f-eb5948674955"). InnerVolumeSpecName "kube-api-access-wlvpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:25:48.214678 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.214641    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e60c46e0-8fd9-4a61-a85c-7f0a745de818-kube-api-access-c6b6w" (OuterVolumeSpecName: "kube-api-access-c6b6w") pod "e60c46e0-8fd9-4a61-a85c-7f0a745de818" (UID: "e60c46e0-8fd9-4a61-a85c-7f0a745de818"). InnerVolumeSpecName "kube-api-access-c6b6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:25:48.313992 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.313960    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6b6w\" (UniqueName: \"kubernetes.io/projected/e60c46e0-8fd9-4a61-a85c-7f0a745de818-kube-api-access-c6b6w\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:25:48.313992 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.313988    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35312b30-2999-4240-8a9f-eb5948674955-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:25:48.313992 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.313997    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e60c46e0-8fd9-4a61-a85c-7f0a745de818-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:25:48.314217 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.314006    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlvpv\" (UniqueName: \"kubernetes.io/projected/35312b30-2999-4240-8a9f-eb5948674955-kube-api-access-wlvpv\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:25:48.918136 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.918103    2562 generic.go:356] "Generic (PLEG): container finished" podID="35312b30-2999-4240-8a9f-eb5948674955" containerID="b3fce66f384218303d04561e7e464447349141a2188fc1ef2ff229e36bca8bc8" exitCode=0
Jul 27 21:25:48.918572 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.918145    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj"
Jul 27 21:25:48.918572 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.918188    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj" event={"ID":"35312b30-2999-4240-8a9f-eb5948674955","Type":"ContainerDied","Data":"b3fce66f384218303d04561e7e464447349141a2188fc1ef2ff229e36bca8bc8"}
Jul 27 21:25:48.918572 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.918237    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj" event={"ID":"35312b30-2999-4240-8a9f-eb5948674955","Type":"ContainerDied","Data":"6f084a0e0bd6097bd9c96cc7ea83236712714e6e9a36c8d7ff8f17694cf9c754"}
Jul 27 21:25:48.918572 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.918290    2562 scope.go:117] "RemoveContainer" containerID="b3fce66f384218303d04561e7e464447349141a2188fc1ef2ff229e36bca8bc8"
Jul 27 21:25:48.919641 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.919566    2562 generic.go:356] "Generic (PLEG): container finished" podID="e60c46e0-8fd9-4a61-a85c-7f0a745de818" containerID="67c42e9dcdce979063ce7792e0405c84c657e31c482868fc586788c2db54383b" exitCode=0
Jul 27 21:25:48.919641 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.919600    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4" event={"ID":"e60c46e0-8fd9-4a61-a85c-7f0a745de818","Type":"ContainerDied","Data":"67c42e9dcdce979063ce7792e0405c84c657e31c482868fc586788c2db54383b"}
Jul 27 21:25:48.919641 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.919637    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4" event={"ID":"e60c46e0-8fd9-4a61-a85c-7f0a745de818","Type":"ContainerDied","Data":"9bebdce7306e332f4344b1f007fdf70f805ce838b904201e943722aa60e9acca"}
Jul 27 21:25:48.919840 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.919694    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4"
Jul 27 21:25:48.927401 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.927385    2562 scope.go:117] "RemoveContainer" containerID="b3fce66f384218303d04561e7e464447349141a2188fc1ef2ff229e36bca8bc8"
Jul 27 21:25:48.927632 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:25:48.927614    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3fce66f384218303d04561e7e464447349141a2188fc1ef2ff229e36bca8bc8\": container with ID starting with b3fce66f384218303d04561e7e464447349141a2188fc1ef2ff229e36bca8bc8 not found: ID does not exist" containerID="b3fce66f384218303d04561e7e464447349141a2188fc1ef2ff229e36bca8bc8"
Jul 27 21:25:48.927682 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.927640    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3fce66f384218303d04561e7e464447349141a2188fc1ef2ff229e36bca8bc8"} err="failed to get container status \"b3fce66f384218303d04561e7e464447349141a2188fc1ef2ff229e36bca8bc8\": rpc error: code = NotFound desc = could not find container \"b3fce66f384218303d04561e7e464447349141a2188fc1ef2ff229e36bca8bc8\": container with ID starting with b3fce66f384218303d04561e7e464447349141a2188fc1ef2ff229e36bca8bc8 not found: ID does not exist"
Jul 27 21:25:48.927682 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.927657    2562 scope.go:117] "RemoveContainer" containerID="67c42e9dcdce979063ce7792e0405c84c657e31c482868fc586788c2db54383b"
Jul 27 21:25:48.935462 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.935445    2562 scope.go:117] "RemoveContainer" containerID="67c42e9dcdce979063ce7792e0405c84c657e31c482868fc586788c2db54383b"
Jul 27 21:25:48.935696 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:25:48.935676    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67c42e9dcdce979063ce7792e0405c84c657e31c482868fc586788c2db54383b\": container with ID starting with 67c42e9dcdce979063ce7792e0405c84c657e31c482868fc586788c2db54383b not found: ID does not exist" containerID="67c42e9dcdce979063ce7792e0405c84c657e31c482868fc586788c2db54383b"
Jul 27 21:25:48.935749 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.935704    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67c42e9dcdce979063ce7792e0405c84c657e31c482868fc586788c2db54383b"} err="failed to get container status \"67c42e9dcdce979063ce7792e0405c84c657e31c482868fc586788c2db54383b\": rpc error: code = NotFound desc = could not find container \"67c42e9dcdce979063ce7792e0405c84c657e31c482868fc586788c2db54383b\": container with ID starting with 67c42e9dcdce979063ce7792e0405c84c657e31c482868fc586788c2db54383b not found: ID does not exist"
Jul 27 21:25:48.939518 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.939496    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj"]
Jul 27 21:25:48.945232 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.945212    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-91a310-74b55dc868-pz7jj"]
Jul 27 21:25:48.959360 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.959339    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4"]
Jul 27 21:25:48.963582 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:48.963559    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-91a310-75fbb5c444-r4kh4"]
Jul 27 21:25:50.871058 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:50.871020    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35312b30-2999-4240-8a9f-eb5948674955" path="/var/lib/kubelet/pods/35312b30-2999-4240-8a9f-eb5948674955/volumes"
Jul 27 21:25:50.871438 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:25:50.871386    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e60c46e0-8fd9-4a61-a85c-7f0a745de818" path="/var/lib/kubelet/pods/e60c46e0-8fd9-4a61-a85c-7f0a745de818/volumes"
Jul 27 21:26:13.392892 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.392857    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k92bv"]
Jul 27 21:26:13.393382 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.393257    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35312b30-2999-4240-8a9f-eb5948674955" containerName="payload-pre-processing"
Jul 27 21:26:13.393382 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.393280    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="35312b30-2999-4240-8a9f-eb5948674955" containerName="payload-pre-processing"
Jul 27 21:26:13.393382 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.393295    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01543c12-6b2d-46b0-8c51-4c892adc674c" containerName="payload-processing"
Jul 27 21:26:13.393382 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.393304    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="01543c12-6b2d-46b0-8c51-4c892adc674c" containerName="payload-processing"
Jul 27 21:26:13.393382 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.393320    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce10e958-89cb-494e-b17a-9a7d0c8a3b0a" containerName="maas-api"
Jul 27 21:26:13.393382 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.393325    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce10e958-89cb-494e-b17a-9a7d0c8a3b0a" containerName="maas-api"
Jul 27 21:26:13.393382 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.393342    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e60c46e0-8fd9-4a61-a85c-7f0a745de818" containerName="payload-processing"
Jul 27 21:26:13.393382 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.393347    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e60c46e0-8fd9-4a61-a85c-7f0a745de818" containerName="payload-processing"
Jul 27 21:26:13.393665 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.393408    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="01543c12-6b2d-46b0-8c51-4c892adc674c" containerName="payload-processing"
Jul 27 21:26:13.393665 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.393416    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="35312b30-2999-4240-8a9f-eb5948674955" containerName="payload-pre-processing"
Jul 27 21:26:13.393665 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.393432    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e60c46e0-8fd9-4a61-a85c-7f0a745de818" containerName="payload-processing"
Jul 27 21:26:13.393665 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.393438    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce10e958-89cb-494e-b17a-9a7d0c8a3b0a" containerName="maas-api"
Jul 27 21:26:13.396216 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.396198    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k92bv"
Jul 27 21:26:13.398841 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.398823    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-cr95r\""
Jul 27 21:26:13.406630 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.406599    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k92bv"]
Jul 27 21:26:13.555951 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.555909    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jljl\" (UniqueName: \"kubernetes.io/projected/5d4a4756-66ce-454a-bd1a-2aec01b69f80-kube-api-access-4jljl\") pod \"kuadrant-operator-catalog-k92bv\" (UID: \"5d4a4756-66ce-454a-bd1a-2aec01b69f80\") " pod="kuadrant-system/kuadrant-operator-catalog-k92bv"
Jul 27 21:26:13.657186 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.657109    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jljl\" (UniqueName: \"kubernetes.io/projected/5d4a4756-66ce-454a-bd1a-2aec01b69f80-kube-api-access-4jljl\") pod \"kuadrant-operator-catalog-k92bv\" (UID: \"5d4a4756-66ce-454a-bd1a-2aec01b69f80\") " pod="kuadrant-system/kuadrant-operator-catalog-k92bv"
Jul 27 21:26:13.667848 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.667825    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jljl\" (UniqueName: \"kubernetes.io/projected/5d4a4756-66ce-454a-bd1a-2aec01b69f80-kube-api-access-4jljl\") pod \"kuadrant-operator-catalog-k92bv\" (UID: \"5d4a4756-66ce-454a-bd1a-2aec01b69f80\") " pod="kuadrant-system/kuadrant-operator-catalog-k92bv"
Jul 27 21:26:13.705880 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.705854    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k92bv"
Jul 27 21:26:13.848808 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:13.848781    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k92bv"]
Jul 27 21:26:13.849806 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:26:13.849774    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4a4756_66ce_454a_bd1a_2aec01b69f80.slice/crio-a2e8492b39d0f73c4d5984693d10707bb3ea26dfdc93ee44eeb9f63cd0f453b1 WatchSource:0}: Error finding container a2e8492b39d0f73c4d5984693d10707bb3ea26dfdc93ee44eeb9f63cd0f453b1: Status 404 returned error can't find the container with id a2e8492b39d0f73c4d5984693d10707bb3ea26dfdc93ee44eeb9f63cd0f453b1
Jul 27 21:26:14.044232 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:14.044153    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k92bv" event={"ID":"5d4a4756-66ce-454a-bd1a-2aec01b69f80","Type":"ContainerStarted","Data":"a2e8492b39d0f73c4d5984693d10707bb3ea26dfdc93ee44eeb9f63cd0f453b1"}
Jul 27 21:26:16.059312 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:16.059211    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k92bv" event={"ID":"5d4a4756-66ce-454a-bd1a-2aec01b69f80","Type":"ContainerStarted","Data":"983a196e50396dfcd4a8742eb28328556fc0af7583867c1fa21794dc3f65ecd7"}
Jul 27 21:26:16.078801 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:16.078748    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-k92bv" podStartSLOduration=1.231225931 podStartE2EDuration="3.078729663s" totalImagesPullingTime="1.847503732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:26:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:26:16.077120334 +0000 UTC m=+3115.717336772" watchObservedRunningTime="2026-07-27 21:26:16.078729663 +0000 UTC m=+3115.718946101"
Jul 27 21:26:23.705959 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:23.705923    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-k92bv"
Jul 27 21:26:23.706369 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:23.705989    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-k92bv"
Jul 27 21:26:23.727669 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:23.727637    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-k92bv"
Jul 27 21:26:24.121010 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:24.120980    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-k92bv"
Jul 27 21:26:24.158064 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:24.158036    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k92bv"]
Jul 27 21:26:26.109808 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:26.109763    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-k92bv" podUID="5d4a4756-66ce-454a-bd1a-2aec01b69f80" containerName="registry-server" containerID="cri-o://983a196e50396dfcd4a8742eb28328556fc0af7583867c1fa21794dc3f65ecd7" gracePeriod=2
Jul 27 21:26:26.368704 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:26.368639    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k92bv"
Jul 27 21:26:26.469730 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:26.469692    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jljl\" (UniqueName: \"kubernetes.io/projected/5d4a4756-66ce-454a-bd1a-2aec01b69f80-kube-api-access-4jljl\") pod \"5d4a4756-66ce-454a-bd1a-2aec01b69f80\" (UID: \"5d4a4756-66ce-454a-bd1a-2aec01b69f80\") "
Jul 27 21:26:26.471734 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:26.471709    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d4a4756-66ce-454a-bd1a-2aec01b69f80-kube-api-access-4jljl" (OuterVolumeSpecName: "kube-api-access-4jljl") pod "5d4a4756-66ce-454a-bd1a-2aec01b69f80" (UID: "5d4a4756-66ce-454a-bd1a-2aec01b69f80"). InnerVolumeSpecName "kube-api-access-4jljl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:26:26.571330 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:26.571303    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jljl\" (UniqueName: \"kubernetes.io/projected/5d4a4756-66ce-454a-bd1a-2aec01b69f80-kube-api-access-4jljl\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:26:27.116741 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:27.116714    2562 generic.go:356] "Generic (PLEG): container finished" podID="5d4a4756-66ce-454a-bd1a-2aec01b69f80" containerID="983a196e50396dfcd4a8742eb28328556fc0af7583867c1fa21794dc3f65ecd7" exitCode=0
Jul 27 21:26:27.117108 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:27.116756    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k92bv"
Jul 27 21:26:27.117108 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:27.116783    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k92bv" event={"ID":"5d4a4756-66ce-454a-bd1a-2aec01b69f80","Type":"ContainerDied","Data":"983a196e50396dfcd4a8742eb28328556fc0af7583867c1fa21794dc3f65ecd7"}
Jul 27 21:26:27.117108 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:27.116821    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k92bv" event={"ID":"5d4a4756-66ce-454a-bd1a-2aec01b69f80","Type":"ContainerDied","Data":"a2e8492b39d0f73c4d5984693d10707bb3ea26dfdc93ee44eeb9f63cd0f453b1"}
Jul 27 21:26:27.117108 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:27.116839    2562 scope.go:117] "RemoveContainer" containerID="983a196e50396dfcd4a8742eb28328556fc0af7583867c1fa21794dc3f65ecd7"
Jul 27 21:26:27.125548 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:27.125532    2562 scope.go:117] "RemoveContainer" containerID="983a196e50396dfcd4a8742eb28328556fc0af7583867c1fa21794dc3f65ecd7"
Jul 27 21:26:27.125806 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:26:27.125788    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"983a196e50396dfcd4a8742eb28328556fc0af7583867c1fa21794dc3f65ecd7\": container with ID starting with 983a196e50396dfcd4a8742eb28328556fc0af7583867c1fa21794dc3f65ecd7 not found: ID does not exist" containerID="983a196e50396dfcd4a8742eb28328556fc0af7583867c1fa21794dc3f65ecd7"
Jul 27 21:26:27.125857 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:27.125816    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"983a196e50396dfcd4a8742eb28328556fc0af7583867c1fa21794dc3f65ecd7"} err="failed to get container status \"983a196e50396dfcd4a8742eb28328556fc0af7583867c1fa21794dc3f65ecd7\": rpc error: code = NotFound desc = could not find container \"983a196e50396dfcd4a8742eb28328556fc0af7583867c1fa21794dc3f65ecd7\": container with ID starting with 983a196e50396dfcd4a8742eb28328556fc0af7583867c1fa21794dc3f65ecd7 not found: ID does not exist"
Jul 27 21:26:27.133261 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:27.133209    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k92bv"]
Jul 27 21:26:27.136780 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:27.136761    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k92bv"]
Jul 27 21:26:28.869986 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:28.869949    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d4a4756-66ce-454a-bd1a-2aec01b69f80" path="/var/lib/kubelet/pods/5d4a4756-66ce-454a-bd1a-2aec01b69f80/volumes"
Jul 27 21:26:51.337655 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.337573    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"]
Jul 27 21:26:51.338239 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.337798    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k" podUID="2a2b4412-23a1-488f-8908-fff4f43ff856" containerName="maas-api" containerID="cri-o://b763b2da1362245f5c8929d74fff9bd0797502048ae3f27703b38495f8b0d846" gracePeriod=30
Jul 27 21:26:51.395983 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.395952    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz"]
Jul 27 21:26:51.396196 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.396170    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz" podUID="98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf" containerName="payload-processing" containerID="cri-o://08a7b1c39ef44bbb13b0040f037678feb23f7513eaed086712d25620aa1cdd49" gracePeriod=30
Jul 27 21:26:51.404221 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.403920    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5"]
Jul 27 21:26:51.404372 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.404137    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5" podUID="4d299f32-89b5-459c-ad6d-4dc954acfcea" containerName="payload-pre-processing" containerID="cri-o://893616e4763df76b0f4f0065e87ebb420b19b6add7deb006e278cd49af0c009a" gracePeriod=30
Jul 27 21:26:51.704443 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.704413    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"
Jul 27 21:26:51.707410 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.707389    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz"
Jul 27 21:26:51.719348 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.719327    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5"
Jul 27 21:26:51.813967 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.813932    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2p5w\" (UniqueName: \"kubernetes.io/projected/4d299f32-89b5-459c-ad6d-4dc954acfcea-kube-api-access-m2p5w\") pod \"4d299f32-89b5-459c-ad6d-4dc954acfcea\" (UID: \"4d299f32-89b5-459c-ad6d-4dc954acfcea\") "
Jul 27 21:26:51.814161 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.813995    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a2b4412-23a1-488f-8908-fff4f43ff856-maas-api-tls\") pod \"2a2b4412-23a1-488f-8908-fff4f43ff856\" (UID: \"2a2b4412-23a1-488f-8908-fff4f43ff856\") "
Jul 27 21:26:51.814161 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.814056    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d299f32-89b5-459c-ad6d-4dc954acfcea-plugins-config-volume\") pod \"4d299f32-89b5-459c-ad6d-4dc954acfcea\" (UID: \"4d299f32-89b5-459c-ad6d-4dc954acfcea\") "
Jul 27 21:26:51.814161 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.814107    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwswb\" (UniqueName: \"kubernetes.io/projected/2a2b4412-23a1-488f-8908-fff4f43ff856-kube-api-access-fwswb\") pod \"2a2b4412-23a1-488f-8908-fff4f43ff856\" (UID: \"2a2b4412-23a1-488f-8908-fff4f43ff856\") "
Jul 27 21:26:51.814161 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.814140    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a2b4412-23a1-488f-8908-fff4f43ff856-openshift-service-ca\") pod \"2a2b4412-23a1-488f-8908-fff4f43ff856\" (UID: \"2a2b4412-23a1-488f-8908-fff4f43ff856\") "
Jul 27 21:26:51.814444 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.814205    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2222b\" (UniqueName: \"kubernetes.io/projected/98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf-kube-api-access-2222b\") pod \"98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf\" (UID: \"98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf\") "
Jul 27 21:26:51.814444 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.814231    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf-plugins-config-volume\") pod \"98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf\" (UID: \"98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf\") "
Jul 27 21:26:51.814647 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.814590    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a2b4412-23a1-488f-8908-fff4f43ff856-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2a2b4412-23a1-488f-8908-fff4f43ff856" (UID: "2a2b4412-23a1-488f-8908-fff4f43ff856"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:26:51.814647 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.814607    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d299f32-89b5-459c-ad6d-4dc954acfcea-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4d299f32-89b5-459c-ad6d-4dc954acfcea" (UID: "4d299f32-89b5-459c-ad6d-4dc954acfcea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:26:51.814835 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.814701    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf" (UID: "98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:26:51.816560 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.816532    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a2b4412-23a1-488f-8908-fff4f43ff856-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2a2b4412-23a1-488f-8908-fff4f43ff856" (UID: "2a2b4412-23a1-488f-8908-fff4f43ff856"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:26:51.816662 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.816603    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf-kube-api-access-2222b" (OuterVolumeSpecName: "kube-api-access-2222b") pod "98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf" (UID: "98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf"). InnerVolumeSpecName "kube-api-access-2222b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:26:51.816793 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.816771    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a2b4412-23a1-488f-8908-fff4f43ff856-kube-api-access-fwswb" (OuterVolumeSpecName: "kube-api-access-fwswb") pod "2a2b4412-23a1-488f-8908-fff4f43ff856" (UID: "2a2b4412-23a1-488f-8908-fff4f43ff856"). InnerVolumeSpecName "kube-api-access-fwswb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:26:51.817213 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.816809    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d299f32-89b5-459c-ad6d-4dc954acfcea-kube-api-access-m2p5w" (OuterVolumeSpecName: "kube-api-access-m2p5w") pod "4d299f32-89b5-459c-ad6d-4dc954acfcea" (UID: "4d299f32-89b5-459c-ad6d-4dc954acfcea"). InnerVolumeSpecName "kube-api-access-m2p5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:26:51.915683 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.915603    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a2b4412-23a1-488f-8908-fff4f43ff856-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:26:51.915683 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.915631    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d299f32-89b5-459c-ad6d-4dc954acfcea-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:26:51.915683 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.915641    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwswb\" (UniqueName: \"kubernetes.io/projected/2a2b4412-23a1-488f-8908-fff4f43ff856-kube-api-access-fwswb\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:26:51.915683 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.915650    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a2b4412-23a1-488f-8908-fff4f43ff856-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:26:51.915683 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.915660    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2222b\" (UniqueName: \"kubernetes.io/projected/98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf-kube-api-access-2222b\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:26:51.915683 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.915669    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:26:51.915683 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:51.915677    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2p5w\" (UniqueName: \"kubernetes.io/projected/4d299f32-89b5-459c-ad6d-4dc954acfcea-kube-api-access-m2p5w\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:26:52.244788 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.244702    2562 generic.go:356] "Generic (PLEG): container finished" podID="98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf" containerID="08a7b1c39ef44bbb13b0040f037678feb23f7513eaed086712d25620aa1cdd49" exitCode=0
Jul 27 21:26:52.244788 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.244747    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz"
Jul 27 21:26:52.245026 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.244785    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz" event={"ID":"98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf","Type":"ContainerDied","Data":"08a7b1c39ef44bbb13b0040f037678feb23f7513eaed086712d25620aa1cdd49"}
Jul 27 21:26:52.245026 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.244836    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz" event={"ID":"98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf","Type":"ContainerDied","Data":"0ec5a2965896a65a113c738400a7c637371bb5583c5cc7234f617f4822c6dfff"}
Jul 27 21:26:52.245026 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.244860    2562 scope.go:117] "RemoveContainer" containerID="08a7b1c39ef44bbb13b0040f037678feb23f7513eaed086712d25620aa1cdd49"
Jul 27 21:26:52.246172 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.246153    2562 generic.go:356] "Generic (PLEG): container finished" podID="4d299f32-89b5-459c-ad6d-4dc954acfcea" containerID="893616e4763df76b0f4f0065e87ebb420b19b6add7deb006e278cd49af0c009a" exitCode=0
Jul 27 21:26:52.246266 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.246192    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5"
Jul 27 21:26:52.246266 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.246220    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5" event={"ID":"4d299f32-89b5-459c-ad6d-4dc954acfcea","Type":"ContainerDied","Data":"893616e4763df76b0f4f0065e87ebb420b19b6add7deb006e278cd49af0c009a"}
Jul 27 21:26:52.246402 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.246300    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5" event={"ID":"4d299f32-89b5-459c-ad6d-4dc954acfcea","Type":"ContainerDied","Data":"e2d35f30aa95b0e8f83cdd9cdc6bd83476bf9fbb5eff412f484e85089da86790"}
Jul 27 21:26:52.247817 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.247792    2562 generic.go:356] "Generic (PLEG): container finished" podID="2a2b4412-23a1-488f-8908-fff4f43ff856" containerID="b763b2da1362245f5c8929d74fff9bd0797502048ae3f27703b38495f8b0d846" exitCode=0
Jul 27 21:26:52.247934 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.247820    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"
Jul 27 21:26:52.247934 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.247848    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k" event={"ID":"2a2b4412-23a1-488f-8908-fff4f43ff856","Type":"ContainerDied","Data":"b763b2da1362245f5c8929d74fff9bd0797502048ae3f27703b38495f8b0d846"}
Jul 27 21:26:52.247934 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.247889    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k" event={"ID":"2a2b4412-23a1-488f-8908-fff4f43ff856","Type":"ContainerDied","Data":"f3dd0a2f6c441101c920d69c512d14a9a2c936fa2759b9a6f4767f94602ed403"}
Jul 27 21:26:52.255737 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.255710    2562 scope.go:117] "RemoveContainer" containerID="08a7b1c39ef44bbb13b0040f037678feb23f7513eaed086712d25620aa1cdd49"
Jul 27 21:26:52.256077 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:26:52.256051    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08a7b1c39ef44bbb13b0040f037678feb23f7513eaed086712d25620aa1cdd49\": container with ID starting with 08a7b1c39ef44bbb13b0040f037678feb23f7513eaed086712d25620aa1cdd49 not found: ID does not exist" containerID="08a7b1c39ef44bbb13b0040f037678feb23f7513eaed086712d25620aa1cdd49"
Jul 27 21:26:52.256159 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.256085    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08a7b1c39ef44bbb13b0040f037678feb23f7513eaed086712d25620aa1cdd49"} err="failed to get container status \"08a7b1c39ef44bbb13b0040f037678feb23f7513eaed086712d25620aa1cdd49\": rpc error: code = NotFound desc = could not find container \"08a7b1c39ef44bbb13b0040f037678feb23f7513eaed086712d25620aa1cdd49\": container with ID starting with 08a7b1c39ef44bbb13b0040f037678feb23f7513eaed086712d25620aa1cdd49 not found: ID does not exist"
Jul 27 21:26:52.256159 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.256109    2562 scope.go:117] "RemoveContainer" containerID="893616e4763df76b0f4f0065e87ebb420b19b6add7deb006e278cd49af0c009a"
Jul 27 21:26:52.264843 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.264827    2562 scope.go:117] "RemoveContainer" containerID="893616e4763df76b0f4f0065e87ebb420b19b6add7deb006e278cd49af0c009a"
Jul 27 21:26:52.265099 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:26:52.265073    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"893616e4763df76b0f4f0065e87ebb420b19b6add7deb006e278cd49af0c009a\": container with ID starting with 893616e4763df76b0f4f0065e87ebb420b19b6add7deb006e278cd49af0c009a not found: ID does not exist" containerID="893616e4763df76b0f4f0065e87ebb420b19b6add7deb006e278cd49af0c009a"
Jul 27 21:26:52.265178 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.265099    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"893616e4763df76b0f4f0065e87ebb420b19b6add7deb006e278cd49af0c009a"} err="failed to get container status \"893616e4763df76b0f4f0065e87ebb420b19b6add7deb006e278cd49af0c009a\": rpc error: code = NotFound desc = could not find container \"893616e4763df76b0f4f0065e87ebb420b19b6add7deb006e278cd49af0c009a\": container with ID starting with 893616e4763df76b0f4f0065e87ebb420b19b6add7deb006e278cd49af0c009a not found: ID does not exist"
Jul 27 21:26:52.265178 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.265121    2562 scope.go:117] "RemoveContainer" containerID="b763b2da1362245f5c8929d74fff9bd0797502048ae3f27703b38495f8b0d846"
Jul 27 21:26:52.272641 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.272624    2562 scope.go:117] "RemoveContainer" containerID="b763b2da1362245f5c8929d74fff9bd0797502048ae3f27703b38495f8b0d846"
Jul 27 21:26:52.272908 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:26:52.272885    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b763b2da1362245f5c8929d74fff9bd0797502048ae3f27703b38495f8b0d846\": container with ID starting with b763b2da1362245f5c8929d74fff9bd0797502048ae3f27703b38495f8b0d846 not found: ID does not exist" containerID="b763b2da1362245f5c8929d74fff9bd0797502048ae3f27703b38495f8b0d846"
Jul 27 21:26:52.272955 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.272918    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b763b2da1362245f5c8929d74fff9bd0797502048ae3f27703b38495f8b0d846"} err="failed to get container status \"b763b2da1362245f5c8929d74fff9bd0797502048ae3f27703b38495f8b0d846\": rpc error: code = NotFound desc = could not find container \"b763b2da1362245f5c8929d74fff9bd0797502048ae3f27703b38495f8b0d846\": container with ID starting with b763b2da1362245f5c8929d74fff9bd0797502048ae3f27703b38495f8b0d846 not found: ID does not exist"
Jul 27 21:26:52.276676 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.276656    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5"]
Jul 27 21:26:52.282899 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.282878    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-85c5ed-8657875bbd-75df5"]
Jul 27 21:26:52.293778 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.293755    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"]
Jul 27 21:26:52.297649 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.297629    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-85c5ed-59ff644595-9wn2k"]
Jul 27 21:26:52.307716 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.307691    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz"]
Jul 27 21:26:52.311471 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.311453    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-85c5ed-8494bb5484-gzfgz"]
Jul 27 21:26:52.871377 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.871344    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a2b4412-23a1-488f-8908-fff4f43ff856" path="/var/lib/kubelet/pods/2a2b4412-23a1-488f-8908-fff4f43ff856/volumes"
Jul 27 21:26:52.871765 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.871708    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d299f32-89b5-459c-ad6d-4dc954acfcea" path="/var/lib/kubelet/pods/4d299f32-89b5-459c-ad6d-4dc954acfcea/volumes"
Jul 27 21:26:52.872016 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:26:52.872003    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf" path="/var/lib/kubelet/pods/98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf/volumes"
Jul 27 21:27:13.861296 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:13.861244    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9"]
Jul 27 21:27:13.861754 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:13.861585    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9" podUID="536576e0-bc88-4213-9155-3a807c0e64f3" containerName="payload-processing" containerID="cri-o://13b51c74312c93504ed2232d495d8feb91836c530fad53e59b90a339862b7484" gracePeriod=30
Jul 27 21:27:13.872736 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:13.872704    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x"]
Jul 27 21:27:14.123018 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.122963    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9"
Jul 27 21:27:14.218317 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.218251    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42plm\" (UniqueName: \"kubernetes.io/projected/536576e0-bc88-4213-9155-3a807c0e64f3-kube-api-access-42plm\") pod \"536576e0-bc88-4213-9155-3a807c0e64f3\" (UID: \"536576e0-bc88-4213-9155-3a807c0e64f3\") "
Jul 27 21:27:14.218495 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.218361    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/536576e0-bc88-4213-9155-3a807c0e64f3-plugins-config-volume\") pod \"536576e0-bc88-4213-9155-3a807c0e64f3\" (UID: \"536576e0-bc88-4213-9155-3a807c0e64f3\") "
Jul 27 21:27:14.218717 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.218695    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/536576e0-bc88-4213-9155-3a807c0e64f3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "536576e0-bc88-4213-9155-3a807c0e64f3" (UID: "536576e0-bc88-4213-9155-3a807c0e64f3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:27:14.220361 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.220329    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/536576e0-bc88-4213-9155-3a807c0e64f3-kube-api-access-42plm" (OuterVolumeSpecName: "kube-api-access-42plm") pod "536576e0-bc88-4213-9155-3a807c0e64f3" (UID: "536576e0-bc88-4213-9155-3a807c0e64f3"). InnerVolumeSpecName "kube-api-access-42plm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:27:14.319653 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.319627    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42plm\" (UniqueName: \"kubernetes.io/projected/536576e0-bc88-4213-9155-3a807c0e64f3-kube-api-access-42plm\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:27:14.319653 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.319650    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/536576e0-bc88-4213-9155-3a807c0e64f3-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:27:14.372147 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.372113    2562 generic.go:356] "Generic (PLEG): container finished" podID="536576e0-bc88-4213-9155-3a807c0e64f3" containerID="13b51c74312c93504ed2232d495d8feb91836c530fad53e59b90a339862b7484" exitCode=0
Jul 27 21:27:14.372321 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.372157    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9"
Jul 27 21:27:14.372321 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.372191    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9" event={"ID":"536576e0-bc88-4213-9155-3a807c0e64f3","Type":"ContainerDied","Data":"13b51c74312c93504ed2232d495d8feb91836c530fad53e59b90a339862b7484"}
Jul 27 21:27:14.372321 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.372243    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9" event={"ID":"536576e0-bc88-4213-9155-3a807c0e64f3","Type":"ContainerDied","Data":"8005f156dc1b57c0413a480b328d4fd48e105f4f0d39e2d2380b2901f29a5544"}
Jul 27 21:27:14.372321 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.372265    2562 scope.go:117] "RemoveContainer" containerID="13b51c74312c93504ed2232d495d8feb91836c530fad53e59b90a339862b7484"
Jul 27 21:27:14.372520 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.372412    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x" podUID="9396334d-5b66-43d0-a8cd-6672852e1d15" containerName="payload-pre-processing" containerID="cri-o://a19199adf4fb80dbbdb50580eb5d1ec92956ebe192b2e399b4bee8cdc8fedb21" gracePeriod=30
Jul 27 21:27:14.382928 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.382911    2562 scope.go:117] "RemoveContainer" containerID="13b51c74312c93504ed2232d495d8feb91836c530fad53e59b90a339862b7484"
Jul 27 21:27:14.383170 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:27:14.383151    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13b51c74312c93504ed2232d495d8feb91836c530fad53e59b90a339862b7484\": container with ID starting with 13b51c74312c93504ed2232d495d8feb91836c530fad53e59b90a339862b7484 not found: ID does not exist" containerID="13b51c74312c93504ed2232d495d8feb91836c530fad53e59b90a339862b7484"
Jul 27 21:27:14.383233 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.383180    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b51c74312c93504ed2232d495d8feb91836c530fad53e59b90a339862b7484"} err="failed to get container status \"13b51c74312c93504ed2232d495d8feb91836c530fad53e59b90a339862b7484\": rpc error: code = NotFound desc = could not find container \"13b51c74312c93504ed2232d495d8feb91836c530fad53e59b90a339862b7484\": container with ID starting with 13b51c74312c93504ed2232d495d8feb91836c530fad53e59b90a339862b7484 not found: ID does not exist"
Jul 27 21:27:14.446318 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.446267    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9"]
Jul 27 21:27:14.452007 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.451986    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-69909d-58466dfb94-pzsn9"]
Jul 27 21:27:14.635945 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.635920    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x"
Jul 27 21:27:14.723569 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.723544    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9pcw\" (UniqueName: \"kubernetes.io/projected/9396334d-5b66-43d0-a8cd-6672852e1d15-kube-api-access-p9pcw\") pod \"9396334d-5b66-43d0-a8cd-6672852e1d15\" (UID: \"9396334d-5b66-43d0-a8cd-6672852e1d15\") "
Jul 27 21:27:14.723730 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.723600    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9396334d-5b66-43d0-a8cd-6672852e1d15-plugins-config-volume\") pod \"9396334d-5b66-43d0-a8cd-6672852e1d15\" (UID: \"9396334d-5b66-43d0-a8cd-6672852e1d15\") "
Jul 27 21:27:14.724028 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.723997    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9396334d-5b66-43d0-a8cd-6672852e1d15-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9396334d-5b66-43d0-a8cd-6672852e1d15" (UID: "9396334d-5b66-43d0-a8cd-6672852e1d15"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:27:14.725729 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.725710    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9396334d-5b66-43d0-a8cd-6672852e1d15-kube-api-access-p9pcw" (OuterVolumeSpecName: "kube-api-access-p9pcw") pod "9396334d-5b66-43d0-a8cd-6672852e1d15" (UID: "9396334d-5b66-43d0-a8cd-6672852e1d15"). InnerVolumeSpecName "kube-api-access-p9pcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:27:14.824683 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.824652    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9396334d-5b66-43d0-a8cd-6672852e1d15-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:27:14.824683 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.824680    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9pcw\" (UniqueName: \"kubernetes.io/projected/9396334d-5b66-43d0-a8cd-6672852e1d15-kube-api-access-p9pcw\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:27:14.870651 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:14.870620    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="536576e0-bc88-4213-9155-3a807c0e64f3" path="/var/lib/kubelet/pods/536576e0-bc88-4213-9155-3a807c0e64f3/volumes"
Jul 27 21:27:15.379701 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:15.379670    2562 generic.go:356] "Generic (PLEG): container finished" podID="9396334d-5b66-43d0-a8cd-6672852e1d15" containerID="a19199adf4fb80dbbdb50580eb5d1ec92956ebe192b2e399b4bee8cdc8fedb21" exitCode=0
Jul 27 21:27:15.379885 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:15.379714    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x"
Jul 27 21:27:15.379885 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:15.379746    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x" event={"ID":"9396334d-5b66-43d0-a8cd-6672852e1d15","Type":"ContainerDied","Data":"a19199adf4fb80dbbdb50580eb5d1ec92956ebe192b2e399b4bee8cdc8fedb21"}
Jul 27 21:27:15.379885 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:15.379786    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x" event={"ID":"9396334d-5b66-43d0-a8cd-6672852e1d15","Type":"ContainerDied","Data":"0d4f0866dfd8d4653ac12060a0d2d3ff47fe4560aa9a68de638584b22efc83ab"}
Jul 27 21:27:15.379885 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:15.379807    2562 scope.go:117] "RemoveContainer" containerID="a19199adf4fb80dbbdb50580eb5d1ec92956ebe192b2e399b4bee8cdc8fedb21"
Jul 27 21:27:15.388180 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:15.388163    2562 scope.go:117] "RemoveContainer" containerID="a19199adf4fb80dbbdb50580eb5d1ec92956ebe192b2e399b4bee8cdc8fedb21"
Jul 27 21:27:15.388456 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:27:15.388437    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a19199adf4fb80dbbdb50580eb5d1ec92956ebe192b2e399b4bee8cdc8fedb21\": container with ID starting with a19199adf4fb80dbbdb50580eb5d1ec92956ebe192b2e399b4bee8cdc8fedb21 not found: ID does not exist" containerID="a19199adf4fb80dbbdb50580eb5d1ec92956ebe192b2e399b4bee8cdc8fedb21"
Jul 27 21:27:15.388525 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:15.388464    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a19199adf4fb80dbbdb50580eb5d1ec92956ebe192b2e399b4bee8cdc8fedb21"} err="failed to get container status \"a19199adf4fb80dbbdb50580eb5d1ec92956ebe192b2e399b4bee8cdc8fedb21\": rpc error: code = NotFound desc = could not find container \"a19199adf4fb80dbbdb50580eb5d1ec92956ebe192b2e399b4bee8cdc8fedb21\": container with ID starting with a19199adf4fb80dbbdb50580eb5d1ec92956ebe192b2e399b4bee8cdc8fedb21 not found: ID does not exist"
Jul 27 21:27:15.397004 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:15.396981    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x"]
Jul 27 21:27:15.400989 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:15.400970    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-69909d-66d5fc455b-lhk9x"]
Jul 27 21:27:16.870088 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:16.870053    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9396334d-5b66-43d0-a8cd-6672852e1d15" path="/var/lib/kubelet/pods/9396334d-5b66-43d0-a8cd-6672852e1d15/volumes"
Jul 27 21:27:35.994381 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:35.994346    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p"]
Jul 27 21:27:35.995252 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:35.995186    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p" podUID="13c2dff6-cefd-4684-996d-e318ad3cb843" containerName="payload-pre-processing" containerID="cri-o://3fc1cace523e23991c83b7ec23133d06c726d2e2c671b20ddae503f1958e2990" gracePeriod=30
Jul 27 21:27:36.256755 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:36.256691    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p"
Jul 27 21:27:36.323149 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:36.323116    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4kqk\" (UniqueName: \"kubernetes.io/projected/13c2dff6-cefd-4684-996d-e318ad3cb843-kube-api-access-p4kqk\") pod \"13c2dff6-cefd-4684-996d-e318ad3cb843\" (UID: \"13c2dff6-cefd-4684-996d-e318ad3cb843\") "
Jul 27 21:27:36.323149 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:36.323153    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13c2dff6-cefd-4684-996d-e318ad3cb843-plugins-config-volume\") pod \"13c2dff6-cefd-4684-996d-e318ad3cb843\" (UID: \"13c2dff6-cefd-4684-996d-e318ad3cb843\") "
Jul 27 21:27:36.323560 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:36.323536    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13c2dff6-cefd-4684-996d-e318ad3cb843-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "13c2dff6-cefd-4684-996d-e318ad3cb843" (UID: "13c2dff6-cefd-4684-996d-e318ad3cb843"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:27:36.325299 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:36.325263    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13c2dff6-cefd-4684-996d-e318ad3cb843-kube-api-access-p4kqk" (OuterVolumeSpecName: "kube-api-access-p4kqk") pod "13c2dff6-cefd-4684-996d-e318ad3cb843" (UID: "13c2dff6-cefd-4684-996d-e318ad3cb843"). InnerVolumeSpecName "kube-api-access-p4kqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:27:36.424606 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:36.424572    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4kqk\" (UniqueName: \"kubernetes.io/projected/13c2dff6-cefd-4684-996d-e318ad3cb843-kube-api-access-p4kqk\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:27:36.424606 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:36.424600    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13c2dff6-cefd-4684-996d-e318ad3cb843-plugins-config-volume\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 27 21:27:36.478566 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:36.478533    2562 generic.go:356] "Generic (PLEG): container finished" podID="13c2dff6-cefd-4684-996d-e318ad3cb843" containerID="3fc1cace523e23991c83b7ec23133d06c726d2e2c671b20ddae503f1958e2990" exitCode=0
Jul 27 21:27:36.478760 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:36.478577    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p"
Jul 27 21:27:36.478760 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:36.478583    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p" event={"ID":"13c2dff6-cefd-4684-996d-e318ad3cb843","Type":"ContainerDied","Data":"3fc1cace523e23991c83b7ec23133d06c726d2e2c671b20ddae503f1958e2990"}
Jul 27 21:27:36.478760 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:36.478646    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p" event={"ID":"13c2dff6-cefd-4684-996d-e318ad3cb843","Type":"ContainerDied","Data":"742c1d8a8c5e89fec06913b37175434c46dd307aaf455765a25be1043691ad65"}
Jul 27 21:27:36.478760 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:36.478679    2562 scope.go:117] "RemoveContainer" containerID="3fc1cace523e23991c83b7ec23133d06c726d2e2c671b20ddae503f1958e2990"
Jul 27 21:27:36.487610 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:36.487591    2562 scope.go:117] "RemoveContainer" containerID="3fc1cace523e23991c83b7ec23133d06c726d2e2c671b20ddae503f1958e2990"
Jul 27 21:27:36.487867 ip-10-0-143-205 kubenswrapper[2562]: E0727 21:27:36.487848    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fc1cace523e23991c83b7ec23133d06c726d2e2c671b20ddae503f1958e2990\": container with ID starting with 3fc1cace523e23991c83b7ec23133d06c726d2e2c671b20ddae503f1958e2990 not found: ID does not exist" containerID="3fc1cace523e23991c83b7ec23133d06c726d2e2c671b20ddae503f1958e2990"
Jul 27 21:27:36.487931 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:36.487879    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fc1cace523e23991c83b7ec23133d06c726d2e2c671b20ddae503f1958e2990"} err="failed to get container status \"3fc1cace523e23991c83b7ec23133d06c726d2e2c671b20ddae503f1958e2990\": rpc error: code = NotFound desc = could not find container \"3fc1cace523e23991c83b7ec23133d06c726d2e2c671b20ddae503f1958e2990\": container with ID starting with 3fc1cace523e23991c83b7ec23133d06c726d2e2c671b20ddae503f1958e2990 not found: ID does not exist"
Jul 27 21:27:36.499696 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:36.499666    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p"]
Jul 27 21:27:36.502417 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:36.502392    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ba2511-5d4756959b-sh95p"]
Jul 27 21:27:36.869800 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:36.869765    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13c2dff6-cefd-4684-996d-e318ad3cb843" path="/var/lib/kubelet/pods/13c2dff6-cefd-4684-996d-e318ad3cb843/volumes"
Jul 27 21:27:53.749620 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:53.749570    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55f5c64d95-rfdss_e53fe4de-f981-4dd5-9016-9f32563aac1c/manager/0.log"
Jul 27 21:27:53.869229 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:53.869200    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lzpj7_bbc0eca5-fe9d-42f5-aabf-509f36c4c963/server/0.log"
Jul 27 21:27:53.993416 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:53.993383    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mvr6f_8de06676-b75e-4d35-b362-5a0eaa84e635/manager/0.log"
Jul 27 21:27:54.101676 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:54.101648    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b945668b-h2jg2_767d4400-0e3f-47ee-b1fa-1b4c729bca4c/copy-manifests/0.log"
Jul 27 21:27:54.108827 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:54.108802    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b945668b-h2jg2_767d4400-0e3f-47ee-b1fa-1b4c729bca4c/manager/0.log"
Jul 27 21:27:54.718379 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:54.718350    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-746cdbd7fb-xlgts_e4ecf528-0c46-4946-978f-6a3b5a0127e0/maas-api/0.log"
Jul 27 21:27:55.152414 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:55.152387    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-zpqtg_daa65e7e-402f-46ae-9f05-fbd58ce3c5f0/postgres/0.log"
Jul 27 21:27:57.262291 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:57.262244    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-pct7z_75a67a19-1ff7-406c-b9b5-f1274771df20/manager/0.log"
Jul 27 21:27:57.737887 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:57.737849    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-98www_42f45d03-86d4-44b3-9368-e7c84cd96496/discovery/0.log"
Jul 27 21:27:57.960744 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:57.960711    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86f57966b4-v8tsh_7c13b62a-e640-4e08-be6b-54932c7c86bf/kube-auth-proxy/0.log"
Jul 27 21:27:58.212116 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:58.212085    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-kkksr_4fd9f783-10f5-4d5c-bc65-ba3d1eb990e9/payload-pre-processing/0.log"
Jul 27 21:27:58.443805 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:58.443778    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84bfbc884c-qvrvp_1a26fdaf-9d7e-4108-b8b1-f028188d2922/router/0.log"
Jul 27 21:27:58.793881 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:58.793851    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-lw954_8f9d6713-1efc-4fd3-8693-678fe1ce8735/main/0.log"
Jul 27 21:27:58.904817 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:58.904787    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-8674n_4c9d2197-4ca5-4b19-99be-2bfa4f44acde/main/0.log"
Jul 27 21:27:59.136408 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:27:59.136359    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn95b4_2478db46-7b35-49b3-8e52-64798feda77a/main/0.log"
Jul 27 21:28:08.107737 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:08.107704    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4z4nt_d1006199-a395-4fef-b9a5-7abe2931fd07/global-pull-secret-syncer/0.log"
Jul 27 21:28:08.279051 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:08.279021    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w7ctn_6ee6d38d-2dd3-41cf-90e0-d6e9d22a8471/konnectivity-agent/0.log"
Jul 27 21:28:08.400129 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:08.400041    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-205.ec2.internal_1fa6b6eadd7d4ba3cc0e93e22fbf7fde/haproxy/0.log"
Jul 27 21:28:13.963603 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:13.963524    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-pct7z_75a67a19-1ff7-406c-b9b5-f1274771df20/manager/0.log"
Jul 27 21:28:15.807716 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:15.807682    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/1.log"
Jul 27 21:28:15.944464 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:15.944430    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-vghz8_5a0d6bf2-f37f-42c7-b51e-bc34fe3b823f/cluster-monitoring-operator/0.log"
Jul 27 21:28:16.288795 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:16.288765    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vv5bs_c689faa5-6262-4ddf-be4f-783a8ba269bc/node-exporter/0.log"
Jul 27 21:28:16.309085 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:16.309060    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vv5bs_c689faa5-6262-4ddf-be4f-783a8ba269bc/kube-rbac-proxy/0.log"
Jul 27 21:28:16.333960 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:16.333942    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vv5bs_c689faa5-6262-4ddf-be4f-783a8ba269bc/init-textfile/0.log"
Jul 27 21:28:17.438244 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438214    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"]
Jul 27 21:28:17.438633 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438615    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13c2dff6-cefd-4684-996d-e318ad3cb843" containerName="payload-pre-processing"
Jul 27 21:28:17.438633 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438627    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="13c2dff6-cefd-4684-996d-e318ad3cb843" containerName="payload-pre-processing"
Jul 27 21:28:17.438718 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438649    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536576e0-bc88-4213-9155-3a807c0e64f3" containerName="payload-processing"
Jul 27 21:28:17.438718 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438655    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="536576e0-bc88-4213-9155-3a807c0e64f3" containerName="payload-processing"
Jul 27 21:28:17.438718 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438662    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d4a4756-66ce-454a-bd1a-2aec01b69f80" containerName="registry-server"
Jul 27 21:28:17.438718 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438668    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d4a4756-66ce-454a-bd1a-2aec01b69f80" containerName="registry-server"
Jul 27 21:28:17.438718 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438682    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9396334d-5b66-43d0-a8cd-6672852e1d15" containerName="payload-pre-processing"
Jul 27 21:28:17.438718 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438690    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9396334d-5b66-43d0-a8cd-6672852e1d15" containerName="payload-pre-processing"
Jul 27 21:28:17.438718 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438700    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a2b4412-23a1-488f-8908-fff4f43ff856" containerName="maas-api"
Jul 27 21:28:17.438718 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438706    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a2b4412-23a1-488f-8908-fff4f43ff856" containerName="maas-api"
Jul 27 21:28:17.438718 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438716    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d299f32-89b5-459c-ad6d-4dc954acfcea" containerName="payload-pre-processing"
Jul 27 21:28:17.438718 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438722    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d299f32-89b5-459c-ad6d-4dc954acfcea" containerName="payload-pre-processing"
Jul 27 21:28:17.439044 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438732    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf" containerName="payload-processing"
Jul 27 21:28:17.439044 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438737    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf" containerName="payload-processing"
Jul 27 21:28:17.439044 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438796    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d4a4756-66ce-454a-bd1a-2aec01b69f80" containerName="registry-server"
Jul 27 21:28:17.439044 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438802    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="536576e0-bc88-4213-9155-3a807c0e64f3" containerName="payload-processing"
Jul 27 21:28:17.439044 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438808    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d299f32-89b5-459c-ad6d-4dc954acfcea" containerName="payload-pre-processing"
Jul 27 21:28:17.439044 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438814    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="98a9a00d-51ea-4f59-bfa4-2828d8e3ceaf" containerName="payload-processing"
Jul 27 21:28:17.439044 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438822    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9396334d-5b66-43d0-a8cd-6672852e1d15" containerName="payload-pre-processing"
Jul 27 21:28:17.439044 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438829    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="13c2dff6-cefd-4684-996d-e318ad3cb843" containerName="payload-pre-processing"
Jul 27 21:28:17.439044 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.438834    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a2b4412-23a1-488f-8908-fff4f43ff856" containerName="maas-api"
Jul 27 21:28:17.445698 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.445675    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:17.448753 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.448369    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7p9dx\"/\"kube-root-ca.crt\""
Jul 27 21:28:17.448753 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.448369    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7p9dx\"/\"openshift-service-ca.crt\""
Jul 27 21:28:17.449392 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.449369    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7p9dx\"/\"default-dockercfg-vg9jk\""
Jul 27 21:28:17.451748 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.451724    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"]
Jul 27 21:28:17.591936 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.591906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3f04ff68-88e7-4b87-b16c-6eb438ec7257-proc\") pod \"perf-node-gather-daemonset-qhcv6\" (UID: \"3f04ff68-88e7-4b87-b16c-6eb438ec7257\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:17.591936 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.591939    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f04ff68-88e7-4b87-b16c-6eb438ec7257-sys\") pod \"perf-node-gather-daemonset-qhcv6\" (UID: \"3f04ff68-88e7-4b87-b16c-6eb438ec7257\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:17.592128 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.591978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smphp\" (UniqueName: \"kubernetes.io/projected/3f04ff68-88e7-4b87-b16c-6eb438ec7257-kube-api-access-smphp\") pod \"perf-node-gather-daemonset-qhcv6\" (UID: \"3f04ff68-88e7-4b87-b16c-6eb438ec7257\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:17.592128 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.592039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f04ff68-88e7-4b87-b16c-6eb438ec7257-lib-modules\") pod \"perf-node-gather-daemonset-qhcv6\" (UID: \"3f04ff68-88e7-4b87-b16c-6eb438ec7257\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:17.592128 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.592092    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3f04ff68-88e7-4b87-b16c-6eb438ec7257-podres\") pod \"perf-node-gather-daemonset-qhcv6\" (UID: \"3f04ff68-88e7-4b87-b16c-6eb438ec7257\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:17.692923 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.692837    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3f04ff68-88e7-4b87-b16c-6eb438ec7257-podres\") pod \"perf-node-gather-daemonset-qhcv6\" (UID: \"3f04ff68-88e7-4b87-b16c-6eb438ec7257\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:17.692923 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.692891    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3f04ff68-88e7-4b87-b16c-6eb438ec7257-proc\") pod \"perf-node-gather-daemonset-qhcv6\" (UID: \"3f04ff68-88e7-4b87-b16c-6eb438ec7257\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:17.692923 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.692922    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f04ff68-88e7-4b87-b16c-6eb438ec7257-sys\") pod \"perf-node-gather-daemonset-qhcv6\" (UID: \"3f04ff68-88e7-4b87-b16c-6eb438ec7257\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:17.693164 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.692976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smphp\" (UniqueName: \"kubernetes.io/projected/3f04ff68-88e7-4b87-b16c-6eb438ec7257-kube-api-access-smphp\") pod \"perf-node-gather-daemonset-qhcv6\" (UID: \"3f04ff68-88e7-4b87-b16c-6eb438ec7257\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:17.693164 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.692996    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3f04ff68-88e7-4b87-b16c-6eb438ec7257-podres\") pod \"perf-node-gather-daemonset-qhcv6\" (UID: \"3f04ff68-88e7-4b87-b16c-6eb438ec7257\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:17.693164 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.693016    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f04ff68-88e7-4b87-b16c-6eb438ec7257-lib-modules\") pod \"perf-node-gather-daemonset-qhcv6\" (UID: \"3f04ff68-88e7-4b87-b16c-6eb438ec7257\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:17.693164 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.693020    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3f04ff68-88e7-4b87-b16c-6eb438ec7257-proc\") pod \"perf-node-gather-daemonset-qhcv6\" (UID: \"3f04ff68-88e7-4b87-b16c-6eb438ec7257\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:17.693164 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.693022    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f04ff68-88e7-4b87-b16c-6eb438ec7257-sys\") pod \"perf-node-gather-daemonset-qhcv6\" (UID: \"3f04ff68-88e7-4b87-b16c-6eb438ec7257\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:17.693164 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.693113    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f04ff68-88e7-4b87-b16c-6eb438ec7257-lib-modules\") pod \"perf-node-gather-daemonset-qhcv6\" (UID: \"3f04ff68-88e7-4b87-b16c-6eb438ec7257\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:17.701970 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.701950    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smphp\" (UniqueName: \"kubernetes.io/projected/3f04ff68-88e7-4b87-b16c-6eb438ec7257-kube-api-access-smphp\") pod \"perf-node-gather-daemonset-qhcv6\" (UID: \"3f04ff68-88e7-4b87-b16c-6eb438ec7257\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:17.757481 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.757447    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:17.887502 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:17.887474    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"]
Jul 27 21:28:17.889099 ip-10-0-143-205 kubenswrapper[2562]: W0727 21:28:17.889070    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3f04ff68_88e7_4b87_b16c_6eb438ec7257.slice/crio-8799b5efd5f19c7108f21d811b6268c64bc04bbf8ae066ffe0f4844113e784bb WatchSource:0}: Error finding container 8799b5efd5f19c7108f21d811b6268c64bc04bbf8ae066ffe0f4844113e784bb: Status 404 returned error can't find the container with id 8799b5efd5f19c7108f21d811b6268c64bc04bbf8ae066ffe0f4844113e784bb
Jul 27 21:28:18.124802 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:18.124767    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-j9njv_b96c2f08-0f8b-49cd-8952-b2a54a65e4aa/networking-console-plugin/0.log"
Jul 27 21:28:18.680478 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:18.680446    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6" event={"ID":"3f04ff68-88e7-4b87-b16c-6eb438ec7257","Type":"ContainerStarted","Data":"de257a7dc0272d30b22b595d78d7a0611f78329b45984d4804b2207765e9a1e8"}
Jul 27 21:28:18.680861 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:18.680494    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6" event={"ID":"3f04ff68-88e7-4b87-b16c-6eb438ec7257","Type":"ContainerStarted","Data":"8799b5efd5f19c7108f21d811b6268c64bc04bbf8ae066ffe0f4844113e784bb"}
Jul 27 21:28:18.680861 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:18.680567    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:18.697843 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:18.697815    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/1.log"
Jul 27 21:28:18.699251 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:18.699198    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6" podStartSLOduration=1.69917466 podStartE2EDuration="1.69917466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:28:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:28:18.695291125 +0000 UTC m=+3238.335507585" watchObservedRunningTime="2026-07-27 21:28:18.69917466 +0000 UTC m=+3238.339391100"
Jul 27 21:28:18.710492 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:18.710468    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-bdpxl_efafc91f-4c5f-47e5-8350-fdf66054226c/console-operator/2.log"
Jul 27 21:28:19.257652 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:19.257615    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-2wpxf_8b954f0a-741a-46e0-bc68-75bfc6324548/download-server/0.log"
Jul 27 21:28:19.828713 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:19.828674    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-gc2v7_969b572a-ba5c-4ec1-b671-9d14627a4967/volume-data-source-validator/0.log"
Jul 27 21:28:20.869975 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:20.869944    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6rjrr_2c2578b4-d3fa-4263-a604-3800a3e85f49/dns/0.log"
Jul 27 21:28:20.891453 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:20.891403    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6rjrr_2c2578b4-d3fa-4263-a604-3800a3e85f49/kube-rbac-proxy/0.log"
Jul 27 21:28:21.050415 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:21.050391    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r5m9z_36724fee-b20c-435b-a906-e9c098932706/dns-node-resolver/0.log"
Jul 27 21:28:21.682902 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:21.682819    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wgfxv_a0f1489a-628e-4cc0-b2aa-fecc3bfa2e48/node-ca/0.log"
Jul 27 21:28:22.873469 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:22.873442    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-98www_42f45d03-86d4-44b3-9368-e7c84cd96496/discovery/0.log"
Jul 27 21:28:22.920519 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:22.920494    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86f57966b4-v8tsh_7c13b62a-e640-4e08-be6b-54932c7c86bf/kube-auth-proxy/0.log"
Jul 27 21:28:23.015727 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:23.015691    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-kkksr_4fd9f783-10f5-4d5c-bc65-ba3d1eb990e9/payload-pre-processing/0.log"
Jul 27 21:28:23.072877 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:23.072849    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84bfbc884c-qvrvp_1a26fdaf-9d7e-4108-b8b1-f028188d2922/router/0.log"
Jul 27 21:28:23.882557 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:23.882530    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gb2sz_e7eade65-21e0-49d0-9f9b-cd7400161efb/serve-healthcheck-canary/0.log"
Jul 27 21:28:24.372634 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:24.372599    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-tnq84_4113dabe-2d35-48f3-bb94-b377ee920246/insights-operator/0.log"
Jul 27 21:28:24.374405 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:24.374380    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-tnq84_4113dabe-2d35-48f3-bb94-b377ee920246/insights-operator/1.log"
Jul 27 21:28:24.471536 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:24.471507    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pxzn9_0d791f22-7d91-4ba5-8225-690d8b1d2df2/kube-rbac-proxy/0.log"
Jul 27 21:28:24.491621 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:24.491595    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pxzn9_0d791f22-7d91-4ba5-8225-690d8b1d2df2/exporter/0.log"
Jul 27 21:28:24.513107 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:24.513083    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pxzn9_0d791f22-7d91-4ba5-8225-690d8b1d2df2/extractor/0.log"
Jul 27 21:28:24.695682 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:24.695612    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-qhcv6"
Jul 27 21:28:27.362945 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:27.362907    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55f5c64d95-rfdss_e53fe4de-f981-4dd5-9016-9f32563aac1c/manager/0.log"
Jul 27 21:28:27.383737 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:27.383715    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lzpj7_bbc0eca5-fe9d-42f5-aabf-509f36c4c963/server/0.log"
Jul 27 21:28:27.510887 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:27.510790    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mvr6f_8de06676-b75e-4d35-b362-5a0eaa84e635/manager/0.log"
Jul 27 21:28:27.535233 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:27.535203    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b945668b-h2jg2_767d4400-0e3f-47ee-b1fa-1b4c729bca4c/manager/0.log"
Jul 27 21:28:27.558290 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:27.558254    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b945668b-h2jg2_767d4400-0e3f-47ee-b1fa-1b4c729bca4c/copy-manifests/0.log"
Jul 27 21:28:28.144663 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:28.144628    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-98www_42f45d03-86d4-44b3-9368-e7c84cd96496/discovery/0.log"
Jul 27 21:28:28.173063 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:28.173032    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86f57966b4-v8tsh_7c13b62a-e640-4e08-be6b-54932c7c86bf/kube-auth-proxy/0.log"
Jul 27 21:28:28.249968 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:28.249942    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-kkksr_4fd9f783-10f5-4d5c-bc65-ba3d1eb990e9/payload-pre-processing/0.log"
Jul 27 21:28:28.288806 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:28.288781    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84bfbc884c-qvrvp_1a26fdaf-9d7e-4108-b8b1-f028188d2922/router/0.log"
Jul 27 21:28:29.945885 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:29.945842    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-98www_42f45d03-86d4-44b3-9368-e7c84cd96496/discovery/0.log"
Jul 27 21:28:29.979843 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:29.979812    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86f57966b4-v8tsh_7c13b62a-e640-4e08-be6b-54932c7c86bf/kube-auth-proxy/0.log"
Jul 27 21:28:30.055810 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:30.055764    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-kkksr_4fd9f783-10f5-4d5c-bc65-ba3d1eb990e9/payload-pre-processing/0.log"
Jul 27 21:28:30.094144 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:30.094114    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84bfbc884c-qvrvp_1a26fdaf-9d7e-4108-b8b1-f028188d2922/router/0.log"
Jul 27 21:28:33.751363 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:33.751327    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-8mbwt_d81f303d-627e-4444-8776-f3f7a0b796a5/migrator/0.log"
Jul 27 21:28:33.776657 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:33.776628    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-8mbwt_d81f303d-627e-4444-8776-f3f7a0b796a5/graceful-termination/0.log"
Jul 27 21:28:34.132692 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:34.132665    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj_a6c193d5-281f-4d93-b21a-5adedf4bf8d8/kube-storage-version-migrator-operator/1.log"
Jul 27 21:28:34.134251 ip-10-0-143-205 kubenswrapper[2562]: I0727 21:28:34.134226    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-94hxj_a6c193d5-281f-4d93-b21a-5adedf4bf8d8/kube-storage-version-migrator-operator/0.log"