Jul 31 20:28:10.246808 ip-10-0-128-218 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 31 20:28:10.246818 ip-10-0-128-218 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 31 20:28:10.246826 ip-10-0-128-218 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 31 20:28:10.247048 ip-10-0-128-218 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 31 20:28:20.057755 ip-10-0-128-218 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 31 20:28:20.057769 ip-10-0-128-218 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 297db43cefe147c6b25fb4dafa2c2796 --
Jul 31 20:29:51.267080 ip-10-0-128-218 systemd[1]: Starting Kubernetes Kubelet...
Jul 31 20:29:51.706256 ip-10-0-128-218 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 20:29:51.706256 ip-10-0-128-218 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 31 20:29:51.706256 ip-10-0-128-218 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 20:29:51.706256 ip-10-0-128-218 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 31 20:29:51.706256 ip-10-0-128-218 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 20:29:51.708375 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.708232    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 31 20:29:51.713242 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713226    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 20:29:51.713242 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713242    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713247    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713252    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713255    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713258    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713261    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713264    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713267    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713270    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713280    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713284    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713288    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713292    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713295    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713298    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713301    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713304    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713307    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713309    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 20:29:51.713305 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713312    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713315    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713318    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713321    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713323    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713326    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713329    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713332    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713334    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713337    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713339    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713342    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713350    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713353    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713355    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713358    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713361    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713364    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713367    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713369    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 20:29:51.713773 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713372    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713374    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713377    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713380    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713382    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713385    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713387    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713389    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713393    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713397    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713400    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713402    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713405    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713408    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713411    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713414    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713417    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713421    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713423    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713426    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 20:29:51.714293 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713428    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713430    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713433    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713435    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713438    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713441    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713443    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713445    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713448    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713450    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713453    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713455    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713458    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713460    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713463    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713465    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713468    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713471    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713473    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713475    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 20:29:51.714794 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713478    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713480    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713483    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713485    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713488    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713490    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713494    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713497    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713499    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713502    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713504    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713507    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713509    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713512    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713514    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713517    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713519    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713522    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.713525    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 20:29:51.715274 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714283    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714291    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714294    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714298    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714301    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714304    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714307    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714310    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714313    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714316    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714319    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714322    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714325    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714328    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714331    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714333    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714337    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714339    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714343    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714346    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 20:29:51.715724 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714349    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714352    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714355    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714357    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714360    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714362    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714364    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714369    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714373    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714376    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714379    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714381    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714384    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714387    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714389    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714392    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714394    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714397    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714399    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714402    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 20:29:51.716235 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714405    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714407    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714410    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714413    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714415    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714418    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714420    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714423    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714425    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714428    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714431    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714434    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714436    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714439    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714441    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714444    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714447    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714450    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714452    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714455    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 20:29:51.716785 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714457    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714460    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714462    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714465    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714467    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714470    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714472    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714477    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714480    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714483    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714486    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714489    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714491    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714494    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714496    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714499    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714502    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714505    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714507    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714510    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 20:29:51.717273 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714513    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714515    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714518    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714521    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714523    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714526    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714529    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714531    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714534    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714536    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714539    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714542    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714544    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714547    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714549    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714552    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714554    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714558    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714561    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 20:29:51.717772 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714991    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.714997    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715001    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715004    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715007    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715010    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715013    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715016    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715019    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715023    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715026    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715029    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715031    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715034    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715036    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715039    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715043    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715045    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715048    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715051    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 20:29:51.718233 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715053    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715056    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715058    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715061    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715063    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715066    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715068    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715071    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715074    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715076    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715079    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715082    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715085    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715087    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715090    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715092    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715095    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715097    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715101    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 20:29:51.718704 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715105    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715107    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715110    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715113    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715115    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715118    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715121    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715123    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715126    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715132    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715134    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715136    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715139    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715142    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715144    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715147    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715149    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715152    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715154    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715156    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 20:29:51.719178 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715159    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715161    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715164    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715166    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715168    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715171    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715173    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715177    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715180    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715183    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715186    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715190    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715193    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715196    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715198    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715201    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715204    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715207    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715209    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 20:29:51.719668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715212    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715215    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715219    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715221    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715224    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715228    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715231    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715233    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715236    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715238    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715241    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715244    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715246    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715248    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715251    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715255    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715257    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715260    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715262    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715265    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 20:29:51.720138 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.715267    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715348    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715359    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715370    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715376    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715381    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715385    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715389    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715399    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715402    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715407    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715410    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715414    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715417    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715422    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715425    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715428    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715431    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715434    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715438    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715441    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715444    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715448    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715451    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 31 20:29:51.720616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715455    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715458    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715461    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715465    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715468    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715471    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715474    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715477    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715480    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715484    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715488    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715491    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715494    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715497    2565 flags.go:64] FLAG: --enable-server="true"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715500    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715505    2565 flags.go:64] FLAG: --event-burst="100"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715508    2565 flags.go:64] FLAG: --event-qps="50"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715511    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715514    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715517    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715521    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715524    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715528    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715531    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715534    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 31 20:29:51.721211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715537    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715540    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715543    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715546    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715549    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715552    2565 flags.go:64] FLAG: --feature-gates=""
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715556    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715559    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715562    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715565    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715568    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715571    2565 flags.go:64] FLAG: --help="false"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715574    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-128-218.ec2.internal"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715577    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715580    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715583    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715586    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715592    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715595    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715598    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715601    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715604    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715607    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715610    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 31 20:29:51.721847 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715613    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715616    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715619    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715622    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715625    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715630    2565 flags.go:64] FLAG: --lock-file=""
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715632    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715635    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715638    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715644    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715647    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715650    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715653    2565 flags.go:64] FLAG: --logging-format="text"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715656    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715659    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715663    2565 flags.go:64] FLAG: --manifest-url=""
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715665    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715669    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715673    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715676    2565 flags.go:64] FLAG: --max-pods="110"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715679    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715683    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715685    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715688    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715692    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 31 20:29:51.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715696    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715699    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715706    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715709    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715712    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715717    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715720    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715725    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715728    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715751    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715755    2565 flags.go:64] FLAG: --port="10250"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715759    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715763    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b8c4128724af3dee"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715766    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715770    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715772    2565 flags.go:64] FLAG: --register-node="true"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715775    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715779    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715782    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715785    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715787    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715791    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715794    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715797    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715800    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 31 20:29:51.723063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715803    2565 flags.go:64] FLAG: --runonce="false"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715806    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715809    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715812    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715814    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715818    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715820    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715823    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715827    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715830    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715833    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715836    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715838    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715842    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715844    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715847    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715852    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715855    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715858    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715863    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715866    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715868    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715871    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715874    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715877    2565 flags.go:64] FLAG: --v="2"
Jul 31 20:29:51.724183 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715881    2565 flags.go:64] FLAG: --version="false"
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715885    2565 flags.go:64] FLAG: --vmodule=""
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715889    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.715892    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716012    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716017    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716020    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716023    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716026    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716029    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716032    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716034    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716038    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716041    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716044    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716047    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716050    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716053    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716056    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716058    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 20:29:51.724904 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716061    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716064    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716067    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716070    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716072    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716074    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716077    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716081    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716083    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716086    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716088    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716091    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716094    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716096    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716099    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716101    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716103    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716106    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716108    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716111    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 20:29:51.725399 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716113    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716116    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716118    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716121    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716123    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716126    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716129    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716131    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716134    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716136    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716138    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716141    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716143    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716146    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716148    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716151    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716153    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716155    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716158    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716161    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 20:29:51.725901 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716163    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716166    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716169    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716171    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716174    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716176    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716178    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716181    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716183    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716186    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716188    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716190    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716193    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716195    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716198    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716200    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716204    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716207    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716211    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 20:29:51.726417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716213    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716216    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716218    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716220    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716223    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716225    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716228    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716230    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716232    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716235    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716238    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716242    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716245    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716248    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716250    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716253    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716256    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716258    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716260    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716263    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 20:29:51.726900 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716265    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 20:29:51.727388 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716268    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 20:29:51.727388 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716270    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 20:29:51.727388 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.716273    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 20:29:51.727388 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.716914    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 20:29:51.727388 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.726092    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 31 20:29:51.727388 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.726108    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 31 20:29:51.727388 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.726128    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 31 20:29:51.727388 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.726134    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 31 20:29:51.727388 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726197    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 20:29:51.727388 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726202    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 20:29:51.727388 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726205    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 20:29:51.727388 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726208    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 20:29:51.727388 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726211    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 20:29:51.727388 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726214    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726217    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726220    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726222    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726225    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726228    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726230    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726233    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726235    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726238    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726241    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726243    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726246    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726249    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726251    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726254    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726256    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726259    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726261    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726264    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 20:29:51.727746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726267    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 20:29:51.728236 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726269    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 20:29:51.728236 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726272    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 20:29:51.728236 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726275    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 20:29:51.728236 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726278    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 20:29:51.728236 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726280    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 20:29:51.728236 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726283    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 20:29:51.728236 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726285    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 20:29:51.728236 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726287    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 20:29:51.728236 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726292    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 20:29:51.728236 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726296    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 20:29:51.728236 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726299    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 20:29:51.728236 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726303    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 20:29:51.728236 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726305    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 20:29:51.728236 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726310    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 20:29:51.728236 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726313    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 20:29:51.728236 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726316    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 20:29:51.728236 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726320    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 20:29:51.728236 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726325    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726328    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726331    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726340    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726343    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726345    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726348    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726351    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726354    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726357    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726359    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726362    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726365    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726367    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726370    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726373    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726375    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726378    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726381    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726384    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 20:29:51.728671 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726386    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726389    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726391    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726394    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726396    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726399    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726402    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726404    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726407    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726409    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726412    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726415    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726417    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726420    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726422    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726425    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726433    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726436    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726439    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726441    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 20:29:51.729159 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726444    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 20:29:51.729670 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726447    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 20:29:51.729670 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726449    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 20:29:51.729670 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726452    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 20:29:51.729670 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726455    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 20:29:51.729670 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726457    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 20:29:51.729670 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726460    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 20:29:51.729670 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726463    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 20:29:51.729670 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726465    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 20:29:51.729670 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726468    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 20:29:51.729670 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726471    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 20:29:51.729670 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726473    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 20:29:51.729670 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726476    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 20:29:51.729670 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726478    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 20:29:51.729670 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726481    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 20:29:51.729670 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726483    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 20:29:51.729670 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.726488    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726613    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726618    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726621    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726624    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726627    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726629    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726632    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726635    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726637    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726640    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726642    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726645    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726648    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726651    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726654    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726656    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726659    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726663    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 20:29:51.730160 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726666    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726670    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726673    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726676    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726679    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726682    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726685    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726688    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726691    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726693    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726696    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726698    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726701    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726703    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726707    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726709    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726712    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726714    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726717    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 20:29:51.730668 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726720    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726722    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726724    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726727    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726730    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726750    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726753    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726756    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726760    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726762    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726765    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726767    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726770    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726772    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726775    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726777    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726780    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726783    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726785    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726788    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 20:29:51.731150 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726790    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726793    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726795    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726798    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726800    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726803    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726805    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726808    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726810    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726813    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726815    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726818    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726820    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726823    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726825    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726829    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726832    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726834    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726837    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 20:29:51.731638 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726839    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726842    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726846    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726848    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726851    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726853    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726855    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726858    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726860    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726863    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726865    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726868    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726871    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726873    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726875    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726878    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726881    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726883    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726885    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726888    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 20:29:51.732137 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726890    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 20:29:51.732626 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726893    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 20:29:51.732626 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:51.726895    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 20:29:51.732626 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.726901    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 20:29:51.732626 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.727019    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 31 20:29:51.732626 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.730354    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 31 20:29:51.732626 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.731978    2565 server.go:1019] "Starting client certificate rotation"
Jul 31 20:29:51.732626 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.732081    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 20:29:51.732983 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.732970    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 20:29:51.734746 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.734723    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 20:29:51.739207 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.739188    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 20:29:51.753432 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.753411    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 31 20:29:51.756143 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.756128    2565 log.go:25] "Validated CRI v1 image API"
Jul 31 20:29:51.757195 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.757181    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 31 20:29:51.762306 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.762287    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 20:29:51.762414 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.762349    2565 fs.go:135] Filesystem UUIDs: map[166246c7-e14d-46f5-8378-2e18c1f94504:/dev/nvme0n1p4 5634fa6b-bc66-4da8-8d77-81921a1acc8d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 31 20:29:51.762414 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.762371    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 31 20:29:51.767750 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.767627    2565 manager.go:216] Machine: {Timestamp:2026-07-31 20:29:51.76633712 +0000 UTC m=+0.371631477 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100086 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ee043de35e3af8eef283077e9ac5d SystemUUID:ec2ee043-de35-e3af-8eef-283077e9ac5d BootID:297db43c-efe1-47c6-b25f-b4dafa2c2796 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d6:1f:31:06:bb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d6:1f:31:06:bb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:74:22:0d:fe:c8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 31 20:29:51.767836 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.767752    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 31 20:29:51.767868 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.767833    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 31 20:29:51.771188 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.771162    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 31 20:29:51.771334 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.771190    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-218.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 31 20:29:51.772547 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.772537    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 31 20:29:51.772579 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.772549    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 31 20:29:51.772579 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.772557    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 20:29:51.773784 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.773773    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 20:29:51.775539 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.775529    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 31 20:29:51.781251 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.781239    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 20:29:51.781367 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.781358    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 31 20:29:51.781397 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.781387    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 31 20:29:51.781424 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.781397    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 31 20:29:51.781424 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.781418    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 31 20:29:51.781479 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.781430    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 31 20:29:51.781479 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.781439    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 31 20:29:51.781875 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.781834    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 20:29:51.781875 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.781852    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 20:29:51.784196 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.784177    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 31 20:29:51.785905 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.785889    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 31 20:29:51.785991 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.785924    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 31 20:29:51.786714 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.786702    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 31 20:29:51.786777 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.786719    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 31 20:29:51.786777 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.786725    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 31 20:29:51.786777 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.786751    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 31 20:29:51.786777 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.786763    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 31 20:29:51.786777 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.786769    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 31 20:29:51.786777 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.786776    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 31 20:29:51.786942 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.786782    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 31 20:29:51.786942 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.786789    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 31 20:29:51.786942 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.786794    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 31 20:29:51.786942 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.786802    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 31 20:29:51.786942 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.786807    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 31 20:29:51.787651 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.787636    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 31 20:29:51.787651 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.787649    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 31 20:29:51.790994 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.790980    2565 server.go:1268] "Started kubelet"
Jul 31 20:29:51.791122 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.791091    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 31 20:29:51.791179 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.791084    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 31 20:29:51.791225 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.791202    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 31 20:29:51.791996 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.791848    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-218.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 31 20:29:51.792030 ip-10-0-128-218 systemd[1]: Started Kubernetes Kubelet.
Jul 31 20:29:51.792713 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:51.792690    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-218.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 31 20:29:51.792823 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.792804    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 31 20:29:51.792974 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:51.792883    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 31 20:29:51.793096 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.793048    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 31 20:29:51.797912 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:51.797891    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 31 20:29:51.799700 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:51.798621    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-218.ec2.internal.18c779e2af93a934  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-218.ec2.internal,UID:ip-10-0-128-218.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-218.ec2.internal,},FirstTimestamp:2026-07-31 20:29:51.790950708 +0000 UTC m=+0.396245061,LastTimestamp:2026-07-31 20:29:51.790950708 +0000 UTC m=+0.396245061,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-218.ec2.internal,}"
Jul 31 20:29:51.800949 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.800929    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 31 20:29:51.800949 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.800937    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 31 20:29:51.801086 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:51.801062    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-218.ec2.internal\" not found"
Jul 31 20:29:51.801790 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.801771    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 31 20:29:51.801790 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.801771    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 31 20:29:51.801921 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.801801    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 31 20:29:51.802212 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.802196    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 31 20:29:51.802212 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.802211    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 31 20:29:51.802633 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.802599    2565 factory.go:55] Registering systemd factory
Jul 31 20:29:51.802705 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.802638    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 31 20:29:51.802937 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.802916    2565 factory.go:153] Registering CRI-O factory
Jul 31 20:29:51.802937 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.802938    2565 factory.go:223] Registration of the crio container factory successfully
Jul 31 20:29:51.803717 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.803702    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 31 20:29:51.803854 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.803843    2565 factory.go:103] Registering Raw factory
Jul 31 20:29:51.803945 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.803938    2565 manager.go:1196] Started watching for new ooms in manager
Jul 31 20:29:51.804532 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.804515    2565 manager.go:349] Starting recovery of all containers
Jul 31 20:29:51.805840 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.805820    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gf7rt"
Jul 31 20:29:51.806771 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:51.806751    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 31 20:29:51.806874 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:51.806854    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-218.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 31 20:29:51.811048 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.811027    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gf7rt"
Jul 31 20:29:51.818148 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.818132    2565 manager.go:354] Recovery completed
Jul 31 20:29:51.822811 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.822798    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 20:29:51.825922 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.825901    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 20:29:51.825981 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.825936    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 20:29:51.825981 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.825947    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasSufficientPID"
Jul 31 20:29:51.826585 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.826567    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 31 20:29:51.826585 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.826585    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 31 20:29:51.826585 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.826596    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 20:29:51.826585 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.826602    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 20:29:51.827449 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:51.827381    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-218.ec2.internal.18c779e2b1a94db0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-218.ec2.internal,UID:ip-10-0-128-218.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-218.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-218.ec2.internal,},FirstTimestamp:2026-07-31 20:29:51.825923504 +0000 UTC m=+0.431217857,LastTimestamp:2026-07-31 20:29:51.825923504 +0000 UTC m=+0.431217857,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-218.ec2.internal,}"
Jul 31 20:29:51.828018 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.828001    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 20:29:51.828077 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.828032    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 20:29:51.828077 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.828041    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasSufficientPID"
Jul 31 20:29:51.828727 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.828715    2565 policy_none.go:49] "None policy: Start"
Jul 31 20:29:51.828783 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.828750    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 31 20:29:51.828783 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.828763    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 31 20:29:51.830775 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.830765    2565 policy_none.go:47] "Start"
Jul 31 20:29:51.869444 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.869292    2565 manager.go:337] "Starting Device Plugin manager"
Jul 31 20:29:51.888669 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:51.869466    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 31 20:29:51.888669 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.869482    2565 server.go:87] "Starting device plugin registration server"
Jul 31 20:29:51.888669 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.869963    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 31 20:29:51.888669 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.869978    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 31 20:29:51.888669 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.870074    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 31 20:29:51.888669 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.870165    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 31 20:29:51.888669 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.870174    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 31 20:29:51.888669 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:51.870765    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 31 20:29:51.888669 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:51.870813    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-218.ec2.internal\" not found"
Jul 31 20:29:51.907215 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.907177    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 31 20:29:51.908551 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.908535    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 31 20:29:51.908599 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.908573    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 31 20:29:51.908599 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.908596    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 31 20:29:51.908676 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:51.908630    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 31 20:29:51.910908 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.910878    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 20:29:51.971052 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.970961    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 20:29:51.971935 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.971916    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 20:29:51.972016 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.971953    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 20:29:51.972016 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.971969    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasSufficientPID"
Jul 31 20:29:51.972016 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.971993    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-218.ec2.internal"
Jul 31 20:29:51.983580 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:51.983559    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-218.ec2.internal"
Jul 31 20:29:51.983641 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:51.983584    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-218.ec2.internal\": node \"ip-10-0-128-218.ec2.internal\" not found"
Jul 31 20:29:52.002798 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:52.002776    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-218.ec2.internal\" not found"
Jul 31 20:29:52.008961 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.008939    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-218.ec2.internal"]
Jul 31 20:29:52.009015 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.009001    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 20:29:52.010493 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.010477    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 20:29:52.010557 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.010506    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 20:29:52.010557 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.010521    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasSufficientPID"
Jul 31 20:29:52.012775 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.012763    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 20:29:52.012836 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.012815    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal"
Jul 31 20:29:52.012887 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.012856    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 20:29:52.013513 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.013491    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 20:29:52.013611 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.013495    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 20:29:52.013611 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.013545    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 20:29:52.013611 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.013560    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasSufficientPID"
Jul 31 20:29:52.013611 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.013522    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 20:29:52.013611 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.013596    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasSufficientPID"
Jul 31 20:29:52.015671 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.015658    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-218.ec2.internal"
Jul 31 20:29:52.015726 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.015685    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 20:29:52.016343 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.016324    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 20:29:52.016412 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.016357    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 20:29:52.016412 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.016371    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeHasSufficientPID"
Jul 31 20:29:52.044496 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:52.044470    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-218.ec2.internal\" not found" node="ip-10-0-128-218.ec2.internal"
Jul 31 20:29:52.048241 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:52.048225    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-218.ec2.internal\" not found" node="ip-10-0-128-218.ec2.internal"
Jul 31 20:29:52.103282 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:52.103254    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-218.ec2.internal\" not found"
Jul 31 20:29:52.103399 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.103308    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/968e482da3adef699dc32ad47471cf95-config\") pod \"kube-apiserver-proxy-ip-10-0-128-218.ec2.internal\" (UID: \"968e482da3adef699dc32ad47471cf95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-218.ec2.internal"
Jul 31 20:29:52.103399 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.103350    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8401e86f5150f5d30d8647acb9eda871-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal\" (UID: \"8401e86f5150f5d30d8647acb9eda871\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal"
Jul 31 20:29:52.103399 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.103368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8401e86f5150f5d30d8647acb9eda871-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal\" (UID: \"8401e86f5150f5d30d8647acb9eda871\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal"
Jul 31 20:29:52.203666 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:52.203623    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-218.ec2.internal\" not found"
Jul 31 20:29:52.203666 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.203657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8401e86f5150f5d30d8647acb9eda871-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal\" (UID: \"8401e86f5150f5d30d8647acb9eda871\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal"
Jul 31 20:29:52.203802 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.203685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8401e86f5150f5d30d8647acb9eda871-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal\" (UID: \"8401e86f5150f5d30d8647acb9eda871\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal"
Jul 31 20:29:52.203802 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.203703    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/968e482da3adef699dc32ad47471cf95-config\") pod \"kube-apiserver-proxy-ip-10-0-128-218.ec2.internal\" (UID: \"968e482da3adef699dc32ad47471cf95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-218.ec2.internal"
Jul 31 20:29:52.203802 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.203764    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/968e482da3adef699dc32ad47471cf95-config\") pod \"kube-apiserver-proxy-ip-10-0-128-218.ec2.internal\" (UID: \"968e482da3adef699dc32ad47471cf95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-218.ec2.internal"
Jul 31 20:29:52.203802 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.203781    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8401e86f5150f5d30d8647acb9eda871-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal\" (UID: \"8401e86f5150f5d30d8647acb9eda871\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal"
Jul 31 20:29:52.203802 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.203781    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8401e86f5150f5d30d8647acb9eda871-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal\" (UID: \"8401e86f5150f5d30d8647acb9eda871\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal"
Jul 31 20:29:52.304310 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:52.304230    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-218.ec2.internal\" not found"
Jul 31 20:29:52.346444 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.346415    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal"
Jul 31 20:29:52.350511 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.350489    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-218.ec2.internal"
Jul 31 20:29:52.404840 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:52.404806    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-218.ec2.internal\" not found"
Jul 31 20:29:52.505212 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:52.505176    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-218.ec2.internal\" not found"
Jul 31 20:29:52.605674 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:52.605596    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-218.ec2.internal\" not found"
Jul 31 20:29:52.686928 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.686895    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 20:29:52.706029 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:52.706001    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-218.ec2.internal\" not found"
Jul 31 20:29:52.731173 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.731148    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 31 20:29:52.731613 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.731285    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 20:29:52.731613 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.731348    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 20:29:52.806064 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:52.806039    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-218.ec2.internal\" not found"
Jul 31 20:29:52.818934 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.818901    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 20:24:52 +0000 UTC" deadline="2028-02-05 02:22:03.020958392 +0000 UTC"
Jul 31 20:29:52.818934 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:52.818929    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13277h52m10.202033454s"
Jul 31 20:29:52.906531 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:52.906432    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-218.ec2.internal\" not found"
Jul 31 20:29:53.006815 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:53.006779    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-218.ec2.internal\" not found"
Jul 31 20:29:53.107189 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:53.107148    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-218.ec2.internal\" not found"
Jul 31 20:29:53.159461 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.159400    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 20:29:53.162290 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:53.162262    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8401e86f5150f5d30d8647acb9eda871.slice/crio-49b2f720fc25bbbdf4ee89b148fb851a424ba8fd858cb9ee0a18bc1018f31b3d WatchSource:0}: Error finding container 49b2f720fc25bbbdf4ee89b148fb851a424ba8fd858cb9ee0a18bc1018f31b3d: Status 404 returned error can't find the container with id 49b2f720fc25bbbdf4ee89b148fb851a424ba8fd858cb9ee0a18bc1018f31b3d
Jul 31 20:29:53.166721 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.166703    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 20:29:53.172222 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:53.172196    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod968e482da3adef699dc32ad47471cf95.slice/crio-888b52fcfd6e4f00f533f08c8c49742fc10dbd22edec1a9ec847632bf8542e51 WatchSource:0}: Error finding container 888b52fcfd6e4f00f533f08c8c49742fc10dbd22edec1a9ec847632bf8542e51: Status 404 returned error can't find the container with id 888b52fcfd6e4f00f533f08c8c49742fc10dbd22edec1a9ec847632bf8542e51
Jul 31 20:29:53.201452 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.201414    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal"
Jul 31 20:29:53.215630 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.215608    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 20:29:53.216746 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.216729    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-218.ec2.internal"
Jul 31 20:29:53.224663 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.224639    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 20:29:53.240256 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.240236    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 20:29:53.783075 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.783041    2565 apiserver.go:52] "Watching apiserver"
Jul 31 20:29:53.788472 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.788445    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 31 20:29:53.790047 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.790015    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-zf99r","kube-system/global-pull-secret-syncer-h7klt","kube-system/konnectivity-agent-c5d4j","kube-system/kube-apiserver-proxy-ip-10-0-128-218.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl","openshift-cluster-node-tuning-operator/tuned-plzhp","openshift-image-registry/node-ca-ttm25","openshift-multus/multus-additional-cni-plugins-vfbbm","openshift-multus/multus-vhpsx","openshift-dns/node-resolver-2xczz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal","openshift-multus/network-metrics-daemon-dqzzx","openshift-network-diagnostics/network-check-target-nbhtt","openshift-network-operator/iptables-alerter-l4g5k"]
Jul 31 20:29:53.792777 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.792734    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2xczz"
Jul 31 20:29:53.794917 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.794877    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 31 20:29:53.795033 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.794959    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 31 20:29:53.795153 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.795135    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6zphn\""
Jul 31 20:29:53.795253 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.795232    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:29:53.795343 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:53.795308    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqzzx" podUID="78163815-3577-406a-ba59-f7e6784b6377"
Jul 31 20:29:53.797764 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.797746    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c5d4j"
Jul 31 20:29:53.799661 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.799642    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 31 20:29:53.799781 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.799682    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-48qf2\""
Jul 31 20:29:53.799781 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.799651    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 31 20:29:53.800080 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.800055    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l4g5k"
Jul 31 20:29:53.802849 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.802470    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 31 20:29:53.802849 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.802554    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 31 20:29:53.803031 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.802921    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 31 20:29:53.803031 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.803005    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ht5s9\""
Jul 31 20:29:53.803333 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.803310    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 31 20:29:53.804504 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.804481    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.806440 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.806420    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 31 20:29:53.806814 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.806741    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 31 20:29:53.806908 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.806800    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 31 20:29:53.806908 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.806803    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sklbh\""
Jul 31 20:29:53.807019 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.806966    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:53.808741 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.808722    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 31 20:29:53.808962 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.808947    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w9mfk\""
Jul 31 20:29:53.809142 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.809122    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 31 20:29:53.809434 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.809415    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:53.810965 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.810947    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 31 20:29:53.811136 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.811114    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 31 20:29:53.811208 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.811153    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 31 20:29:53.811265 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.811250    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 31 20:29:53.811368 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.811346    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3364e041-5213-4dff-9c10-7d76ee5d2c85-etc-selinux\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.811435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.811377    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w8rws\""
Jul 31 20:29:53.811435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.811375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f-hosts-file\") pod \"node-resolver-2xczz\" (UID: \"bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f\") " pod="openshift-dns/node-resolver-2xczz"
Jul 31 20:29:53.811656 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.811435    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/512e2144-7eb2-4aff-af11-30f449160993-agent-certs\") pod \"konnectivity-agent-c5d4j\" (UID: \"512e2144-7eb2-4aff-af11-30f449160993\") " pod="kube-system/konnectivity-agent-c5d4j"
Jul 31 20:29:53.811656 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.811466    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3364e041-5213-4dff-9c10-7d76ee5d2c85-socket-dir\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.811656 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.811493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3364e041-5213-4dff-9c10-7d76ee5d2c85-sys-fs\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.811855 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.811665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f-tmp-dir\") pod \"node-resolver-2xczz\" (UID: \"bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f\") " pod="openshift-dns/node-resolver-2xczz"
Jul 31 20:29:53.811855 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.811715    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd2s9\" (UniqueName: \"kubernetes.io/projected/78163815-3577-406a-ba59-f7e6784b6377-kube-api-access-fd2s9\") pod \"network-metrics-daemon-dqzzx\" (UID: \"78163815-3577-406a-ba59-f7e6784b6377\") " pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:29:53.811855 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.811751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3364e041-5213-4dff-9c10-7d76ee5d2c85-registration-dir\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.811855 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.811816    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s94zs\" (UniqueName: \"kubernetes.io/projected/bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f-kube-api-access-s94zs\") pod \"node-resolver-2xczz\" (UID: \"bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f\") " pod="openshift-dns/node-resolver-2xczz"
Jul 31 20:29:53.811855 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.811845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/512e2144-7eb2-4aff-af11-30f449160993-konnectivity-ca\") pod \"konnectivity-agent-c5d4j\" (UID: \"512e2144-7eb2-4aff-af11-30f449160993\") " pod="kube-system/konnectivity-agent-c5d4j"
Jul 31 20:29:53.812128 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.811872    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0905f420-9a41-422c-90cd-ad250dfb6169-iptables-alerter-script\") pod \"iptables-alerter-l4g5k\" (UID: \"0905f420-9a41-422c-90cd-ad250dfb6169\") " pod="openshift-network-operator/iptables-alerter-l4g5k"
Jul 31 20:29:53.812128 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.811921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0905f420-9a41-422c-90cd-ad250dfb6169-host-slash\") pod \"iptables-alerter-l4g5k\" (UID: \"0905f420-9a41-422c-90cd-ad250dfb6169\") " pod="openshift-network-operator/iptables-alerter-l4g5k"
Jul 31 20:29:53.812128 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.812050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hztfs\" (UniqueName: \"kubernetes.io/projected/0905f420-9a41-422c-90cd-ad250dfb6169-kube-api-access-hztfs\") pod \"iptables-alerter-l4g5k\" (UID: \"0905f420-9a41-422c-90cd-ad250dfb6169\") " pod="openshift-network-operator/iptables-alerter-l4g5k"
Jul 31 20:29:53.812128 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.812117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft29f\" (UniqueName: \"kubernetes.io/projected/3364e041-5213-4dff-9c10-7d76ee5d2c85-kube-api-access-ft29f\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.812319 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.812166    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs\") pod \"network-metrics-daemon-dqzzx\" (UID: \"78163815-3577-406a-ba59-f7e6784b6377\") " pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:29:53.812319 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.812197    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ttm25"
Jul 31 20:29:53.812319 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.812207    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3364e041-5213-4dff-9c10-7d76ee5d2c85-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.812319 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.812234    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3364e041-5213-4dff-9c10-7d76ee5d2c85-device-dir\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.813866 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.813846    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hlqkm\""
Jul 31 20:29:53.814022 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.814003    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 31 20:29:53.814078 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.814064    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 31 20:29:53.814139 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.814104    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 20:29:53.814199 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.814151    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 31 20:29:53.814713 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.814507    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:29:53.814713 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:53.814578    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7klt" podUID="d6c4d228-4d34-47bd-9881-60e38a8a56e3"
Jul 31 20:29:53.817234 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.817215    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.820851 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.820829    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 31 20:29:53.820957 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.820881    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8qhn9\""
Jul 31 20:29:53.820957 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.820897    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 31 20:29:53.820957 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.820840    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 31 20:29:53.821133 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.821038    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 31 20:29:53.821133 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.821075    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 31 20:29:53.821133 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.821135    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 31 20:29:53.821325 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.821302    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:53.823393 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.823163    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 31 20:29:53.823393 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.823170    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5t7pr\""
Jul 31 20:29:53.823393 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.823197    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 31 20:29:53.823879 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.823851    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:29:53.824009 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:53.823931    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nbhtt" podUID="184c96b5-fe65-47a8-a9d1-a0d590bd1765"
Jul 31 20:29:53.838516 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.838492    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hrn6l"
Jul 31 20:29:53.847445 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.846843    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hrn6l"
Jul 31 20:29:53.882392 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.882225    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 20:29:53.903969 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.903948    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 31 20:29:53.913130 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.913105    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3364e041-5213-4dff-9c10-7d76ee5d2c85-device-dir\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.913348 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.913315    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-modprobe-d\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:53.913461 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.913364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-multus-socket-dir-parent\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:53.913461 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.913393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-host-run-netns\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:53.913461 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.913433    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/512e2144-7eb2-4aff-af11-30f449160993-agent-certs\") pod \"konnectivity-agent-c5d4j\" (UID: \"512e2144-7eb2-4aff-af11-30f449160993\") " pod="kube-system/konnectivity-agent-c5d4j"
Jul 31 20:29:53.913594 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.913466    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3364e041-5213-4dff-9c10-7d76ee5d2c85-socket-dir\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.913594 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.913505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd2s9\" (UniqueName: \"kubernetes.io/projected/78163815-3577-406a-ba59-f7e6784b6377-kube-api-access-fd2s9\") pod \"network-metrics-daemon-dqzzx\" (UID: \"78163815-3577-406a-ba59-f7e6784b6377\") " pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:29:53.913594 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.913535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-run-netns\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.913594 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.913576    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-run-systemd\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.913724 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.913639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t4hv\" (UniqueName: \"kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv\") pod \"network-check-target-nbhtt\" (UID: \"184c96b5-fe65-47a8-a9d1-a0d590bd1765\") " pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:29:53.913724 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.913695    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/854d7548-0ae4-42ee-9ae5-126639dc479c-cni-binary-copy\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:53.913839 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.913732    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/732589ca-b2a0-48d3-aa09-0ab535fb7d94-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:53.913839 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.913790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-host\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:53.913907 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.913875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-run-ovn\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.913954 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.913911    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fcgg\" (UniqueName: \"kubernetes.io/projected/211c1840-13e1-474b-9b24-f231cea1964e-kube-api-access-5fcgg\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.913954 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.913946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-run\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:53.914019 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.913979    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0905f420-9a41-422c-90cd-ad250dfb6169-host-slash\") pod \"iptables-alerter-l4g5k\" (UID: \"0905f420-9a41-422c-90cd-ad250dfb6169\") " pod="openshift-network-operator/iptables-alerter-l4g5k"
Jul 31 20:29:53.914053 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.914034    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hztfs\" (UniqueName: \"kubernetes.io/projected/0905f420-9a41-422c-90cd-ad250dfb6169-kube-api-access-hztfs\") pod \"iptables-alerter-l4g5k\" (UID: \"0905f420-9a41-422c-90cd-ad250dfb6169\") " pod="openshift-network-operator/iptables-alerter-l4g5k"
Jul 31 20:29:53.914083 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.914061    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-cni-bin\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.914128 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.914092    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-lib-modules\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:53.914354 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.914331    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-host-var-lib-kubelet\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:53.914812 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.914763    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0905f420-9a41-422c-90cd-ad250dfb6169-host-slash\") pod \"iptables-alerter-l4g5k\" (UID: \"0905f420-9a41-422c-90cd-ad250dfb6169\") " pod="openshift-network-operator/iptables-alerter-l4g5k"
Jul 31 20:29:53.915317 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.915285    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 31 20:29:53.915985 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.915960    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3364e041-5213-4dff-9c10-7d76ee5d2c85-socket-dir\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.916341 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f-hosts-file\") pod \"node-resolver-2xczz\" (UID: \"bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f\") " pod="openshift-dns/node-resolver-2xczz"
Jul 31 20:29:53.916415 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916360    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d6c4d228-4d34-47bd-9881-60e38a8a56e3-dbus\") pod \"global-pull-secret-syncer-h7klt\" (UID: \"d6c4d228-4d34-47bd-9881-60e38a8a56e3\") " pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:29:53.916415 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916390    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret\") pod \"global-pull-secret-syncer-h7klt\" (UID: \"d6c4d228-4d34-47bd-9881-60e38a8a56e3\") " pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:29:53.916525 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916428    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-node-log\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.916525 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916454    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-cni-netd\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.916525 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916479    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-tuned\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:53.916525 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916503    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-hostroot\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:53.916731 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916526    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-multus-conf-dir\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:53.916731 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916551    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-systemd-units\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.916731 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916611    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.916731 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916641    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/211c1840-13e1-474b-9b24-f231cea1964e-env-overrides\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.916731 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-var-lib-kubelet\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:53.916731 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916690    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vtns\" (UniqueName: \"kubernetes.io/projected/e0d719da-980c-4f82-8dbe-c0c416ce0a66-kube-api-access-5vtns\") pod \"node-ca-ttm25\" (UID: \"e0d719da-980c-4f82-8dbe-c0c416ce0a66\") " pod="openshift-image-registry/node-ca-ttm25"
Jul 31 20:29:53.916731 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/732589ca-b2a0-48d3-aa09-0ab535fb7d94-cni-binary-copy\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:53.917104 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916744    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s94zs\" (UniqueName: \"kubernetes.io/projected/bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f-kube-api-access-s94zs\") pod \"node-resolver-2xczz\" (UID: \"bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f\") " pod="openshift-dns/node-resolver-2xczz"
Jul 31 20:29:53.917104 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916772    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/512e2144-7eb2-4aff-af11-30f449160993-konnectivity-ca\") pod \"konnectivity-agent-c5d4j\" (UID: \"512e2144-7eb2-4aff-af11-30f449160993\") " pod="kube-system/konnectivity-agent-c5d4j"
Jul 31 20:29:53.917104 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0905f420-9a41-422c-90cd-ad250dfb6169-iptables-alerter-script\") pod \"iptables-alerter-l4g5k\" (UID: \"0905f420-9a41-422c-90cd-ad250dfb6169\") " pod="openshift-network-operator/iptables-alerter-l4g5k"
Jul 31 20:29:53.917104 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916865    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d6c4d228-4d34-47bd-9881-60e38a8a56e3-kubelet-config\") pod \"global-pull-secret-syncer-h7klt\" (UID: \"d6c4d228-4d34-47bd-9881-60e38a8a56e3\") " pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:29:53.917104 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-slash\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.917104 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.916924    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/732589ca-b2a0-48d3-aa09-0ab535fb7d94-cnibin\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:53.917104 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/732589ca-b2a0-48d3-aa09-0ab535fb7d94-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:53.917104 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/211c1840-13e1-474b-9b24-f231cea1964e-ovnkube-config\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.917104 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-sys\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:53.917638 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-os-release\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:53.917638 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917134    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-host-var-lib-cni-bin\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:53.917638 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f-tmp-dir\") pod \"node-resolver-2xczz\" (UID: \"bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f\") " pod="openshift-dns/node-resolver-2xczz"
Jul 31 20:29:53.917638 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-kubelet\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.917638 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-run-openvswitch\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.917638 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917251    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-log-socket\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.917638 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-kubernetes\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:53.917638 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917307    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-system-cni-dir\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:53.917638 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917332    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-host-run-k8s-cni-cncf-io\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:53.917638 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917362    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0d719da-980c-4f82-8dbe-c0c416ce0a66-serviceca\") pod \"node-ca-ttm25\" (UID: \"e0d719da-980c-4f82-8dbe-c0c416ce0a66\") " pod="openshift-image-registry/node-ca-ttm25"
Jul 31 20:29:53.917638 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917384    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/732589ca-b2a0-48d3-aa09-0ab535fb7d94-os-release\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:53.917638 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917404    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft29f\" (UniqueName: \"kubernetes.io/projected/3364e041-5213-4dff-9c10-7d76ee5d2c85-kube-api-access-ft29f\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.917638 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/211c1840-13e1-474b-9b24-f231cea1964e-ovnkube-script-lib\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.917638 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-multus-cni-dir\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:53.917638 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917454    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-host-var-lib-cni-multus\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:53.917638 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917486    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/854d7548-0ae4-42ee-9ae5-126639dc479c-multus-daemon-config\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:53.917638 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3364e041-5213-4dff-9c10-7d76ee5d2c85-etc-selinux\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.918402 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917540    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/211c1840-13e1-474b-9b24-f231cea1964e-ovn-node-metrics-cert\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.918402 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-sysconfig\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:53.918402 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917575    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-sysctl-d\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:53.918402 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917673    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-etc-kubernetes\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:53.918402 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917690    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b5db\" (UniqueName: \"kubernetes.io/projected/854d7548-0ae4-42ee-9ae5-126639dc479c-kube-api-access-4b5db\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:53.918402 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0d719da-980c-4f82-8dbe-c0c416ce0a66-host\") pod \"node-ca-ttm25\" (UID: \"e0d719da-980c-4f82-8dbe-c0c416ce0a66\") " pod="openshift-image-registry/node-ca-ttm25"
Jul 31 20:29:53.918402 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917735    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffbt8\" (UniqueName: \"kubernetes.io/projected/732589ca-b2a0-48d3-aa09-0ab535fb7d94-kube-api-access-ffbt8\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:53.918402 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3364e041-5213-4dff-9c10-7d76ee5d2c85-sys-fs\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.918402 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-var-lib-openvswitch\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.918402 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917963    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-etc-openvswitch\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.918402 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.917997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-sysctl-conf\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:53.918402 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.918036    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f-hosts-file\") pod \"node-resolver-2xczz\" (UID: \"bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f\") " pod="openshift-dns/node-resolver-2xczz"
Jul 31 20:29:53.918402 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.918074    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-systemd\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:53.918402 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.918104    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-host-run-multus-certs\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:53.918402 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.918180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3364e041-5213-4dff-9c10-7d76ee5d2c85-registration-dir\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.918402 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.918208    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-run-ovn-kubernetes\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:53.919143 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.918239    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/732589ca-b2a0-48d3-aa09-0ab535fb7d94-system-cni-dir\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:53.919143 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.918271    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs\") pod \"network-metrics-daemon-dqzzx\" (UID: \"78163815-3577-406a-ba59-f7e6784b6377\") " pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:29:53.919143 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.918296    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-tmp\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:53.919143 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.918239    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3364e041-5213-4dff-9c10-7d76ee5d2c85-registration-dir\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.919143 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:53.918430    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:29:53.919143 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:53.918492    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs podName:78163815-3577-406a-ba59-f7e6784b6377 nodeName:}" failed. No retries permitted until 2026-07-31 20:29:54.418471566 +0000 UTC m=+3.023765911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs") pod "network-metrics-daemon-dqzzx" (UID: "78163815-3577-406a-ba59-f7e6784b6377") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:29:53.919143 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.918511    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3364e041-5213-4dff-9c10-7d76ee5d2c85-device-dir\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.919143 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.918322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4x8z\" (UniqueName: \"kubernetes.io/projected/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-kube-api-access-h4x8z\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:53.919143 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.918583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-cnibin\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:53.919143 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.918617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/732589ca-b2a0-48d3-aa09-0ab535fb7d94-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:53.919143 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.918655    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3364e041-5213-4dff-9c10-7d76ee5d2c85-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.919143 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.918751    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3364e041-5213-4dff-9c10-7d76ee5d2c85-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.919734 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.919458    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0905f420-9a41-422c-90cd-ad250dfb6169-iptables-alerter-script\") pod \"iptables-alerter-l4g5k\" (UID: \"0905f420-9a41-422c-90cd-ad250dfb6169\") " pod="openshift-network-operator/iptables-alerter-l4g5k"
Jul 31 20:29:53.919734 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.919544    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/512e2144-7eb2-4aff-af11-30f449160993-konnectivity-ca\") pod \"konnectivity-agent-c5d4j\" (UID: \"512e2144-7eb2-4aff-af11-30f449160993\") " pod="kube-system/konnectivity-agent-c5d4j"
Jul 31 20:29:53.919734 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.919644    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3364e041-5213-4dff-9c10-7d76ee5d2c85-sys-fs\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.919734 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.919648    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3364e041-5213-4dff-9c10-7d76ee5d2c85-etc-selinux\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.919734 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.919681    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f-tmp-dir\") pod \"node-resolver-2xczz\" (UID: \"bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f\") " pod="openshift-dns/node-resolver-2xczz"
Jul 31 20:29:53.923059 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.923035    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/512e2144-7eb2-4aff-af11-30f449160993-agent-certs\") pod \"konnectivity-agent-c5d4j\" (UID: \"512e2144-7eb2-4aff-af11-30f449160993\") " pod="kube-system/konnectivity-agent-c5d4j"
Jul 31 20:29:53.925723 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.925214    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-218.ec2.internal" event={"ID":"968e482da3adef699dc32ad47471cf95","Type":"ContainerStarted","Data":"888b52fcfd6e4f00f533f08c8c49742fc10dbd22edec1a9ec847632bf8542e51"}
Jul 31 20:29:53.925723 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.925746    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd2s9\" (UniqueName: \"kubernetes.io/projected/78163815-3577-406a-ba59-f7e6784b6377-kube-api-access-fd2s9\") pod \"network-metrics-daemon-dqzzx\" (UID: \"78163815-3577-406a-ba59-f7e6784b6377\") " pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:29:53.925928 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.925856    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hztfs\" (UniqueName: \"kubernetes.io/projected/0905f420-9a41-422c-90cd-ad250dfb6169-kube-api-access-hztfs\") pod \"iptables-alerter-l4g5k\" (UID: \"0905f420-9a41-422c-90cd-ad250dfb6169\") " pod="openshift-network-operator/iptables-alerter-l4g5k"
Jul 31 20:29:53.928159 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.928117    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s94zs\" (UniqueName: \"kubernetes.io/projected/bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f-kube-api-access-s94zs\") pod \"node-resolver-2xczz\" (UID: \"bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f\") " pod="openshift-dns/node-resolver-2xczz"
Jul 31 20:29:53.930272 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.930101    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft29f\" (UniqueName: \"kubernetes.io/projected/3364e041-5213-4dff-9c10-7d76ee5d2c85-kube-api-access-ft29f\") pod \"aws-ebs-csi-driver-node-4bbcl\" (UID: \"3364e041-5213-4dff-9c10-7d76ee5d2c85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:53.930671 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:53.930645    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal" event={"ID":"8401e86f5150f5d30d8647acb9eda871","Type":"ContainerStarted","Data":"49b2f720fc25bbbdf4ee89b148fb851a424ba8fd858cb9ee0a18bc1018f31b3d"}
Jul 31 20:29:54.019757 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.019715    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffbt8\" (UniqueName: \"kubernetes.io/projected/732589ca-b2a0-48d3-aa09-0ab535fb7d94-kube-api-access-ffbt8\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:54.019917 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.019781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-var-lib-openvswitch\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.019917 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.019808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-etc-openvswitch\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.019917 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.019832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-sysctl-conf\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.019917 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.019858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-systemd\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.019917 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.019882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-host-run-multus-certs\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.019917 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.019909    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-run-ovn-kubernetes\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.020288 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.019937    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/732589ca-b2a0-48d3-aa09-0ab535fb7d94-system-cni-dir\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:54.020288 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.019975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-tmp\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.020288 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4x8z\" (UniqueName: \"kubernetes.io/projected/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-kube-api-access-h4x8z\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.020288 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-cnibin\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.020288 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020057    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/732589ca-b2a0-48d3-aa09-0ab535fb7d94-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:54.020288 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-modprobe-d\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.020288 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-multus-socket-dir-parent\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.020288 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-host-run-netns\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.020288 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020172    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-run-netns\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.020288 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020197    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-run-systemd\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.020288 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t4hv\" (UniqueName: \"kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv\") pod \"network-check-target-nbhtt\" (UID: \"184c96b5-fe65-47a8-a9d1-a0d590bd1765\") " pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:29:54.020288 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/854d7548-0ae4-42ee-9ae5-126639dc479c-cni-binary-copy\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.020288 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/732589ca-b2a0-48d3-aa09-0ab535fb7d94-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:54.020835 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-host\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.020835 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-run-ovn\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.020835 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fcgg\" (UniqueName: \"kubernetes.io/projected/211c1840-13e1-474b-9b24-f231cea1964e-kube-api-access-5fcgg\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.020835 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-run\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.020835 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020417    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-cni-bin\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.020835 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-lib-modules\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.020835 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020533    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-host-var-lib-kubelet\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.020835 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020831    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-var-lib-openvswitch\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.021317 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020876    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-etc-openvswitch\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.021317 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020992    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-sysctl-conf\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.021317 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.021032    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-systemd\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.021317 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.021054    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-host-run-multus-certs\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.021317 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.021078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-run-ovn-kubernetes\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.021317 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.021102    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/732589ca-b2a0-48d3-aa09-0ab535fb7d94-system-cni-dir\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:54.021626 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.020465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-host-var-lib-kubelet\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.021626 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.021459    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d6c4d228-4d34-47bd-9881-60e38a8a56e3-dbus\") pod \"global-pull-secret-syncer-h7klt\" (UID: \"d6c4d228-4d34-47bd-9881-60e38a8a56e3\") " pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:29:54.021626 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.021488    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret\") pod \"global-pull-secret-syncer-h7klt\" (UID: \"d6c4d228-4d34-47bd-9881-60e38a8a56e3\") " pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:29:54.021626 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.021515    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-node-log\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.021626 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.021538    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-cni-netd\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.021626 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.021560    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-tuned\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.021626 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.021584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-hostroot\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.021626 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.021620    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-multus-conf-dir\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.022049 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.021645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-systemd-units\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.022049 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.021675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.022049 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.021751    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/211c1840-13e1-474b-9b24-f231cea1964e-env-overrides\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.022049 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.021877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-var-lib-kubelet\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.022049 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.021936    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vtns\" (UniqueName: \"kubernetes.io/projected/e0d719da-980c-4f82-8dbe-c0c416ce0a66-kube-api-access-5vtns\") pod \"node-ca-ttm25\" (UID: \"e0d719da-980c-4f82-8dbe-c0c416ce0a66\") " pod="openshift-image-registry/node-ca-ttm25"
Jul 31 20:29:54.022049 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.021962    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/732589ca-b2a0-48d3-aa09-0ab535fb7d94-cni-binary-copy\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:54.022049 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.021995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d6c4d228-4d34-47bd-9881-60e38a8a56e3-kubelet-config\") pod \"global-pull-secret-syncer-h7klt\" (UID: \"d6c4d228-4d34-47bd-9881-60e38a8a56e3\") " pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:29:54.022049 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-slash\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.022049 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022049    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/732589ca-b2a0-48d3-aa09-0ab535fb7d94-cnibin\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:54.022517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/732589ca-b2a0-48d3-aa09-0ab535fb7d94-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:54.022517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/211c1840-13e1-474b-9b24-f231cea1964e-ovnkube-config\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.022517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-sys\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.022517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022182    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-os-release\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.022517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022208    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-host-var-lib-cni-bin\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.022517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022238    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-kubelet\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.022517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-run-openvswitch\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.022517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-log-socket\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.022517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-kubernetes\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.022517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022347    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-system-cni-dir\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.022517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-host-run-k8s-cni-cncf-io\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.022517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0d719da-980c-4f82-8dbe-c0c416ce0a66-serviceca\") pod \"node-ca-ttm25\" (UID: \"e0d719da-980c-4f82-8dbe-c0c416ce0a66\") " pod="openshift-image-registry/node-ca-ttm25"
Jul 31 20:29:54.022517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/732589ca-b2a0-48d3-aa09-0ab535fb7d94-os-release\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:54.022517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/211c1840-13e1-474b-9b24-f231cea1964e-ovnkube-script-lib\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.022517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-multus-cni-dir\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.022517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-host-var-lib-cni-multus\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.023333 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022530    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/854d7548-0ae4-42ee-9ae5-126639dc479c-multus-daemon-config\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.023333 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022559    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/211c1840-13e1-474b-9b24-f231cea1964e-ovn-node-metrics-cert\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.023333 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022586    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-sysconfig\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.023333 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022620    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-sysctl-d\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.023333 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-etc-kubernetes\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.023333 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b5db\" (UniqueName: \"kubernetes.io/projected/854d7548-0ae4-42ee-9ae5-126639dc479c-kube-api-access-4b5db\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.023333 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0d719da-980c-4f82-8dbe-c0c416ce0a66-host\") pod \"node-ca-ttm25\" (UID: \"e0d719da-980c-4f82-8dbe-c0c416ce0a66\") " pod="openshift-image-registry/node-ca-ttm25"
Jul 31 20:29:54.023333 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022828    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0d719da-980c-4f82-8dbe-c0c416ce0a66-host\") pod \"node-ca-ttm25\" (UID: \"e0d719da-980c-4f82-8dbe-c0c416ce0a66\") " pod="openshift-image-registry/node-ca-ttm25"
Jul 31 20:29:54.023333 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.022896    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d6c4d228-4d34-47bd-9881-60e38a8a56e3-dbus\") pod \"global-pull-secret-syncer-h7klt\" (UID: \"d6c4d228-4d34-47bd-9881-60e38a8a56e3\") " pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:29:54.023333 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:54.022984    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 20:29:54.023333 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:54.023049    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret podName:d6c4d228-4d34-47bd-9881-60e38a8a56e3 nodeName:}" failed. No retries permitted until 2026-07-31 20:29:54.523028631 +0000 UTC m=+3.128322975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret") pod "global-pull-secret-syncer-h7klt" (UID: "d6c4d228-4d34-47bd-9881-60e38a8a56e3") : object "kube-system"/"original-pull-secret" not registered
Jul 31 20:29:54.023333 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.023094    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-node-log\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.023333 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.023146    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-cni-netd\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.024738 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.024713    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-kubelet\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.024878 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.024764    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-hostroot\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.024878 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.024793    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-multus-conf-dir\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.024878 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.024849    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-systemd-units\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.025022 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.024893    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.025140 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.025111    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-tmp\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.025399 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.025373    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/211c1840-13e1-474b-9b24-f231cea1964e-env-overrides\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.025455 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.025422    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-cnibin\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.025495 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.025451    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-var-lib-kubelet\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.025995 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.025969    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/732589ca-b2a0-48d3-aa09-0ab535fb7d94-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:54.026106 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.026083    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/732589ca-b2a0-48d3-aa09-0ab535fb7d94-cni-binary-copy\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:54.026174 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.026118    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-modprobe-d\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.026174 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.026156    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d6c4d228-4d34-47bd-9881-60e38a8a56e3-kubelet-config\") pod \"global-pull-secret-syncer-h7klt\" (UID: \"d6c4d228-4d34-47bd-9881-60e38a8a56e3\") " pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:29:54.026252 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.026183    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-multus-socket-dir-parent\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.026252 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.026202    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-slash\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.026252 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.026224    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-host-run-netns\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.026353 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.026249    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/732589ca-b2a0-48d3-aa09-0ab535fb7d94-cnibin\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:54.026353 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.026263    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-run-netns\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.026353 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.026302    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-run-systemd\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.026728 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.026702    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/732589ca-b2a0-48d3-aa09-0ab535fb7d94-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:54.027044 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.027021    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-multus-cni-dir\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.027126 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.027089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-run-openvswitch\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.027181 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.027166    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-log-socket\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.027233 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.027206    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/211c1840-13e1-474b-9b24-f231cea1964e-ovnkube-config\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.027233 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.027227    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-kubernetes\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.027327 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.027284    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-host-run-k8s-cni-cncf-io\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.027327 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.027294    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-sys\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.027465 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.027352    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/732589ca-b2a0-48d3-aa09-0ab535fb7d94-os-release\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:54.027465 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.027361    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-os-release\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.027465 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.027411    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-host-var-lib-cni-bin\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.027465 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.027458    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-system-cni-dir\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.027622 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.027600    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-tuned\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.027689 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.027672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-host-var-lib-cni-multus\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.027861 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.027838    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0d719da-980c-4f82-8dbe-c0c416ce0a66-serviceca\") pod \"node-ca-ttm25\" (UID: \"e0d719da-980c-4f82-8dbe-c0c416ce0a66\") " pod="openshift-image-registry/node-ca-ttm25"
Jul 31 20:29:54.027935 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.027887    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-sysctl-d\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.028228 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.028203    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/854d7548-0ae4-42ee-9ae5-126639dc479c-cni-binary-copy\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.028356 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.028337    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/732589ca-b2a0-48d3-aa09-0ab535fb7d94-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:54.028415 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.028381    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/211c1840-13e1-474b-9b24-f231cea1964e-ovnkube-script-lib\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.028415 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.028391    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-host\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.028505 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.028441    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-run\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.028505 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.028467    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-host-cni-bin\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.028571 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.028531    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-lib-modules\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.028642 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.028412    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/211c1840-13e1-474b-9b24-f231cea1964e-run-ovn\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.028762 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.028730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-etc-sysconfig\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.028880 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.028854    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/854d7548-0ae4-42ee-9ae5-126639dc479c-etc-kubernetes\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.029478 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.029452    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/854d7548-0ae4-42ee-9ae5-126639dc479c-multus-daemon-config\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.030654 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.030629    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/211c1840-13e1-474b-9b24-f231cea1964e-ovn-node-metrics-cert\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.031100 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.031062    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffbt8\" (UniqueName: \"kubernetes.io/projected/732589ca-b2a0-48d3-aa09-0ab535fb7d94-kube-api-access-ffbt8\") pod \"multus-additional-cni-plugins-vfbbm\" (UID: \"732589ca-b2a0-48d3-aa09-0ab535fb7d94\") " pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:54.031572 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:54.031553    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 20:29:54.031708 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:54.031578    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 20:29:54.031708 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:54.031593    2565 projected.go:196] Error preparing data for projected volume kube-api-access-8t4hv for pod openshift-network-diagnostics/network-check-target-nbhtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:29:54.031708 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:54.031667    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv podName:184c96b5-fe65-47a8-a9d1-a0d590bd1765 nodeName:}" failed. No retries permitted until 2026-07-31 20:29:54.531649707 +0000 UTC m=+3.136944072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8t4hv" (UniqueName: "kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv") pod "network-check-target-nbhtt" (UID: "184c96b5-fe65-47a8-a9d1-a0d590bd1765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:29:54.033730 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.033609    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4x8z\" (UniqueName: \"kubernetes.io/projected/b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba-kube-api-access-h4x8z\") pod \"tuned-plzhp\" (UID: \"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba\") " pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.035876 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.035855    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vtns\" (UniqueName: \"kubernetes.io/projected/e0d719da-980c-4f82-8dbe-c0c416ce0a66-kube-api-access-5vtns\") pod \"node-ca-ttm25\" (UID: \"e0d719da-980c-4f82-8dbe-c0c416ce0a66\") " pod="openshift-image-registry/node-ca-ttm25"
Jul 31 20:29:54.036569 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.036548    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fcgg\" (UniqueName: \"kubernetes.io/projected/211c1840-13e1-474b-9b24-f231cea1964e-kube-api-access-5fcgg\") pod \"ovnkube-node-zf99r\" (UID: \"211c1840-13e1-474b-9b24-f231cea1964e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.038969 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.038944    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b5db\" (UniqueName: \"kubernetes.io/projected/854d7548-0ae4-42ee-9ae5-126639dc479c-kube-api-access-4b5db\") pod \"multus-vhpsx\" (UID: \"854d7548-0ae4-42ee-9ae5-126639dc479c\") " pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.107019 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.106983    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2xczz"
Jul 31 20:29:54.115240 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.115218    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c5d4j"
Jul 31 20:29:54.118089 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:54.118063    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe17aaf_bbc8_4d32_bb96_e5feb85f9d8f.slice/crio-20ff2f70d9a36bbf2c761c74faae47d0083868d0f88c3d2734ebab44cde38565 WatchSource:0}: Error finding container 20ff2f70d9a36bbf2c761c74faae47d0083868d0f88c3d2734ebab44cde38565: Status 404 returned error can't find the container with id 20ff2f70d9a36bbf2c761c74faae47d0083868d0f88c3d2734ebab44cde38565
Jul 31 20:29:54.125032 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.124858    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l4g5k"
Jul 31 20:29:54.126038 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:54.125935    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod512e2144_7eb2_4aff_af11_30f449160993.slice/crio-428d8f421f776e0d600e48f79d52a3d25fa3332b70ac67f2cfb9c8792dc6afa3 WatchSource:0}: Error finding container 428d8f421f776e0d600e48f79d52a3d25fa3332b70ac67f2cfb9c8792dc6afa3: Status 404 returned error can't find the container with id 428d8f421f776e0d600e48f79d52a3d25fa3332b70ac67f2cfb9c8792dc6afa3
Jul 31 20:29:54.132506 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.132477    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl"
Jul 31 20:29:54.139879 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:54.139163    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0905f420_9a41_422c_90cd_ad250dfb6169.slice/crio-769a30d769fa3892565d69196ccb067517f9ef483e04cd63ef160c7e97b45c13 WatchSource:0}: Error finding container 769a30d769fa3892565d69196ccb067517f9ef483e04cd63ef160c7e97b45c13: Status 404 returned error can't find the container with id 769a30d769fa3892565d69196ccb067517f9ef483e04cd63ef160c7e97b45c13
Jul 31 20:29:54.141420 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.140376    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-plzhp"
Jul 31 20:29:54.147577 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.147416    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vhpsx"
Jul 31 20:29:54.147577 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:54.147525    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3364e041_5213_4dff_9c10_7d76ee5d2c85.slice/crio-0e8b304d1f2f4043c55394d1f5d2e8a9a32c834b1b9a60f47617b07a1daf09c6 WatchSource:0}: Error finding container 0e8b304d1f2f4043c55394d1f5d2e8a9a32c834b1b9a60f47617b07a1daf09c6: Status 404 returned error can't find the container with id 0e8b304d1f2f4043c55394d1f5d2e8a9a32c834b1b9a60f47617b07a1daf09c6
Jul 31 20:29:54.153415 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:54.153380    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2bdf454_d159_4c0d_a0c4_9af0ac1ae6ba.slice/crio-e7112166bcc65021b4a4b888dea9574f37dbb558622ae6ef070ded319b8f9d6e WatchSource:0}: Error finding container e7112166bcc65021b4a4b888dea9574f37dbb558622ae6ef070ded319b8f9d6e: Status 404 returned error can't find the container with id e7112166bcc65021b4a4b888dea9574f37dbb558622ae6ef070ded319b8f9d6e
Jul 31 20:29:54.155084 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.155066    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ttm25"
Jul 31 20:29:54.158542 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:54.158506    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod854d7548_0ae4_42ee_9ae5_126639dc479c.slice/crio-1c058d6427e2ac3211a3896da69eb2d1738ea860012a551ae813379149084ebd WatchSource:0}: Error finding container 1c058d6427e2ac3211a3896da69eb2d1738ea860012a551ae813379149084ebd: Status 404 returned error can't find the container with id 1c058d6427e2ac3211a3896da69eb2d1738ea860012a551ae813379149084ebd
Jul 31 20:29:54.164950 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.164928    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:29:54.166129 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:54.166097    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d719da_980c_4f82_8dbe_c0c416ce0a66.slice/crio-38ec112711449146ce43ffaad8c87bd0e7d72d4fbbe78e91f7b94372a78a45cc WatchSource:0}: Error finding container 38ec112711449146ce43ffaad8c87bd0e7d72d4fbbe78e91f7b94372a78a45cc: Status 404 returned error can't find the container with id 38ec112711449146ce43ffaad8c87bd0e7d72d4fbbe78e91f7b94372a78a45cc
Jul 31 20:29:54.172468 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.172449    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vfbbm"
Jul 31 20:29:54.183176 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:29:54.183149    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod732589ca_b2a0_48d3_aa09_0ab535fb7d94.slice/crio-485de065bda2745ded36bc5c18c7969220b188c56e61a833702982a8ef490506 WatchSource:0}: Error finding container 485de065bda2745ded36bc5c18c7969220b188c56e61a833702982a8ef490506: Status 404 returned error can't find the container with id 485de065bda2745ded36bc5c18c7969220b188c56e61a833702982a8ef490506
Jul 31 20:29:54.425840 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.425735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs\") pod \"network-metrics-daemon-dqzzx\" (UID: \"78163815-3577-406a-ba59-f7e6784b6377\") " pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:29:54.426003 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:54.425931    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:29:54.426058 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:54.426016    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs podName:78163815-3577-406a-ba59-f7e6784b6377 nodeName:}" failed. No retries permitted until 2026-07-31 20:29:55.425996108 +0000 UTC m=+4.031290456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs") pod "network-metrics-daemon-dqzzx" (UID: "78163815-3577-406a-ba59-f7e6784b6377") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:29:54.526406 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.526359    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret\") pod \"global-pull-secret-syncer-h7klt\" (UID: \"d6c4d228-4d34-47bd-9881-60e38a8a56e3\") " pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:29:54.526588 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:54.526483    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 20:29:54.526588 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:54.526552    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret podName:d6c4d228-4d34-47bd-9881-60e38a8a56e3 nodeName:}" failed. No retries permitted until 2026-07-31 20:29:55.526531554 +0000 UTC m=+4.131825898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret") pod "global-pull-secret-syncer-h7klt" (UID: "d6c4d228-4d34-47bd-9881-60e38a8a56e3") : object "kube-system"/"original-pull-secret" not registered
Jul 31 20:29:54.627118 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.627079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t4hv\" (UniqueName: \"kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv\") pod \"network-check-target-nbhtt\" (UID: \"184c96b5-fe65-47a8-a9d1-a0d590bd1765\") " pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:29:54.627287 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:54.627232    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 20:29:54.627287 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:54.627252    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 20:29:54.627287 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:54.627263    2565 projected.go:196] Error preparing data for projected volume kube-api-access-8t4hv for pod openshift-network-diagnostics/network-check-target-nbhtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:29:54.627410 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:54.627320    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv podName:184c96b5-fe65-47a8-a9d1-a0d590bd1765 nodeName:}" failed. No retries permitted until 2026-07-31 20:29:55.627306115 +0000 UTC m=+4.232600461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8t4hv" (UniqueName: "kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv") pod "network-check-target-nbhtt" (UID: "184c96b5-fe65-47a8-a9d1-a0d590bd1765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:29:54.739663 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.739579    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 20:29:54.850852 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.850782    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 20:24:54 +0000 UTC" deadline="2028-02-22 03:43:17.830510457 +0000 UTC"
Jul 31 20:29:54.850852 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.850839    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13687h13m22.979674806s"
Jul 31 20:29:54.935906 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.935857    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l4g5k" event={"ID":"0905f420-9a41-422c-90cd-ad250dfb6169","Type":"ContainerStarted","Data":"769a30d769fa3892565d69196ccb067517f9ef483e04cd63ef160c7e97b45c13"}
Jul 31 20:29:54.937397 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.937337    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c5d4j" event={"ID":"512e2144-7eb2-4aff-af11-30f449160993","Type":"ContainerStarted","Data":"428d8f421f776e0d600e48f79d52a3d25fa3332b70ac67f2cfb9c8792dc6afa3"}
Jul 31 20:29:54.939047 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.939020    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vfbbm" event={"ID":"732589ca-b2a0-48d3-aa09-0ab535fb7d94","Type":"ContainerStarted","Data":"485de065bda2745ded36bc5c18c7969220b188c56e61a833702982a8ef490506"}
Jul 31 20:29:54.940638 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.940607    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ttm25" event={"ID":"e0d719da-980c-4f82-8dbe-c0c416ce0a66","Type":"ContainerStarted","Data":"38ec112711449146ce43ffaad8c87bd0e7d72d4fbbe78e91f7b94372a78a45cc"}
Jul 31 20:29:54.942781 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.942740    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vhpsx" event={"ID":"854d7548-0ae4-42ee-9ae5-126639dc479c","Type":"ContainerStarted","Data":"1c058d6427e2ac3211a3896da69eb2d1738ea860012a551ae813379149084ebd"}
Jul 31 20:29:54.944913 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.944889    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-plzhp" event={"ID":"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba","Type":"ContainerStarted","Data":"e7112166bcc65021b4a4b888dea9574f37dbb558622ae6ef070ded319b8f9d6e"}
Jul 31 20:29:54.946021 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.945962    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2xczz" event={"ID":"bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f","Type":"ContainerStarted","Data":"20ff2f70d9a36bbf2c761c74faae47d0083868d0f88c3d2734ebab44cde38565"}
Jul 31 20:29:54.948164 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.948132    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r" event={"ID":"211c1840-13e1-474b-9b24-f231cea1964e","Type":"ContainerStarted","Data":"442bc4ae1e13669a2b0b2a6c4188fc4ce75e9a13f94ed9e8580c4e9419261871"}
Jul 31 20:29:54.949481 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:54.949457    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl" event={"ID":"3364e041-5213-4dff-9c10-7d76ee5d2c85","Type":"ContainerStarted","Data":"0e8b304d1f2f4043c55394d1f5d2e8a9a32c834b1b9a60f47617b07a1daf09c6"}
Jul 31 20:29:55.433481 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:55.433433    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs\") pod \"network-metrics-daemon-dqzzx\" (UID: \"78163815-3577-406a-ba59-f7e6784b6377\") " pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:29:55.433674 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:55.433634    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:29:55.433743 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:55.433701    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs podName:78163815-3577-406a-ba59-f7e6784b6377 nodeName:}" failed. No retries permitted until 2026-07-31 20:29:57.433681358 +0000 UTC m=+6.038975719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs") pod "network-metrics-daemon-dqzzx" (UID: "78163815-3577-406a-ba59-f7e6784b6377") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:29:55.534419 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:55.534378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret\") pod \"global-pull-secret-syncer-h7klt\" (UID: \"d6c4d228-4d34-47bd-9881-60e38a8a56e3\") " pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:29:55.534601 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:55.534580    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 20:29:55.534669 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:55.534649    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret podName:d6c4d228-4d34-47bd-9881-60e38a8a56e3 nodeName:}" failed. No retries permitted until 2026-07-31 20:29:57.534629183 +0000 UTC m=+6.139923550 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret") pod "global-pull-secret-syncer-h7klt" (UID: "d6c4d228-4d34-47bd-9881-60e38a8a56e3") : object "kube-system"/"original-pull-secret" not registered
Jul 31 20:29:55.635525 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:55.635440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t4hv\" (UniqueName: \"kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv\") pod \"network-check-target-nbhtt\" (UID: \"184c96b5-fe65-47a8-a9d1-a0d590bd1765\") " pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:29:55.635700 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:55.635610    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 20:29:55.635700 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:55.635631    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 20:29:55.635700 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:55.635645    2565 projected.go:196] Error preparing data for projected volume kube-api-access-8t4hv for pod openshift-network-diagnostics/network-check-target-nbhtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:29:55.635889 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:55.635702    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv podName:184c96b5-fe65-47a8-a9d1-a0d590bd1765 nodeName:}" failed. No retries permitted until 2026-07-31 20:29:57.635683394 +0000 UTC m=+6.240977752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8t4hv" (UniqueName: "kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv") pod "network-check-target-nbhtt" (UID: "184c96b5-fe65-47a8-a9d1-a0d590bd1765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:29:55.851031 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:55.850986    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 20:24:54 +0000 UTC" deadline="2028-01-17 00:27:03.069348646 +0000 UTC"
Jul 31 20:29:55.851031 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:55.851029    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12819h57m7.218323926s"
Jul 31 20:29:55.910021 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:55.909927    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:29:55.910197 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:55.910102    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7klt" podUID="d6c4d228-4d34-47bd-9881-60e38a8a56e3"
Jul 31 20:29:55.910647 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:55.910613    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:29:55.910777 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:55.910724    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nbhtt" podUID="184c96b5-fe65-47a8-a9d1-a0d590bd1765"
Jul 31 20:29:55.910867 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:55.910833    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:29:55.910952 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:55.910928    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqzzx" podUID="78163815-3577-406a-ba59-f7e6784b6377"
Jul 31 20:29:56.966524 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:56.966213    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-218.ec2.internal" event={"ID":"968e482da3adef699dc32ad47471cf95","Type":"ContainerStarted","Data":"7834333a07ca14c419c37969892118a7525c90a54659ed782f02617655029274"}
Jul 31 20:29:56.982069 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:56.982006    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-218.ec2.internal" podStartSLOduration=3.981984297 podStartE2EDuration="3.981984297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:29:56.981156652 +0000 UTC m=+5.586451020" watchObservedRunningTime="2026-07-31 20:29:56.981984297 +0000 UTC m=+5.587278664"
Jul 31 20:29:57.454303 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:57.454191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs\") pod \"network-metrics-daemon-dqzzx\" (UID: \"78163815-3577-406a-ba59-f7e6784b6377\") " pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:29:57.454500 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:57.454418    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:29:57.454500 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:57.454489    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs podName:78163815-3577-406a-ba59-f7e6784b6377 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:01.454469947 +0000 UTC m=+10.059764292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs") pod "network-metrics-daemon-dqzzx" (UID: "78163815-3577-406a-ba59-f7e6784b6377") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:29:57.555475 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:57.555389    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret\") pod \"global-pull-secret-syncer-h7klt\" (UID: \"d6c4d228-4d34-47bd-9881-60e38a8a56e3\") " pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:29:57.555657 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:57.555513    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 20:29:57.555657 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:57.555565    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret podName:d6c4d228-4d34-47bd-9881-60e38a8a56e3 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:01.555550497 +0000 UTC m=+10.160844843 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret") pod "global-pull-secret-syncer-h7klt" (UID: "d6c4d228-4d34-47bd-9881-60e38a8a56e3") : object "kube-system"/"original-pull-secret" not registered
Jul 31 20:29:57.656503 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:57.656443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t4hv\" (UniqueName: \"kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv\") pod \"network-check-target-nbhtt\" (UID: \"184c96b5-fe65-47a8-a9d1-a0d590bd1765\") " pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:29:57.656703 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:57.656632    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 20:29:57.656703 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:57.656654    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 20:29:57.656703 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:57.656668    2565 projected.go:196] Error preparing data for projected volume kube-api-access-8t4hv for pod openshift-network-diagnostics/network-check-target-nbhtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:29:57.656915 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:57.656731    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv podName:184c96b5-fe65-47a8-a9d1-a0d590bd1765 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:01.656712526 +0000 UTC m=+10.262006872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8t4hv" (UniqueName: "kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv") pod "network-check-target-nbhtt" (UID: "184c96b5-fe65-47a8-a9d1-a0d590bd1765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:29:57.909940 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:57.909570    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:29:57.909940 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:57.909713    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:29:57.909940 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:57.909716    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nbhtt" podUID="184c96b5-fe65-47a8-a9d1-a0d590bd1765"
Jul 31 20:29:57.913935 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:57.910998    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqzzx" podUID="78163815-3577-406a-ba59-f7e6784b6377"
Jul 31 20:29:57.916141 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:57.909570    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:29:57.916141 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:57.916084    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7klt" podUID="d6c4d228-4d34-47bd-9881-60e38a8a56e3"
Jul 31 20:29:57.972831 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:57.972753    2565 generic.go:356] "Generic (PLEG): container finished" podID="8401e86f5150f5d30d8647acb9eda871" containerID="89424dcd4acf29c20a330fcb7bc0dda081db523cc56a2299575b83b0dda13522" exitCode=0
Jul 31 20:29:57.973814 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:57.973775    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal" event={"ID":"8401e86f5150f5d30d8647acb9eda871","Type":"ContainerDied","Data":"89424dcd4acf29c20a330fcb7bc0dda081db523cc56a2299575b83b0dda13522"}
Jul 31 20:29:59.909915 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:59.909881    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:29:59.910423 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:59.910024    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqzzx" podUID="78163815-3577-406a-ba59-f7e6784b6377"
Jul 31 20:29:59.910423 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:59.910386    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:29:59.910543 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:59.910484    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7klt" podUID="d6c4d228-4d34-47bd-9881-60e38a8a56e3"
Jul 31 20:29:59.910592 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:29:59.910576    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:29:59.910661 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:29:59.910639    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nbhtt" podUID="184c96b5-fe65-47a8-a9d1-a0d590bd1765"
Jul 31 20:30:01.486894 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:01.486849    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs\") pod \"network-metrics-daemon-dqzzx\" (UID: \"78163815-3577-406a-ba59-f7e6784b6377\") " pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:01.487407 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:01.487005    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:30:01.487407 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:01.487092    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs podName:78163815-3577-406a-ba59-f7e6784b6377 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:09.487068942 +0000 UTC m=+18.092363303 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs") pod "network-metrics-daemon-dqzzx" (UID: "78163815-3577-406a-ba59-f7e6784b6377") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:30:01.587533 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:01.587412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret\") pod \"global-pull-secret-syncer-h7klt\" (UID: \"d6c4d228-4d34-47bd-9881-60e38a8a56e3\") " pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:01.587734 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:01.587604    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 20:30:01.587734 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:01.587692    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret podName:d6c4d228-4d34-47bd-9881-60e38a8a56e3 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:09.58766927 +0000 UTC m=+18.192963633 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret") pod "global-pull-secret-syncer-h7klt" (UID: "d6c4d228-4d34-47bd-9881-60e38a8a56e3") : object "kube-system"/"original-pull-secret" not registered
Jul 31 20:30:01.688275 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:01.688235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t4hv\" (UniqueName: \"kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv\") pod \"network-check-target-nbhtt\" (UID: \"184c96b5-fe65-47a8-a9d1-a0d590bd1765\") " pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:01.688549 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:01.688517    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 20:30:01.688549 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:01.688552    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 20:30:01.688718 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:01.688565    2565 projected.go:196] Error preparing data for projected volume kube-api-access-8t4hv for pod openshift-network-diagnostics/network-check-target-nbhtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:30:01.688718 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:01.688622    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv podName:184c96b5-fe65-47a8-a9d1-a0d590bd1765 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:09.688602152 +0000 UTC m=+18.293896506 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8t4hv" (UniqueName: "kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv") pod "network-check-target-nbhtt" (UID: "184c96b5-fe65-47a8-a9d1-a0d590bd1765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:30:01.910860 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:01.910788    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:01.911008 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:01.910899    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nbhtt" podUID="184c96b5-fe65-47a8-a9d1-a0d590bd1765"
Jul 31 20:30:01.911266 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:01.911247    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:01.911493 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:01.911344    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqzzx" podUID="78163815-3577-406a-ba59-f7e6784b6377"
Jul 31 20:30:01.911493 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:01.911393    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:01.911493 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:01.911467    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7klt" podUID="d6c4d228-4d34-47bd-9881-60e38a8a56e3"
Jul 31 20:30:03.912249 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:03.909685    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:03.912249 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:03.909832    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nbhtt" podUID="184c96b5-fe65-47a8-a9d1-a0d590bd1765"
Jul 31 20:30:03.912249 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:03.911590    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:03.912249 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:03.911700    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqzzx" podUID="78163815-3577-406a-ba59-f7e6784b6377"
Jul 31 20:30:03.912249 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:03.909648    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:03.912249 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:03.912170    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7klt" podUID="d6c4d228-4d34-47bd-9881-60e38a8a56e3"
Jul 31 20:30:05.909456 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:05.909370    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:05.909456 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:05.909400    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:05.909948 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:05.909370    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:05.909948 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:05.909483    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nbhtt" podUID="184c96b5-fe65-47a8-a9d1-a0d590bd1765"
Jul 31 20:30:05.909948 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:05.909610    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqzzx" podUID="78163815-3577-406a-ba59-f7e6784b6377"
Jul 31 20:30:05.909948 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:05.909700    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7klt" podUID="d6c4d228-4d34-47bd-9881-60e38a8a56e3"
Jul 31 20:30:07.909075 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:07.909038    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:07.909519 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:07.909038    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:07.909519 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:07.909039    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:07.909519 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:07.909187    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqzzx" podUID="78163815-3577-406a-ba59-f7e6784b6377"
Jul 31 20:30:07.909519 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:07.909291    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7klt" podUID="d6c4d228-4d34-47bd-9881-60e38a8a56e3"
Jul 31 20:30:07.909519 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:07.909378    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nbhtt" podUID="184c96b5-fe65-47a8-a9d1-a0d590bd1765"
Jul 31 20:30:09.550826 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:09.550784    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs\") pod \"network-metrics-daemon-dqzzx\" (UID: \"78163815-3577-406a-ba59-f7e6784b6377\") " pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:09.551290 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:09.550967    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:30:09.551290 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:09.551046    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs podName:78163815-3577-406a-ba59-f7e6784b6377 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:25.551022145 +0000 UTC m=+34.156316500 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs") pod "network-metrics-daemon-dqzzx" (UID: "78163815-3577-406a-ba59-f7e6784b6377") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:30:09.651754 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:09.651640    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret\") pod \"global-pull-secret-syncer-h7klt\" (UID: \"d6c4d228-4d34-47bd-9881-60e38a8a56e3\") " pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:09.651922 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:09.651828    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 20:30:09.651922 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:09.651911    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret podName:d6c4d228-4d34-47bd-9881-60e38a8a56e3 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:25.65189046 +0000 UTC m=+34.257184819 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret") pod "global-pull-secret-syncer-h7klt" (UID: "d6c4d228-4d34-47bd-9881-60e38a8a56e3") : object "kube-system"/"original-pull-secret" not registered
Jul 31 20:30:09.752008 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:09.751971    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t4hv\" (UniqueName: \"kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv\") pod \"network-check-target-nbhtt\" (UID: \"184c96b5-fe65-47a8-a9d1-a0d590bd1765\") " pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:09.752194 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:09.752150    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 20:30:09.752194 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:09.752172    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 20:30:09.752194 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:09.752186    2565 projected.go:196] Error preparing data for projected volume kube-api-access-8t4hv for pod openshift-network-diagnostics/network-check-target-nbhtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:30:09.752356 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:09.752252    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv podName:184c96b5-fe65-47a8-a9d1-a0d590bd1765 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:25.752233691 +0000 UTC m=+34.357528049 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8t4hv" (UniqueName: "kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv") pod "network-check-target-nbhtt" (UID: "184c96b5-fe65-47a8-a9d1-a0d590bd1765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:30:09.911251 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:09.909310    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:09.911251 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:09.909350    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:09.911251 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:09.909358    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:09.911251 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:09.909434    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7klt" podUID="d6c4d228-4d34-47bd-9881-60e38a8a56e3"
Jul 31 20:30:09.911251 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:09.909542    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nbhtt" podUID="184c96b5-fe65-47a8-a9d1-a0d590bd1765"
Jul 31 20:30:09.911251 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:09.909635    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqzzx" podUID="78163815-3577-406a-ba59-f7e6784b6377"
Jul 31 20:30:11.909667 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:11.909637    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:11.910122 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:11.909760    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7klt" podUID="d6c4d228-4d34-47bd-9881-60e38a8a56e3"
Jul 31 20:30:11.910122 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:11.909850    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:11.910122 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:11.909957    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nbhtt" podUID="184c96b5-fe65-47a8-a9d1-a0d590bd1765"
Jul 31 20:30:11.910122 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:11.910017    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:11.910122 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:11.910107    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqzzx" podUID="78163815-3577-406a-ba59-f7e6784b6377"
Jul 31 20:30:13.909920 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:13.909726    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:13.910501 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:13.909751    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:13.910501 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:13.909843    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:13.910501 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:13.910011    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7klt" podUID="d6c4d228-4d34-47bd-9881-60e38a8a56e3"
Jul 31 20:30:13.910501 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:13.910094    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqzzx" podUID="78163815-3577-406a-ba59-f7e6784b6377"
Jul 31 20:30:13.910501 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:13.910138    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nbhtt" podUID="184c96b5-fe65-47a8-a9d1-a0d590bd1765"
Jul 31 20:30:14.008073 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:14.008047    2565 generic.go:356] "Generic (PLEG): container finished" podID="732589ca-b2a0-48d3-aa09-0ab535fb7d94" containerID="12ea7d548d43a7360b12fe44ed0a2e0f963b9c225bc719ac9dd7520094112d09" exitCode=0
Jul 31 20:30:14.008200 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:14.008123    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vfbbm" event={"ID":"732589ca-b2a0-48d3-aa09-0ab535fb7d94","Type":"ContainerDied","Data":"12ea7d548d43a7360b12fe44ed0a2e0f963b9c225bc719ac9dd7520094112d09"}
Jul 31 20:30:14.009761 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:14.009661    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ttm25" event={"ID":"e0d719da-980c-4f82-8dbe-c0c416ce0a66","Type":"ContainerStarted","Data":"5878820f7a0bfa47bf5a35a8e5c12629fe080f23d66a78c42e5d79ac90e3636e"}
Jul 31 20:30:14.011757 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:14.011714    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vhpsx" event={"ID":"854d7548-0ae4-42ee-9ae5-126639dc479c","Type":"ContainerStarted","Data":"553049cfda49090bc059b70556e2c20bb7c5e0a58a258e8252f57212f9fd449b"}
Jul 31 20:30:14.013236 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:14.013215    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-plzhp" event={"ID":"b2bdf454-d159-4c0d-a0c4-9af0ac1ae6ba","Type":"ContainerStarted","Data":"5c701d25da345416434928c73ff1eb2413dd096b8b7535c0373ffbd0aeefc857"}
Jul 31 20:30:14.014930 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:14.014911    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2xczz" event={"ID":"bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f","Type":"ContainerStarted","Data":"e46713b1119581c2f8903dfce80c7be6d56222629b1d3d45ea59845dd9eafaef"}
Jul 31 20:30:14.016538 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:14.016521    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal" event={"ID":"8401e86f5150f5d30d8647acb9eda871","Type":"ContainerStarted","Data":"424abe3c09d67e7a538f21a3d1d6610e73d0450aa00a10d4433abb53a8eed614"}
Jul 31 20:30:14.018392 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:14.018371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r" event={"ID":"211c1840-13e1-474b-9b24-f231cea1964e","Type":"ContainerStarted","Data":"2057e41b66b6b5198681d03ef47952335bfefe6a0e21e7197278f149dfdd3d20"}
Jul 31 20:30:14.019724 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:14.019699    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl" event={"ID":"3364e041-5213-4dff-9c10-7d76ee5d2c85","Type":"ContainerStarted","Data":"9108eb6e6d06365137904b2390872bc66626f116a3c3c374096eff80abf4da07"}
Jul 31 20:30:14.021034 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:14.021010    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c5d4j" event={"ID":"512e2144-7eb2-4aff-af11-30f449160993","Type":"ContainerStarted","Data":"18ba49ef746e1dced0e88f2da1bfefe1b4b37a52068cce57f916a306a657836b"}
Jul 31 20:30:14.039616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:14.039576    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2xczz" podStartSLOduration=2.685338451 podStartE2EDuration="22.039562853s" totalImagesPullingTime="19.354224402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:14.039103702 +0000 UTC m=+22.644398064" watchObservedRunningTime="2026-07-31 20:30:14.039562853 +0000 UTC m=+22.644857216"
Jul 31 20:30:14.053497 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:14.053452    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-plzhp" podStartSLOduration=2.734266905 podStartE2EDuration="22.053437738s" totalImagesPullingTime="19.319170833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:14.053405737 +0000 UTC m=+22.658700113" watchObservedRunningTime="2026-07-31 20:30:14.053437738 +0000 UTC m=+22.658732100"
Jul 31 20:30:14.067503 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:14.067455    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vhpsx" podStartSLOduration=2.743468033 podStartE2EDuration="22.067435559s" totalImagesPullingTime="19.323967526s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:14.067222682 +0000 UTC m=+22.672517045" watchObservedRunningTime="2026-07-31 20:30:14.067435559 +0000 UTC m=+22.672729920"
Jul 31 20:30:14.094343 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:14.094298    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-218.ec2.internal" podStartSLOduration=21.094283635 podStartE2EDuration="21.094283635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:14.093543324 +0000 UTC m=+22.698837686" watchObservedRunningTime="2026-07-31 20:30:14.094283635 +0000 UTC m=+22.699577998"
Jul 31 20:30:14.111256 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:14.111214    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c5d4j" podStartSLOduration=2.8176823840000003 podStartE2EDuration="22.111197558s" totalImagesPullingTime="19.293515174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:14.11060869 +0000 UTC m=+22.715903054" watchObservedRunningTime="2026-07-31 20:30:14.111197558 +0000 UTC m=+22.716491921"
Jul 31 20:30:14.125713 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:14.125585    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ttm25" podStartSLOduration=2.848412331 podStartE2EDuration="22.125569604s" totalImagesPullingTime="19.277157273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:14.125159974 +0000 UTC m=+22.730454336" watchObservedRunningTime="2026-07-31 20:30:14.125569604 +0000 UTC m=+22.730863967"
Jul 31 20:30:15.026547 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:15.026473    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 20:30:15.027303 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:15.026847    2565 generic.go:356] "Generic (PLEG): container finished" podID="211c1840-13e1-474b-9b24-f231cea1964e" containerID="b7155241cca0651112c84f28d30d48abc8eb511d25819f75b55ed467bd3c19cf" exitCode=1
Jul 31 20:30:15.027303 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:15.026921    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r" event={"ID":"211c1840-13e1-474b-9b24-f231cea1964e","Type":"ContainerDied","Data":"b7155241cca0651112c84f28d30d48abc8eb511d25819f75b55ed467bd3c19cf"}
Jul 31 20:30:15.027303 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:15.027048    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r" event={"ID":"211c1840-13e1-474b-9b24-f231cea1964e","Type":"ContainerStarted","Data":"ef6e3506856ed6ceb3ecf97f6f90bc836f983653f38486b998f1162ce3aa8e9f"}
Jul 31 20:30:15.027303 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:15.027097    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r" event={"ID":"211c1840-13e1-474b-9b24-f231cea1964e","Type":"ContainerStarted","Data":"065e4edb1407a733691415c6a9006f3fd9278d9cdce88fd78e3c4292931c20bb"}
Jul 31 20:30:15.027303 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:15.027146    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r" event={"ID":"211c1840-13e1-474b-9b24-f231cea1964e","Type":"ContainerStarted","Data":"871e973daf863f519ba37f136053f39c3a941315b0690810f3082cf6e2d9d91c"}
Jul 31 20:30:15.027303 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:15.027186    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r" event={"ID":"211c1840-13e1-474b-9b24-f231cea1964e","Type":"ContainerStarted","Data":"2850dbe8050a70766c9d2d2a365589058ad514705a19e34cb324443e537432eb"}
Jul 31 20:30:15.028640 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:15.028614    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l4g5k" event={"ID":"0905f420-9a41-422c-90cd-ad250dfb6169","Type":"ContainerStarted","Data":"dd0544ea71cd48b89f242aa6c03ca8aa9d4fdb834c2ce984933de6062f8ae29e"}
Jul 31 20:30:15.043186 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:15.043140    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l4g5k" podStartSLOduration=3.707373581 podStartE2EDuration="23.043126172s" totalImagesPullingTime="19.335752591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:15.042986518 +0000 UTC m=+23.648280883" watchObservedRunningTime="2026-07-31 20:30:15.043126172 +0000 UTC m=+23.648420534"
Jul 31 20:30:15.158350 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:15.158302    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c5d4j"
Jul 31 20:30:15.347191 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:15.347166    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 31 20:30:15.887711 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:15.887607    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T20:30:15.347185333Z","UUID":"877649f2-f47e-4650-bd3f-bfea9e1dd292","Handler":null,"Name":"","Endpoint":""}
Jul 31 20:30:15.889200 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:15.889180    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 31 20:30:15.889320 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:15.889224    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 31 20:30:15.909563 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:15.909536    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:15.909563 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:15.909548    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:15.909701 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:15.909538    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:15.909701 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:15.909652    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7klt" podUID="d6c4d228-4d34-47bd-9881-60e38a8a56e3"
Jul 31 20:30:15.909804 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:15.909760    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqzzx" podUID="78163815-3577-406a-ba59-f7e6784b6377"
Jul 31 20:30:15.909908 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:15.909883    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nbhtt" podUID="184c96b5-fe65-47a8-a9d1-a0d590bd1765"
Jul 31 20:30:16.032653 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:16.032620    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl" event={"ID":"3364e041-5213-4dff-9c10-7d76ee5d2c85","Type":"ContainerStarted","Data":"0a138c8d5c5afc5639e3a07a9b37dfe389e1bc28f0747a8e1eb53a052f9abba5"}
Jul 31 20:30:17.037965 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:17.037938    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 20:30:17.038428 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:17.038302    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r" event={"ID":"211c1840-13e1-474b-9b24-f231cea1964e","Type":"ContainerStarted","Data":"b0195cfaf70f8112f954281bd36885b7a0fd2f74f6ee65c78b46c32b194771cb"}
Jul 31 20:30:17.123302 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:17.123235    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c5d4j"
Jul 31 20:30:17.123933 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:17.123909    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c5d4j"
Jul 31 20:30:17.909760 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:17.909536    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:17.909959 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:17.909536    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:17.909959 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:17.909867    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqzzx" podUID="78163815-3577-406a-ba59-f7e6784b6377"
Jul 31 20:30:17.909959 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:17.909910    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7klt" podUID="d6c4d228-4d34-47bd-9881-60e38a8a56e3"
Jul 31 20:30:17.909959 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:17.909536    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:17.910163 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:17.909983    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nbhtt" podUID="184c96b5-fe65-47a8-a9d1-a0d590bd1765"
Jul 31 20:30:18.041335 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:18.041303    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c5d4j"
Jul 31 20:30:19.045968 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:19.045941    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 20:30:19.046931 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:19.046343    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r" event={"ID":"211c1840-13e1-474b-9b24-f231cea1964e","Type":"ContainerStarted","Data":"07a8be611ae5f53956a6b242aba0010fdf0b19e0fce9600460c5c9d91553e6f6"}
Jul 31 20:30:19.046931 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:19.046632    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:30:19.046931 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:19.046836    2565 scope.go:117] "RemoveContainer" containerID="b7155241cca0651112c84f28d30d48abc8eb511d25819f75b55ed467bd3c19cf"
Jul 31 20:30:19.048836 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:19.048805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl" event={"ID":"3364e041-5213-4dff-9c10-7d76ee5d2c85","Type":"ContainerStarted","Data":"8e95aea025f2a09a79c09b63a0d65fca122063a91a0785e6b9507462d1067d02"}
Jul 31 20:30:19.050842 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:19.050818    2565 generic.go:356] "Generic (PLEG): container finished" podID="732589ca-b2a0-48d3-aa09-0ab535fb7d94" containerID="9739a77d90a3f9741a5dce153c49cf68cc084cff45de51edf11fe79f6fbd3f93" exitCode=0
Jul 31 20:30:19.050935 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:19.050901    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vfbbm" event={"ID":"732589ca-b2a0-48d3-aa09-0ab535fb7d94","Type":"ContainerDied","Data":"9739a77d90a3f9741a5dce153c49cf68cc084cff45de51edf11fe79f6fbd3f93"}
Jul 31 20:30:19.062970 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:19.062948    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:30:19.108786 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:19.108710    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bbcl" podStartSLOduration=3.136796872 podStartE2EDuration="27.108680123s" totalImagesPullingTime="23.971883251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:19.108495216 +0000 UTC m=+27.713789579" watchObservedRunningTime="2026-07-31 20:30:19.108680123 +0000 UTC m=+27.713974487"
Jul 31 20:30:19.913776 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:19.913556    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:19.914074 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:19.913584    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:19.914171 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:19.914078    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7klt" podUID="d6c4d228-4d34-47bd-9881-60e38a8a56e3"
Jul 31 20:30:19.914233 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:19.914182    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nbhtt" podUID="184c96b5-fe65-47a8-a9d1-a0d590bd1765"
Jul 31 20:30:19.914233 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:19.913634    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:19.914346 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:19.914324    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqzzx" podUID="78163815-3577-406a-ba59-f7e6784b6377"
Jul 31 20:30:20.056602 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:20.056576    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 20:30:20.057041 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:20.057016    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r" event={"ID":"211c1840-13e1-474b-9b24-f231cea1964e","Type":"ContainerStarted","Data":"9ffc627400ad2d36ed6623d96cdb7fc8106a806d303a84678ece28edd22e9382"}
Jul 31 20:30:20.057116 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:20.057062    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 31 20:30:20.057338 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:20.057323    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:30:20.059192 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:20.059169    2565 generic.go:356] "Generic (PLEG): container finished" podID="732589ca-b2a0-48d3-aa09-0ab535fb7d94" containerID="f392bb82d4882f0c2b95bdf1ca4df65082f989599f1bf243ddf8aa771983c6b7" exitCode=0
Jul 31 20:30:20.059276 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:20.059250    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vfbbm" event={"ID":"732589ca-b2a0-48d3-aa09-0ab535fb7d94","Type":"ContainerDied","Data":"f392bb82d4882f0c2b95bdf1ca4df65082f989599f1bf243ddf8aa771983c6b7"}
Jul 31 20:30:20.073561 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:20.073542    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:30:20.083041 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:20.082998    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r" podStartSLOduration=8.477940052 podStartE2EDuration="28.082980284s" totalImagesPullingTime="19.605040232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:20.082301676 +0000 UTC m=+28.687596039" watchObservedRunningTime="2026-07-31 20:30:20.082980284 +0000 UTC m=+28.688274647"
Jul 31 20:30:20.817669 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:20.817635    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nbhtt"]
Jul 31 20:30:20.817857 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:20.817846    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:20.817957 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:20.817938    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nbhtt" podUID="184c96b5-fe65-47a8-a9d1-a0d590bd1765"
Jul 31 20:30:20.820509 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:20.820481    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h7klt"]
Jul 31 20:30:20.820628 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:20.820590    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:20.820723 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:20.820701    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7klt" podUID="d6c4d228-4d34-47bd-9881-60e38a8a56e3"
Jul 31 20:30:20.821023 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:20.820999    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dqzzx"]
Jul 31 20:30:20.821120 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:20.821106    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:20.821225 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:20.821205    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqzzx" podUID="78163815-3577-406a-ba59-f7e6784b6377"
Jul 31 20:30:20.973712 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:20.973687    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:30:21.064365 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:21.064333    2565 generic.go:356] "Generic (PLEG): container finished" podID="732589ca-b2a0-48d3-aa09-0ab535fb7d94" containerID="a02ac5e54be76cc0837fa181299475184b6e443e290a030f2e5cb8ac70deb1a0" exitCode=0
Jul 31 20:30:21.064763 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:21.064411    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vfbbm" event={"ID":"732589ca-b2a0-48d3-aa09-0ab535fb7d94","Type":"ContainerDied","Data":"a02ac5e54be76cc0837fa181299475184b6e443e290a030f2e5cb8ac70deb1a0"}
Jul 31 20:30:21.909552 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:21.909520    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:21.909748 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:21.909607    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nbhtt" podUID="184c96b5-fe65-47a8-a9d1-a0d590bd1765"
Jul 31 20:30:22.909263 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:22.909179    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:22.909671 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:22.909297    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqzzx" podUID="78163815-3577-406a-ba59-f7e6784b6377"
Jul 31 20:30:22.909671 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:22.909356    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:22.909671 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:22.909458    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7klt" podUID="d6c4d228-4d34-47bd-9881-60e38a8a56e3"
Jul 31 20:30:23.909709 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:23.909665    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:23.910270 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:23.909811    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nbhtt" podUID="184c96b5-fe65-47a8-a9d1-a0d590bd1765"
Jul 31 20:30:24.908855 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:24.908821    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:24.909050 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:24.908821    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:24.909050 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:24.908946    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7klt" podUID="d6c4d228-4d34-47bd-9881-60e38a8a56e3"
Jul 31 20:30:24.909170 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:24.909064    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dqzzx" podUID="78163815-3577-406a-ba59-f7e6784b6377"
Jul 31 20:30:25.570174 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:25.569992    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs\") pod \"network-metrics-daemon-dqzzx\" (UID: \"78163815-3577-406a-ba59-f7e6784b6377\") " pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:25.570539 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:25.570124    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:30:25.570539 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:25.570268    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs podName:78163815-3577-406a-ba59-f7e6784b6377 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:57.570253938 +0000 UTC m=+66.175548280 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs") pod "network-metrics-daemon-dqzzx" (UID: "78163815-3577-406a-ba59-f7e6784b6377") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:30:25.670928 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:25.670894    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret\") pod \"global-pull-secret-syncer-h7klt\" (UID: \"d6c4d228-4d34-47bd-9881-60e38a8a56e3\") " pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:25.671089 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:25.671019    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 20:30:25.671089 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:25.671072    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret podName:d6c4d228-4d34-47bd-9881-60e38a8a56e3 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:57.671060401 +0000 UTC m=+66.276354741 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret") pod "global-pull-secret-syncer-h7klt" (UID: "d6c4d228-4d34-47bd-9881-60e38a8a56e3") : object "kube-system"/"original-pull-secret" not registered
Jul 31 20:30:25.771754 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:25.771702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t4hv\" (UniqueName: \"kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv\") pod \"network-check-target-nbhtt\" (UID: \"184c96b5-fe65-47a8-a9d1-a0d590bd1765\") " pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:25.771913 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:25.771842    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 20:30:25.771913 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:25.771857    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 20:30:25.771913 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:25.771865    2565 projected.go:196] Error preparing data for projected volume kube-api-access-8t4hv for pod openshift-network-diagnostics/network-check-target-nbhtt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:30:25.771913 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:25.771914    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv podName:184c96b5-fe65-47a8-a9d1-a0d590bd1765 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:57.77190096 +0000 UTC m=+66.377195301 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8t4hv" (UniqueName: "kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv") pod "network-check-target-nbhtt" (UID: "184c96b5-fe65-47a8-a9d1-a0d590bd1765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:30:25.908964 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:25.908940    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:25.909101 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:25.909079    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nbhtt" podUID="184c96b5-fe65-47a8-a9d1-a0d590bd1765"
Jul 31 20:30:26.079096 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.079056    2565 generic.go:356] "Generic (PLEG): container finished" podID="732589ca-b2a0-48d3-aa09-0ab535fb7d94" containerID="d4ba424f8a509de63ca55393d7002965e94709848cfacbd6faa251afc96cb140" exitCode=0
Jul 31 20:30:26.079096 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.079098    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vfbbm" event={"ID":"732589ca-b2a0-48d3-aa09-0ab535fb7d94","Type":"ContainerDied","Data":"d4ba424f8a509de63ca55393d7002965e94709848cfacbd6faa251afc96cb140"}
Jul 31 20:30:26.250160 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.250138    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-218.ec2.internal" event="NodeReady"
Jul 31 20:30:26.250289 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.250261    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 31 20:30:26.284167 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.284136    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"]
Jul 31 20:30:26.294348 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.294325    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cfbf8c644-ghtcq"]
Jul 31 20:30:26.294487 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.294465    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"
Jul 31 20:30:26.297001 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.296980    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 31 20:30:26.297482 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.297466    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ks9k7\""
Jul 31 20:30:26.297569 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.297511    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 31 20:30:26.297821 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.297802    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 31 20:30:26.298194 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.298173    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 31 20:30:26.308718 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.308394    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6bc9d75b56-fmv5h"]
Jul 31 20:30:26.308718 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.308700    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.311814 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.311789    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 31 20:30:26.311905 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.311837    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 31 20:30:26.312030 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.312015    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 31 20:30:26.312168 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.311792    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2j4vz\""
Jul 31 20:30:26.316476 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.316456    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5"]
Jul 31 20:30:26.316476 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.316474    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 31 20:30:26.316751 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.316717    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:26.318879 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.318861    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 31 20:30:26.318978 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.318892    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 31 20:30:26.319248 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.319227    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 31 20:30:26.319345 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.319251    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 31 20:30:26.319345 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.319274    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 31 20:30:26.319459 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.319355    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 31 20:30:26.319523 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.319509    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wfcpd\""
Jul 31 20:30:26.326504 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.326480    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-t7lf9"]
Jul 31 20:30:26.327003 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.326983    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5"
Jul 31 20:30:26.329127 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.329109    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 31 20:30:26.329439 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.329422    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 31 20:30:26.329989 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.329968    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 31 20:30:26.330081 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.329999    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-x6hgc\""
Jul 31 20:30:26.330716 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.330699    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 31 20:30:26.336683 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.336665    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-vfkvs"]
Jul 31 20:30:26.336820 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.336803    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-t7lf9"
Jul 31 20:30:26.339096 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.339078    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 31 20:30:26.339232 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.339217    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-sjwgb\""
Jul 31 20:30:26.339287 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.339265    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 31 20:30:26.344904 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.344889    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6"]
Jul 31 20:30:26.345032 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.345013    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.346998 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.346980    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 31 20:30:26.347082 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.347005    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 31 20:30:26.347540 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.347523    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zbsdt\""
Jul 31 20:30:26.347633 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.347549    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 31 20:30:26.347633 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.347603    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 31 20:30:26.353062 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.353045    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v"]
Jul 31 20:30:26.353193 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.353155    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6"
Jul 31 20:30:26.355311 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.355292    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 31 20:30:26.355560 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.355545    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 31 20:30:26.355976 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.355955    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 31 20:30:26.356318 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.356300    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6qv62\""
Jul 31 20:30:26.356622 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.356608    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 31 20:30:26.359520 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.359501    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-fmf72"]
Jul 31 20:30:26.359776 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.359594    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v"
Jul 31 20:30:26.361255 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.361239    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 31 20:30:26.363709 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.363693    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 31 20:30:26.364260 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.364246    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 31 20:30:26.364508 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.364493    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 31 20:30:26.364615 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.364599    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4mkrf\""
Jul 31 20:30:26.369371 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.369357    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"]
Jul 31 20:30:26.369438 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.369379    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6"]
Jul 31 20:30:26.369438 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.369394    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-wt4mx"]
Jul 31 20:30:26.369506 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.369447    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:30:26.371987 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.371965    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 31 20:30:26.372071 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.372012    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6sjvc\""
Jul 31 20:30:26.372233 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.372217    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 31 20:30:26.373930 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.373911    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 31 20:30:26.376808 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.376790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ed08f05d-1fb1-46a5-8c13-102bea748361-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-sxw2g\" (UID: \"ed08f05d-1fb1-46a5-8c13-102bea748361\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"
Jul 31 20:30:26.376877 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.376855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-sxw2g\" (UID: \"ed08f05d-1fb1-46a5-8c13-102bea748361\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"
Jul 31 20:30:26.376912 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.376882    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhdcp\" (UniqueName: \"kubernetes.io/projected/ed08f05d-1fb1-46a5-8c13-102bea748361-kube-api-access-bhdcp\") pod \"cluster-monitoring-operator-6f55c4f58d-sxw2g\" (UID: \"ed08f05d-1fb1-46a5-8c13-102bea748361\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"
Jul 31 20:30:26.377316 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.377300    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 31 20:30:26.377610 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.377590    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5"]
Jul 31 20:30:26.377684 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.377619    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-vfkvs"]
Jul 31 20:30:26.377684 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.377632    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bc9d75b56-fmv5h"]
Jul 31 20:30:26.377684 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.377644    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cfbf8c644-ghtcq"]
Jul 31 20:30:26.377684 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.377657    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-68khq"]
Jul 31 20:30:26.377901 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.377706    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-wt4mx"
Jul 31 20:30:26.380820 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.380803    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 31 20:30:26.382653 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.382633    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 20:30:26.383002 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.382982    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-q495q\""
Jul 31 20:30:26.383814 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.383800    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 20:30:26.385542 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.385526    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tsqzv"]
Jul 31 20:30:26.385636 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.385623    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-68khq"
Jul 31 20:30:26.388504 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.388487    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 31 20:30:26.388504 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.388500    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 31 20:30:26.388801 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.388787    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 31 20:30:26.389596 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.389584    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jbv2m\""
Jul 31 20:30:26.391838 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.391822    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-wt4mx"]
Jul 31 20:30:26.391908 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.391851    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v"]
Jul 31 20:30:26.391908 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.391868    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-fmf72"]
Jul 31 20:30:26.391908 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.391879    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-68khq"]
Jul 31 20:30:26.391908 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.391890    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-t7lf9"]
Jul 31 20:30:26.391908 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.391901    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tsqzv"]
Jul 31 20:30:26.392063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.391918    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:26.395624 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.395610    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 31 20:30:26.395816 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.395801    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 31 20:30:26.395856 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.395845    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w7w5c\""
Jul 31 20:30:26.477286 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-certificates\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.477396 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477294    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-bound-sa-token\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.477396 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ed08f05d-1fb1-46a5-8c13-102bea748361-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-sxw2g\" (UID: \"ed08f05d-1fb1-46a5-8c13-102bea748361\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"
Jul 31 20:30:26.477396 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b9948a1-099f-4f1c-98a1-99155b23bebe-image-registry-private-configuration\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.477396 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477381    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b9948a1-099f-4f1c-98a1-99155b23bebe-ca-trust-extracted\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.477540 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477407    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b9948a1-099f-4f1c-98a1-99155b23bebe-trusted-ca\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.477540 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477464    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b24a63c2-0cf8-478c-a622-869116d09329-cert\") pod \"ingress-canary-68khq\" (UID: \"b24a63c2-0cf8-478c-a622-869116d09329\") " pod="openshift-ingress-canary/ingress-canary-68khq"
Jul 31 20:30:26.477540 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477508    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-stats-auth\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:26.477646 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477541    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d8329200-4000-4de4-8ef7-abf447f2e636-snapshots\") pod \"insights-operator-77696685b-vfkvs\" (UID: \"d8329200-4000-4de4-8ef7-abf447f2e636\") " pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.477646 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:26.477787 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cfe485d-9832-42d7-bf3f-03ee9f76fc84-config\") pod \"console-operator-5ccd6b445f-fmf72\" (UID: \"2cfe485d-9832-42d7-bf3f-03ee9f76fc84\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:30:26.477787 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cfe485d-9832-42d7-bf3f-03ee9f76fc84-serving-cert\") pod \"console-operator-5ccd6b445f-fmf72\" (UID: \"2cfe485d-9832-42d7-bf3f-03ee9f76fc84\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:30:26.477945 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-sxw2g\" (UID: \"ed08f05d-1fb1-46a5-8c13-102bea748361\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"
Jul 31 20:30:26.477945 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477834    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl226\" (UniqueName: \"kubernetes.io/projected/2cfe485d-9832-42d7-bf3f-03ee9f76fc84-kube-api-access-hl226\") pod \"console-operator-5ccd6b445f-fmf72\" (UID: \"2cfe485d-9832-42d7-bf3f-03ee9f76fc84\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:30:26.477945 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477859    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glp6c\" (UniqueName: \"kubernetes.io/projected/3cac8fa3-385e-4753-92de-de2489ad9a73-kube-api-access-glp6c\") pod \"network-check-source-65bdbbff45-wt4mx\" (UID: \"3cac8fa3-385e-4753-92de-de2489ad9a73\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-wt4mx"
Jul 31 20:30:26.477945 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c565a1e5-6a0d-4655-93ae-606d7f18049c-tmp-dir\") pod \"dns-default-tsqzv\" (UID: \"c565a1e5-6a0d-4655-93ae-606d7f18049c\") " pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:26.477945 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477917    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b9948a1-099f-4f1c-98a1-99155b23bebe-installation-pull-secrets\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.478457 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s59l7\" (UniqueName: \"kubernetes.io/projected/b24a63c2-0cf8-478c-a622-869116d09329-kube-api-access-s59l7\") pod \"ingress-canary-68khq\" (UID: \"b24a63c2-0cf8-478c-a622-869116d09329\") " pod="openshift-ingress-canary/ingress-canary-68khq"
Jul 31 20:30:26.478457 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.477976    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8329200-4000-4de4-8ef7-abf447f2e636-trusted-ca-bundle\") pod \"insights-operator-77696685b-vfkvs\" (UID: \"d8329200-4000-4de4-8ef7-abf447f2e636\") " pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.478457 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478005    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:26.478457 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdkz7\" (UniqueName: \"kubernetes.io/projected/ff238e54-d1f3-4c02-87f1-857f3b510b84-kube-api-access-wdkz7\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:26.478457 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478056    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f405b67c-4d95-4880-8ad3-2915433fe139-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-z9sj5\" (UID: \"f405b67c-4d95-4880-8ad3-2915433fe139\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5"
Jul 31 20:30:26.478457 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478081    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl2kc\" (UniqueName: \"kubernetes.io/projected/d96baaf6-7e89-4c38-8824-92b2df6d14ef-kube-api-access-jl2kc\") pod \"cluster-samples-operator-559cbf5745-zbw4v\" (UID: \"d96baaf6-7e89-4c38-8824-92b2df6d14ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v"
Jul 31 20:30:26.478457 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478111    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ed08f05d-1fb1-46a5-8c13-102bea748361-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-sxw2g\" (UID: \"ed08f05d-1fb1-46a5-8c13-102bea748361\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"
Jul 31 20:30:26.478457 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.478457 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478155    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx87d\" (UniqueName: \"kubernetes.io/projected/d8329200-4000-4de4-8ef7-abf447f2e636-kube-api-access-xx87d\") pod \"insights-operator-77696685b-vfkvs\" (UID: \"d8329200-4000-4de4-8ef7-abf447f2e636\") " pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.478457 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478186    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85ab1ab6-5d3a-4173-8e9a-85ca012925fd-serving-cert\") pod \"service-ca-operator-784f97bcf6-vxlv6\" (UID: \"85ab1ab6-5d3a-4173-8e9a-85ca012925fd\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6"
Jul 31 20:30:26.478457 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478208    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2cfe485d-9832-42d7-bf3f-03ee9f76fc84-trusted-ca\") pod \"console-operator-5ccd6b445f-fmf72\" (UID: \"2cfe485d-9832-42d7-bf3f-03ee9f76fc84\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:30:26.478457 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:26.478217    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 31 20:30:26.478457 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f405b67c-4d95-4880-8ad3-2915433fe139-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-z9sj5\" (UID: \"f405b67c-4d95-4880-8ad3-2915433fe139\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5"
Jul 31 20:30:26.478457 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478254    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls\") pod \"dns-default-tsqzv\" (UID: \"c565a1e5-6a0d-4655-93ae-606d7f18049c\") " pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:26.478457 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:26.478280    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls podName:ed08f05d-1fb1-46a5-8c13-102bea748361 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:26.978263661 +0000 UTC m=+35.583558017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-sxw2g" (UID: "ed08f05d-1fb1-46a5-8c13-102bea748361") : secret "cluster-monitoring-operator-tls" not found
Jul 31 20:30:26.479200 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478492    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8329200-4000-4de4-8ef7-abf447f2e636-tmp\") pod \"insights-operator-77696685b-vfkvs\" (UID: \"d8329200-4000-4de4-8ef7-abf447f2e636\") " pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.479200 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8329200-4000-4de4-8ef7-abf447f2e636-serving-cert\") pod \"insights-operator-77696685b-vfkvs\" (UID: \"d8329200-4000-4de4-8ef7-abf447f2e636\") " pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.479200 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btb6j\" (UniqueName: \"kubernetes.io/projected/85ab1ab6-5d3a-4173-8e9a-85ca012925fd-kube-api-access-btb6j\") pod \"service-ca-operator-784f97bcf6-vxlv6\" (UID: \"85ab1ab6-5d3a-4173-8e9a-85ca012925fd\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6"
Jul 31 20:30:26.479200 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8329200-4000-4de4-8ef7-abf447f2e636-service-ca-bundle\") pod \"insights-operator-77696685b-vfkvs\" (UID: \"d8329200-4000-4de4-8ef7-abf447f2e636\") " pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.479200 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478645    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzs72\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-kube-api-access-dzs72\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.479200 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478670    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-default-certificate\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:26.479200 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478690    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdjzx\" (UniqueName: \"kubernetes.io/projected/f405b67c-4d95-4880-8ad3-2915433fe139-kube-api-access-xdjzx\") pod \"kube-storage-version-migrator-operator-7878f4b88c-z9sj5\" (UID: \"f405b67c-4d95-4880-8ad3-2915433fe139\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5"
Jul 31 20:30:26.479200 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478724    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzgs2\" (UniqueName: \"kubernetes.io/projected/c565a1e5-6a0d-4655-93ae-606d7f18049c-kube-api-access-lzgs2\") pod \"dns-default-tsqzv\" (UID: \"c565a1e5-6a0d-4655-93ae-606d7f18049c\") " pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:26.479200 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478784    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zbw4v\" (UID: \"d96baaf6-7e89-4c38-8824-92b2df6d14ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v"
Jul 31 20:30:26.479200 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478823    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85ab1ab6-5d3a-4173-8e9a-85ca012925fd-config\") pod \"service-ca-operator-784f97bcf6-vxlv6\" (UID: \"85ab1ab6-5d3a-4173-8e9a-85ca012925fd\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6"
Jul 31 20:30:26.479200 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478853    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c565a1e5-6a0d-4655-93ae-606d7f18049c-config-volume\") pod \"dns-default-tsqzv\" (UID: \"c565a1e5-6a0d-4655-93ae-606d7f18049c\") " pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:26.479200 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478916    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cw42\" (UniqueName: \"kubernetes.io/projected/fa145089-9180-41ec-9e64-fad46e720174-kube-api-access-7cw42\") pod \"volume-data-source-validator-5b8776669-t7lf9\" (UID: \"fa145089-9180-41ec-9e64-fad46e720174\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-t7lf9"
Jul 31 20:30:26.479200 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.478946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhdcp\" (UniqueName: \"kubernetes.io/projected/ed08f05d-1fb1-46a5-8c13-102bea748361-kube-api-access-bhdcp\") pod \"cluster-monitoring-operator-6f55c4f58d-sxw2g\" (UID: \"ed08f05d-1fb1-46a5-8c13-102bea748361\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"
Jul 31 20:30:26.488096 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.488077    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhdcp\" (UniqueName: \"kubernetes.io/projected/ed08f05d-1fb1-46a5-8c13-102bea748361-kube-api-access-bhdcp\") pod \"cluster-monitoring-operator-6f55c4f58d-sxw2g\" (UID: \"ed08f05d-1fb1-46a5-8c13-102bea748361\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"
Jul 31 20:30:26.579521 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.579489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b9948a1-099f-4f1c-98a1-99155b23bebe-image-registry-private-configuration\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.579521 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.579524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b9948a1-099f-4f1c-98a1-99155b23bebe-ca-trust-extracted\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.580366 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.579549    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b9948a1-099f-4f1c-98a1-99155b23bebe-trusted-ca\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.580366 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.579681    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b24a63c2-0cf8-478c-a622-869116d09329-cert\") pod \"ingress-canary-68khq\" (UID: \"b24a63c2-0cf8-478c-a622-869116d09329\") " pod="openshift-ingress-canary/ingress-canary-68khq"
Jul 31 20:30:26.580366 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.579723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-stats-auth\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:26.580366 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.579778    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d8329200-4000-4de4-8ef7-abf447f2e636-snapshots\") pod \"insights-operator-77696685b-vfkvs\" (UID: \"d8329200-4000-4de4-8ef7-abf447f2e636\") " pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.580366 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.579828    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:26.580366 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.579852    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cfe485d-9832-42d7-bf3f-03ee9f76fc84-config\") pod \"console-operator-5ccd6b445f-fmf72\" (UID: \"2cfe485d-9832-42d7-bf3f-03ee9f76fc84\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:30:26.580366 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.579874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cfe485d-9832-42d7-bf3f-03ee9f76fc84-serving-cert\") pod \"console-operator-5ccd6b445f-fmf72\" (UID: \"2cfe485d-9832-42d7-bf3f-03ee9f76fc84\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:30:26.580366 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.579918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl226\" (UniqueName: \"kubernetes.io/projected/2cfe485d-9832-42d7-bf3f-03ee9f76fc84-kube-api-access-hl226\") pod \"console-operator-5ccd6b445f-fmf72\" (UID: \"2cfe485d-9832-42d7-bf3f-03ee9f76fc84\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:30:26.580366 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.579948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glp6c\" (UniqueName: \"kubernetes.io/projected/3cac8fa3-385e-4753-92de-de2489ad9a73-kube-api-access-glp6c\") pod \"network-check-source-65bdbbff45-wt4mx\" (UID: \"3cac8fa3-385e-4753-92de-de2489ad9a73\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-wt4mx"
Jul 31 20:30:26.580366 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.579975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c565a1e5-6a0d-4655-93ae-606d7f18049c-tmp-dir\") pod \"dns-default-tsqzv\" (UID: \"c565a1e5-6a0d-4655-93ae-606d7f18049c\") " pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:26.580366 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.579994    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b9948a1-099f-4f1c-98a1-99155b23bebe-ca-trust-extracted\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.580366 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.580003    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b9948a1-099f-4f1c-98a1-99155b23bebe-installation-pull-secrets\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.580366 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:26.580087    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 20:30:26.580366 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.580144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s59l7\" (UniqueName: \"kubernetes.io/projected/b24a63c2-0cf8-478c-a622-869116d09329-kube-api-access-s59l7\") pod \"ingress-canary-68khq\" (UID: \"b24a63c2-0cf8-478c-a622-869116d09329\") " pod="openshift-ingress-canary/ingress-canary-68khq"
Jul 31 20:30:26.580366 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:26.580168    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs podName:ff238e54-d1f3-4c02-87f1-857f3b510b84 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:27.080138858 +0000 UTC m=+35.685433204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs") pod "router-default-6bc9d75b56-fmv5h" (UID: "ff238e54-d1f3-4c02-87f1-857f3b510b84") : secret "router-metrics-certs-default" not found
Jul 31 20:30:26.580366 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.580218    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8329200-4000-4de4-8ef7-abf447f2e636-trusted-ca-bundle\") pod \"insights-operator-77696685b-vfkvs\" (UID: \"d8329200-4000-4de4-8ef7-abf447f2e636\") " pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.581216 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.580255    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:26.581216 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.580308    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdkz7\" (UniqueName: \"kubernetes.io/projected/ff238e54-d1f3-4c02-87f1-857f3b510b84-kube-api-access-wdkz7\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:26.581216 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.580338    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f405b67c-4d95-4880-8ad3-2915433fe139-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-z9sj5\" (UID: \"f405b67c-4d95-4880-8ad3-2915433fe139\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5"
Jul 31 20:30:26.581216 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.580393    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl2kc\" (UniqueName: \"kubernetes.io/projected/d96baaf6-7e89-4c38-8824-92b2df6d14ef-kube-api-access-jl2kc\") pod \"cluster-samples-operator-559cbf5745-zbw4v\" (UID: \"d96baaf6-7e89-4c38-8824-92b2df6d14ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v"
Jul 31 20:30:26.581216 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.580615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.581216 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.580640    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx87d\" (UniqueName: \"kubernetes.io/projected/d8329200-4000-4de4-8ef7-abf447f2e636-kube-api-access-xx87d\") pod \"insights-operator-77696685b-vfkvs\" (UID: \"d8329200-4000-4de4-8ef7-abf447f2e636\") " pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.581216 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.580684    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b9948a1-099f-4f1c-98a1-99155b23bebe-trusted-ca\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.581216 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.580717    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cfe485d-9832-42d7-bf3f-03ee9f76fc84-config\") pod \"console-operator-5ccd6b445f-fmf72\" (UID: \"2cfe485d-9832-42d7-bf3f-03ee9f76fc84\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:30:26.581216 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.581135    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c565a1e5-6a0d-4655-93ae-606d7f18049c-tmp-dir\") pod \"dns-default-tsqzv\" (UID: \"c565a1e5-6a0d-4655-93ae-606d7f18049c\") " pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:26.581216 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.581212    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d8329200-4000-4de4-8ef7-abf447f2e636-snapshots\") pod \"insights-operator-77696685b-vfkvs\" (UID: \"d8329200-4000-4de4-8ef7-abf447f2e636\") " pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.581773 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:26.581322    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 20:30:26.581773 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:26.581335    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cfbf8c644-ghtcq: secret "image-registry-tls" not found
Jul 31 20:30:26.581773 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.581368    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8329200-4000-4de4-8ef7-abf447f2e636-trusted-ca-bundle\") pod \"insights-operator-77696685b-vfkvs\" (UID: \"d8329200-4000-4de4-8ef7-abf447f2e636\") " pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.581773 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:26.581439    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle podName:ff238e54-d1f3-4c02-87f1-857f3b510b84 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:27.081419439 +0000 UTC m=+35.686713784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle") pod "router-default-6bc9d75b56-fmv5h" (UID: "ff238e54-d1f3-4c02-87f1-857f3b510b84") : configmap references non-existent config key: service-ca.crt
Jul 31 20:30:26.581773 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:26.581509    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls podName:9b9948a1-099f-4f1c-98a1-99155b23bebe nodeName:}" failed. No retries permitted until 2026-07-31 20:30:27.081469402 +0000 UTC m=+35.686763743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls") pod "image-registry-5cfbf8c644-ghtcq" (UID: "9b9948a1-099f-4f1c-98a1-99155b23bebe") : secret "image-registry-tls" not found
Jul 31 20:30:26.581773 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.581586    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85ab1ab6-5d3a-4173-8e9a-85ca012925fd-serving-cert\") pod \"service-ca-operator-784f97bcf6-vxlv6\" (UID: \"85ab1ab6-5d3a-4173-8e9a-85ca012925fd\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6"
Jul 31 20:30:26.581773 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.581613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2cfe485d-9832-42d7-bf3f-03ee9f76fc84-trusted-ca\") pod \"console-operator-5ccd6b445f-fmf72\" (UID: \"2cfe485d-9832-42d7-bf3f-03ee9f76fc84\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:30:26.581773 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.581644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f405b67c-4d95-4880-8ad3-2915433fe139-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-z9sj5\" (UID: \"f405b67c-4d95-4880-8ad3-2915433fe139\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5"
Jul 31 20:30:26.581773 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.581671    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls\") pod \"dns-default-tsqzv\" (UID: \"c565a1e5-6a0d-4655-93ae-606d7f18049c\") " pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:26.581773 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.581674    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f405b67c-4d95-4880-8ad3-2915433fe139-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-z9sj5\" (UID: \"f405b67c-4d95-4880-8ad3-2915433fe139\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5"
Jul 31 20:30:26.581773 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.581724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8329200-4000-4de4-8ef7-abf447f2e636-tmp\") pod \"insights-operator-77696685b-vfkvs\" (UID: \"d8329200-4000-4de4-8ef7-abf447f2e636\") " pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.581773 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.581770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8329200-4000-4de4-8ef7-abf447f2e636-serving-cert\") pod \"insights-operator-77696685b-vfkvs\" (UID: \"d8329200-4000-4de4-8ef7-abf447f2e636\") " pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.582447 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.581798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btb6j\" (UniqueName: \"kubernetes.io/projected/85ab1ab6-5d3a-4173-8e9a-85ca012925fd-kube-api-access-btb6j\") pod \"service-ca-operator-784f97bcf6-vxlv6\" (UID: \"85ab1ab6-5d3a-4173-8e9a-85ca012925fd\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6"
Jul 31 20:30:26.582447 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.581823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8329200-4000-4de4-8ef7-abf447f2e636-service-ca-bundle\") pod \"insights-operator-77696685b-vfkvs\" (UID: \"d8329200-4000-4de4-8ef7-abf447f2e636\") " pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.582447 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.581855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzs72\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-kube-api-access-dzs72\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.582447 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.581882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-default-certificate\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:26.582447 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.581916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdjzx\" (UniqueName: \"kubernetes.io/projected/f405b67c-4d95-4880-8ad3-2915433fe139-kube-api-access-xdjzx\") pod \"kube-storage-version-migrator-operator-7878f4b88c-z9sj5\" (UID: \"f405b67c-4d95-4880-8ad3-2915433fe139\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5"
Jul 31 20:30:26.582447 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.581944    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzgs2\" (UniqueName: \"kubernetes.io/projected/c565a1e5-6a0d-4655-93ae-606d7f18049c-kube-api-access-lzgs2\") pod \"dns-default-tsqzv\" (UID: \"c565a1e5-6a0d-4655-93ae-606d7f18049c\") " pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:26.582447 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.581970    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zbw4v\" (UID: \"d96baaf6-7e89-4c38-8824-92b2df6d14ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v"
Jul 31 20:30:26.582447 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.581995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85ab1ab6-5d3a-4173-8e9a-85ca012925fd-config\") pod \"service-ca-operator-784f97bcf6-vxlv6\" (UID: \"85ab1ab6-5d3a-4173-8e9a-85ca012925fd\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6"
Jul 31 20:30:26.582447 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.582018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c565a1e5-6a0d-4655-93ae-606d7f18049c-config-volume\") pod \"dns-default-tsqzv\" (UID: \"c565a1e5-6a0d-4655-93ae-606d7f18049c\") " pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:26.582447 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.582053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cw42\" (UniqueName: \"kubernetes.io/projected/fa145089-9180-41ec-9e64-fad46e720174-kube-api-access-7cw42\") pod \"volume-data-source-validator-5b8776669-t7lf9\" (UID: \"fa145089-9180-41ec-9e64-fad46e720174\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-t7lf9"
Jul 31 20:30:26.582447 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.582095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-certificates\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.582447 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.582121    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-bound-sa-token\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.583095 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.582460    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8329200-4000-4de4-8ef7-abf447f2e636-service-ca-bundle\") pod \"insights-operator-77696685b-vfkvs\" (UID: \"d8329200-4000-4de4-8ef7-abf447f2e636\") " pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.583095 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:26.582546    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 20:30:26.583095 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:26.582600    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls podName:c565a1e5-6a0d-4655-93ae-606d7f18049c nodeName:}" failed. No retries permitted until 2026-07-31 20:30:27.082585299 +0000 UTC m=+35.687879655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls") pod "dns-default-tsqzv" (UID: "c565a1e5-6a0d-4655-93ae-606d7f18049c") : secret "dns-default-metrics-tls" not found
Jul 31 20:30:26.583095 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.582871    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8329200-4000-4de4-8ef7-abf447f2e636-tmp\") pod \"insights-operator-77696685b-vfkvs\" (UID: \"d8329200-4000-4de4-8ef7-abf447f2e636\") " pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.583431 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.583366    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b9948a1-099f-4f1c-98a1-99155b23bebe-installation-pull-secrets\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.584118 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.583855    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85ab1ab6-5d3a-4173-8e9a-85ca012925fd-config\") pod \"service-ca-operator-784f97bcf6-vxlv6\" (UID: \"85ab1ab6-5d3a-4173-8e9a-85ca012925fd\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6"
Jul 31 20:30:26.584118 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.583924    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-stats-auth\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:26.584118 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:26.583942    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 20:30:26.584118 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:26.583985    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls podName:d96baaf6-7e89-4c38-8824-92b2df6d14ef nodeName:}" failed. No retries permitted until 2026-07-31 20:30:27.083970467 +0000 UTC m=+35.689264809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-zbw4v" (UID: "d96baaf6-7e89-4c38-8824-92b2df6d14ef") : secret "samples-operator-tls" not found
Jul 31 20:30:26.584118 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.584088    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b24a63c2-0cf8-478c-a622-869116d09329-cert\") pod \"ingress-canary-68khq\" (UID: \"b24a63c2-0cf8-478c-a622-869116d09329\") " pod="openshift-ingress-canary/ingress-canary-68khq"
Jul 31 20:30:26.584399 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.584308    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-certificates\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.584455 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.584436    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b9948a1-099f-4f1c-98a1-99155b23bebe-image-registry-private-configuration\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.584547 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.584520    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c565a1e5-6a0d-4655-93ae-606d7f18049c-config-volume\") pod \"dns-default-tsqzv\" (UID: \"c565a1e5-6a0d-4655-93ae-606d7f18049c\") " pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:26.584722 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.584702    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85ab1ab6-5d3a-4173-8e9a-85ca012925fd-serving-cert\") pod \"service-ca-operator-784f97bcf6-vxlv6\" (UID: \"85ab1ab6-5d3a-4173-8e9a-85ca012925fd\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6"
Jul 31 20:30:26.584834 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.584711    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2cfe485d-9832-42d7-bf3f-03ee9f76fc84-trusted-ca\") pod \"console-operator-5ccd6b445f-fmf72\" (UID: \"2cfe485d-9832-42d7-bf3f-03ee9f76fc84\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:30:26.585266 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.585251    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f405b67c-4d95-4880-8ad3-2915433fe139-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-z9sj5\" (UID: \"f405b67c-4d95-4880-8ad3-2915433fe139\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5"
Jul 31 20:30:26.585666 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.585643    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cfe485d-9832-42d7-bf3f-03ee9f76fc84-serving-cert\") pod \"console-operator-5ccd6b445f-fmf72\" (UID: \"2cfe485d-9832-42d7-bf3f-03ee9f76fc84\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:30:26.586390 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.586357    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-default-certificate\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:26.586574 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.586556    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8329200-4000-4de4-8ef7-abf447f2e636-serving-cert\") pod \"insights-operator-77696685b-vfkvs\" (UID: \"d8329200-4000-4de4-8ef7-abf447f2e636\") " pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.588818 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.588777    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glp6c\" (UniqueName: \"kubernetes.io/projected/3cac8fa3-385e-4753-92de-de2489ad9a73-kube-api-access-glp6c\") pod \"network-check-source-65bdbbff45-wt4mx\" (UID: \"3cac8fa3-385e-4753-92de-de2489ad9a73\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-wt4mx"
Jul 31 20:30:26.589187 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.589162    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdkz7\" (UniqueName: \"kubernetes.io/projected/ff238e54-d1f3-4c02-87f1-857f3b510b84-kube-api-access-wdkz7\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:26.589452 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.589424    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl226\" (UniqueName: \"kubernetes.io/projected/2cfe485d-9832-42d7-bf3f-03ee9f76fc84-kube-api-access-hl226\") pod \"console-operator-5ccd6b445f-fmf72\" (UID: \"2cfe485d-9832-42d7-bf3f-03ee9f76fc84\") " pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:30:26.589877 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.589832    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s59l7\" (UniqueName: \"kubernetes.io/projected/b24a63c2-0cf8-478c-a622-869116d09329-kube-api-access-s59l7\") pod \"ingress-canary-68khq\" (UID: \"b24a63c2-0cf8-478c-a622-869116d09329\") " pod="openshift-ingress-canary/ingress-canary-68khq"
Jul 31 20:30:26.590000 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.589980    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl2kc\" (UniqueName: \"kubernetes.io/projected/d96baaf6-7e89-4c38-8824-92b2df6d14ef-kube-api-access-jl2kc\") pod \"cluster-samples-operator-559cbf5745-zbw4v\" (UID: \"d96baaf6-7e89-4c38-8824-92b2df6d14ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v"
Jul 31 20:30:26.590211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.590172    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx87d\" (UniqueName: \"kubernetes.io/projected/d8329200-4000-4de4-8ef7-abf447f2e636-kube-api-access-xx87d\") pod \"insights-operator-77696685b-vfkvs\" (UID: \"d8329200-4000-4de4-8ef7-abf447f2e636\") " pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.590561 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.590540    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzs72\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-kube-api-access-dzs72\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.591081 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.591057    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-bound-sa-token\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:26.591522 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.591498    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btb6j\" (UniqueName: \"kubernetes.io/projected/85ab1ab6-5d3a-4173-8e9a-85ca012925fd-kube-api-access-btb6j\") pod \"service-ca-operator-784f97bcf6-vxlv6\" (UID: \"85ab1ab6-5d3a-4173-8e9a-85ca012925fd\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6"
Jul 31 20:30:26.592011 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.591989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cw42\" (UniqueName: \"kubernetes.io/projected/fa145089-9180-41ec-9e64-fad46e720174-kube-api-access-7cw42\") pod \"volume-data-source-validator-5b8776669-t7lf9\" (UID: \"fa145089-9180-41ec-9e64-fad46e720174\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-t7lf9"
Jul 31 20:30:26.592216 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.592181    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdjzx\" (UniqueName: \"kubernetes.io/projected/f405b67c-4d95-4880-8ad3-2915433fe139-kube-api-access-xdjzx\") pod \"kube-storage-version-migrator-operator-7878f4b88c-z9sj5\" (UID: \"f405b67c-4d95-4880-8ad3-2915433fe139\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5"
Jul 31 20:30:26.592599 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.592584    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzgs2\" (UniqueName: \"kubernetes.io/projected/c565a1e5-6a0d-4655-93ae-606d7f18049c-kube-api-access-lzgs2\") pod \"dns-default-tsqzv\" (UID: \"c565a1e5-6a0d-4655-93ae-606d7f18049c\") " pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:26.645544 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.645486    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5"
Jul 31 20:30:26.651602 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.651583    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-t7lf9"
Jul 31 20:30:26.656777 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.656763    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-vfkvs"
Jul 31 20:30:26.663666 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.663652    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6"
Jul 31 20:30:26.677054 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.677034    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:30:26.685198 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.685177    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-wt4mx"
Jul 31 20:30:26.693341 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.693318    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-68khq"
Jul 31 20:30:26.865519 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.864771    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5"]
Jul 31 20:30:26.876679 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:30:26.874387    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf405b67c_4d95_4880_8ad3_2915433fe139.slice/crio-f861ce92e5d78c1159d2484822505a9f04a572dee3543626fbb77bc425123e6a WatchSource:0}: Error finding container f861ce92e5d78c1159d2484822505a9f04a572dee3543626fbb77bc425123e6a: Status 404 returned error can't find the container with id f861ce92e5d78c1159d2484822505a9f04a572dee3543626fbb77bc425123e6a
Jul 31 20:30:26.883357 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.883238    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-t7lf9"]
Jul 31 20:30:26.910835 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.910120    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:26.914179 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.911330    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:26.914179 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.913501    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 20:30:26.914179 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.913758    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 20:30:26.914179 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.913970    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9lfhf\""
Jul 31 20:30:26.951926 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.951785    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-fmf72"]
Jul 31 20:30:26.954710 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:30:26.954573    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cfe485d_9832_42d7_bf3f_03ee9f76fc84.slice/crio-dcc1c0f28967a50540a81a0b5e8595a45b8c39c7a4250760f77509745d2902f0 WatchSource:0}: Error finding container dcc1c0f28967a50540a81a0b5e8595a45b8c39c7a4250760f77509745d2902f0: Status 404 returned error can't find the container with id dcc1c0f28967a50540a81a0b5e8595a45b8c39c7a4250760f77509745d2902f0
Jul 31 20:30:26.982559 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.982487    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-vfkvs"]
Jul 31 20:30:26.985196 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:30:26.985170    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8329200_4000_4de4_8ef7_abf447f2e636.slice/crio-e5a5d14941c6df43a07f3b63c7c18cb29e3625985d8a6b6f97b14c843dd3ab0d WatchSource:0}: Error finding container e5a5d14941c6df43a07f3b63c7c18cb29e3625985d8a6b6f97b14c843dd3ab0d: Status 404 returned error can't find the container with id e5a5d14941c6df43a07f3b63c7c18cb29e3625985d8a6b6f97b14c843dd3ab0d
Jul 31 20:30:26.989453 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.989428    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-68khq"]
Jul 31 20:30:26.992601 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:30:26.992577    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb24a63c2_0cf8_478c_a622_869116d09329.slice/crio-d6114b1944754838588e37601d09f093365b26d542a57fe4431922674ad2d948 WatchSource:0}: Error finding container d6114b1944754838588e37601d09f093365b26d542a57fe4431922674ad2d948: Status 404 returned error can't find the container with id d6114b1944754838588e37601d09f093365b26d542a57fe4431922674ad2d948
Jul 31 20:30:26.994075 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:26.994059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-sxw2g\" (UID: \"ed08f05d-1fb1-46a5-8c13-102bea748361\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"
Jul 31 20:30:26.994177 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:26.994164    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 31 20:30:26.994232 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:26.994222    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls podName:ed08f05d-1fb1-46a5-8c13-102bea748361 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:27.994205723 +0000 UTC m=+36.599500067 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-sxw2g" (UID: "ed08f05d-1fb1-46a5-8c13-102bea748361") : secret "cluster-monitoring-operator-tls" not found
Jul 31 20:30:27.006785 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:27.006760    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6"]
Jul 31 20:30:27.009709 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:30:27.009689    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85ab1ab6_5d3a_4173_8e9a_85ca012925fd.slice/crio-3083d337d863de045db6728c9cde856276bb60a21f30da9d9abb9009dbafc57c WatchSource:0}: Error finding container 3083d337d863de045db6728c9cde856276bb60a21f30da9d9abb9009dbafc57c: Status 404 returned error can't find the container with id 3083d337d863de045db6728c9cde856276bb60a21f30da9d9abb9009dbafc57c
Jul 31 20:30:27.009848 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:27.009815    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-wt4mx"]
Jul 31 20:30:27.012417 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:30:27.012397    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cac8fa3_385e_4753_92de_de2489ad9a73.slice/crio-0c327e44fb20920e907f7866d39ec0710a4e37161fae4d42dde103dd1f9e6edf WatchSource:0}: Error finding container 0c327e44fb20920e907f7866d39ec0710a4e37161fae4d42dde103dd1f9e6edf: Status 404 returned error can't find the container with id 0c327e44fb20920e907f7866d39ec0710a4e37161fae4d42dde103dd1f9e6edf
Jul 31 20:30:27.082553 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:27.082522    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72" event={"ID":"2cfe485d-9832-42d7-bf3f-03ee9f76fc84","Type":"ContainerStarted","Data":"dcc1c0f28967a50540a81a0b5e8595a45b8c39c7a4250760f77509745d2902f0"}
Jul 31 20:30:27.083581 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:27.083554    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6" event={"ID":"85ab1ab6-5d3a-4173-8e9a-85ca012925fd","Type":"ContainerStarted","Data":"3083d337d863de045db6728c9cde856276bb60a21f30da9d9abb9009dbafc57c"}
Jul 31 20:30:27.084519 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:27.084500    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-vfkvs" event={"ID":"d8329200-4000-4de4-8ef7-abf447f2e636","Type":"ContainerStarted","Data":"e5a5d14941c6df43a07f3b63c7c18cb29e3625985d8a6b6f97b14c843dd3ab0d"}
Jul 31 20:30:27.085561 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:27.085544    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5" event={"ID":"f405b67c-4d95-4880-8ad3-2915433fe139","Type":"ContainerStarted","Data":"f861ce92e5d78c1159d2484822505a9f04a572dee3543626fbb77bc425123e6a"}
Jul 31 20:30:27.088365 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:27.088344    2565 generic.go:356] "Generic (PLEG): container finished" podID="732589ca-b2a0-48d3-aa09-0ab535fb7d94" containerID="c9ce1383d55092759c973c4117389d4d83f6d1745412a2448c4da5aab7e532b9" exitCode=0
Jul 31 20:30:27.088445 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:27.088424    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vfbbm" event={"ID":"732589ca-b2a0-48d3-aa09-0ab535fb7d94","Type":"ContainerDied","Data":"c9ce1383d55092759c973c4117389d4d83f6d1745412a2448c4da5aab7e532b9"}
Jul 31 20:30:27.089532 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:27.089496    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-t7lf9" event={"ID":"fa145089-9180-41ec-9e64-fad46e720174","Type":"ContainerStarted","Data":"71de0844ea8f63c1090251d4d585401141eaa2fb77eab1f1f78e4ee816a12491"}
Jul 31 20:30:27.090502 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:27.090475    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-68khq" event={"ID":"b24a63c2-0cf8-478c-a622-869116d09329","Type":"ContainerStarted","Data":"d6114b1944754838588e37601d09f093365b26d542a57fe4431922674ad2d948"}
Jul 31 20:30:27.091482 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:27.091462    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-wt4mx" event={"ID":"3cac8fa3-385e-4753-92de-de2489ad9a73","Type":"ContainerStarted","Data":"0c327e44fb20920e907f7866d39ec0710a4e37161fae4d42dde103dd1f9e6edf"}
Jul 31 20:30:27.094941 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:27.094921    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:27.095015 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:27.094958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:27.095015 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:27.094977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls\") pod \"dns-default-tsqzv\" (UID: \"c565a1e5-6a0d-4655-93ae-606d7f18049c\") " pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:27.095097 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:27.095062    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle podName:ff238e54-d1f3-4c02-87f1-857f3b510b84 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:28.095046347 +0000 UTC m=+36.700340687 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle") pod "router-default-6bc9d75b56-fmv5h" (UID: "ff238e54-d1f3-4c02-87f1-857f3b510b84") : configmap references non-existent config key: service-ca.crt
Jul 31 20:30:27.095097 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:27.095070    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 20:30:27.095097 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:27.095071    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 20:30:27.095097 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:27.095092    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cfbf8c644-ghtcq: secret "image-registry-tls" not found
Jul 31 20:30:27.095281 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:27.095130    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls podName:c565a1e5-6a0d-4655-93ae-606d7f18049c nodeName:}" failed. No retries permitted until 2026-07-31 20:30:28.095111136 +0000 UTC m=+36.700405478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls") pod "dns-default-tsqzv" (UID: "c565a1e5-6a0d-4655-93ae-606d7f18049c") : secret "dns-default-metrics-tls" not found
Jul 31 20:30:27.095281 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:27.095156    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls podName:9b9948a1-099f-4f1c-98a1-99155b23bebe nodeName:}" failed. No retries permitted until 2026-07-31 20:30:28.095144013 +0000 UTC m=+36.700438358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls") pod "image-registry-5cfbf8c644-ghtcq" (UID: "9b9948a1-099f-4f1c-98a1-99155b23bebe") : secret "image-registry-tls" not found
Jul 31 20:30:27.095281 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:27.095207    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zbw4v\" (UID: \"d96baaf6-7e89-4c38-8824-92b2df6d14ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v"
Jul 31 20:30:27.095465 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:27.095293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:27.095465 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:27.095301    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 20:30:27.095465 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:27.095332    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls podName:d96baaf6-7e89-4c38-8824-92b2df6d14ef nodeName:}" failed. No retries permitted until 2026-07-31 20:30:28.095322027 +0000 UTC m=+36.700616368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-zbw4v" (UID: "d96baaf6-7e89-4c38-8824-92b2df6d14ef") : secret "samples-operator-tls" not found
Jul 31 20:30:27.095465 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:27.095364    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 20:30:27.095465 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:27.095410    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs podName:ff238e54-d1f3-4c02-87f1-857f3b510b84 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:28.095397649 +0000 UTC m=+36.700691992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs") pod "router-default-6bc9d75b56-fmv5h" (UID: "ff238e54-d1f3-4c02-87f1-857f3b510b84") : secret "router-metrics-certs-default" not found
Jul 31 20:30:27.910654 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:27.910617    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:27.914767 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:27.914371    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w6hmj\""
Jul 31 20:30:28.005142 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:28.004468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-sxw2g\" (UID: \"ed08f05d-1fb1-46a5-8c13-102bea748361\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"
Jul 31 20:30:28.005142 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:28.004715    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 31 20:30:28.005142 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:28.004796    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls podName:ed08f05d-1fb1-46a5-8c13-102bea748361 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:30.004776764 +0000 UTC m=+38.610071109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-sxw2g" (UID: "ed08f05d-1fb1-46a5-8c13-102bea748361") : secret "cluster-monitoring-operator-tls" not found
Jul 31 20:30:28.105194 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:28.104511    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vfbbm" event={"ID":"732589ca-b2a0-48d3-aa09-0ab535fb7d94","Type":"ContainerStarted","Data":"3e4b95dab78f16818a5ef021811d314c265c27d2464e24613a62784b1dd8c704"}
Jul 31 20:30:28.105347 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:28.105194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:28.105347 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:28.105257    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:28.105347 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:28.105301    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:28.105347 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:28.105333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls\") pod \"dns-default-tsqzv\" (UID: \"c565a1e5-6a0d-4655-93ae-606d7f18049c\") " pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:28.105572 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:28.105388    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zbw4v\" (UID: \"d96baaf6-7e89-4c38-8824-92b2df6d14ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v"
Jul 31 20:30:28.105572 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:28.105393    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 20:30:28.105572 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:28.105459    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs podName:ff238e54-d1f3-4c02-87f1-857f3b510b84 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:30.105437214 +0000 UTC m=+38.710731560 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs") pod "router-default-6bc9d75b56-fmv5h" (UID: "ff238e54-d1f3-4c02-87f1-857f3b510b84") : secret "router-metrics-certs-default" not found
Jul 31 20:30:28.105723 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:28.105588    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 20:30:28.105723 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:28.105638    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls podName:d96baaf6-7e89-4c38-8824-92b2df6d14ef nodeName:}" failed. No retries permitted until 2026-07-31 20:30:30.105621488 +0000 UTC m=+38.710915851 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-zbw4v" (UID: "d96baaf6-7e89-4c38-8824-92b2df6d14ef") : secret "samples-operator-tls" not found
Jul 31 20:30:28.105723 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:28.105716    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle podName:ff238e54-d1f3-4c02-87f1-857f3b510b84 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:30.105705569 +0000 UTC m=+38.710999923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle") pod "router-default-6bc9d75b56-fmv5h" (UID: "ff238e54-d1f3-4c02-87f1-857f3b510b84") : configmap references non-existent config key: service-ca.crt
Jul 31 20:30:28.105904 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:28.105811    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 20:30:28.105904 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:28.105823    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cfbf8c644-ghtcq: secret "image-registry-tls" not found
Jul 31 20:30:28.105904 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:28.105855    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls podName:9b9948a1-099f-4f1c-98a1-99155b23bebe nodeName:}" failed. No retries permitted until 2026-07-31 20:30:30.105844133 +0000 UTC m=+38.711138477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls") pod "image-registry-5cfbf8c644-ghtcq" (UID: "9b9948a1-099f-4f1c-98a1-99155b23bebe") : secret "image-registry-tls" not found
Jul 31 20:30:28.105904 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:28.105872    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 20:30:28.106124 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:28.105922    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls podName:c565a1e5-6a0d-4655-93ae-606d7f18049c nodeName:}" failed. No retries permitted until 2026-07-31 20:30:30.105908225 +0000 UTC m=+38.711202567 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls") pod "dns-default-tsqzv" (UID: "c565a1e5-6a0d-4655-93ae-606d7f18049c") : secret "dns-default-metrics-tls" not found
Jul 31 20:30:28.126609 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:28.126556    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vfbbm" podStartSLOduration=10.013183927 podStartE2EDuration="36.12653956s" totalImagesPullingTime="26.113355633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:28.12496621 +0000 UTC m=+36.730260576" watchObservedRunningTime="2026-07-31 20:30:28.12653956 +0000 UTC m=+36.731833922"
Jul 31 20:30:28.260866 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:28.260821    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:28.345530 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:28.345440    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:30.026390 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:30.026197    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-sxw2g\" (UID: \"ed08f05d-1fb1-46a5-8c13-102bea748361\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"
Jul 31 20:30:30.026900 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:30.026373    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 31 20:30:30.026900 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:30.026567    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls podName:ed08f05d-1fb1-46a5-8c13-102bea748361 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:34.026548857 +0000 UTC m=+42.631843198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-sxw2g" (UID: "ed08f05d-1fb1-46a5-8c13-102bea748361") : secret "cluster-monitoring-operator-tls" not found
Jul 31 20:30:30.115126 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:30.115079    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-t7lf9" event={"ID":"fa145089-9180-41ec-9e64-fad46e720174","Type":"ContainerStarted","Data":"69abb06f3e8106f84dd333a6ae1d149faab46685d333f18d270b432971051f48"}
Jul 31 20:30:30.127229 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:30.127193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:30.127396 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:30.127250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls\") pod \"dns-default-tsqzv\" (UID: \"c565a1e5-6a0d-4655-93ae-606d7f18049c\") " pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:30.127396 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:30.127316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zbw4v\" (UID: \"d96baaf6-7e89-4c38-8824-92b2df6d14ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v"
Jul 31 20:30:30.127497 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:30.127397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:30.127497 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:30.127452    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:30.127607 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:30.127583    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle podName:ff238e54-d1f3-4c02-87f1-857f3b510b84 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:34.127569118 +0000 UTC m=+42.732863459 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle") pod "router-default-6bc9d75b56-fmv5h" (UID: "ff238e54-d1f3-4c02-87f1-857f3b510b84") : configmap references non-existent config key: service-ca.crt
Jul 31 20:30:30.127848 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:30.127824    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 20:30:30.127964 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:30.127956    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 20:30:30.128021 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:30.127970    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cfbf8c644-ghtcq: secret "image-registry-tls" not found
Jul 31 20:30:30.128021 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:30.127985    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 20:30:30.128021 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:30.128016    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls podName:9b9948a1-099f-4f1c-98a1-99155b23bebe nodeName:}" failed. No retries permitted until 2026-07-31 20:30:34.128000185 +0000 UTC m=+42.733294541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls") pod "image-registry-5cfbf8c644-ghtcq" (UID: "9b9948a1-099f-4f1c-98a1-99155b23bebe") : secret "image-registry-tls" not found
Jul 31 20:30:30.128173 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:30.128037    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls podName:c565a1e5-6a0d-4655-93ae-606d7f18049c nodeName:}" failed. No retries permitted until 2026-07-31 20:30:34.128025993 +0000 UTC m=+42.733320333 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls") pod "dns-default-tsqzv" (UID: "c565a1e5-6a0d-4655-93ae-606d7f18049c") : secret "dns-default-metrics-tls" not found
Jul 31 20:30:30.128173 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:30.128061    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 20:30:30.128173 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:30.128104    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs podName:ff238e54-d1f3-4c02-87f1-857f3b510b84 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:34.128087668 +0000 UTC m=+42.733382014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs") pod "router-default-6bc9d75b56-fmv5h" (UID: "ff238e54-d1f3-4c02-87f1-857f3b510b84") : secret "router-metrics-certs-default" not found
Jul 31 20:30:30.128173 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:30.128122    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls podName:d96baaf6-7e89-4c38-8824-92b2df6d14ef nodeName:}" failed. No retries permitted until 2026-07-31 20:30:34.128113199 +0000 UTC m=+42.733407545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-zbw4v" (UID: "d96baaf6-7e89-4c38-8824-92b2df6d14ef") : secret "samples-operator-tls" not found
Jul 31 20:30:30.130565 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:30.130527    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-t7lf9" podStartSLOduration=21.991562292 podStartE2EDuration="24.130512688s" totalImagesPullingTime="2.138950396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:30.129462115 +0000 UTC m=+38.734756478" watchObservedRunningTime="2026-07-31 20:30:30.130512688 +0000 UTC m=+38.735807051"
Jul 31 20:30:30.200651 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:30.200618    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:31.359598 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:31.359556    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:31.414774 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:31.414722    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:34.062865 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:34.062819    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-sxw2g\" (UID: \"ed08f05d-1fb1-46a5-8c13-102bea748361\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"
Jul 31 20:30:34.063300 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:34.062944    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 31 20:30:34.063300 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:34.063016    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls podName:ed08f05d-1fb1-46a5-8c13-102bea748361 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:42.062997949 +0000 UTC m=+50.668292291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-sxw2g" (UID: "ed08f05d-1fb1-46a5-8c13-102bea748361") : secret "cluster-monitoring-operator-tls" not found
Jul 31 20:30:34.164012 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:34.163972    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:34.164203 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:34.164046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:34.164203 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:34.164081    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:34.164203 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:34.164108    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls\") pod \"dns-default-tsqzv\" (UID: \"c565a1e5-6a0d-4655-93ae-606d7f18049c\") " pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:34.164203 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:34.164162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zbw4v\" (UID: \"d96baaf6-7e89-4c38-8824-92b2df6d14ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v"
Jul 31 20:30:34.164384 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:34.164310    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 20:30:34.164384 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:34.164365    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls podName:d96baaf6-7e89-4c38-8824-92b2df6d14ef nodeName:}" failed. No retries permitted until 2026-07-31 20:30:42.16435049 +0000 UTC m=+50.769644831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-zbw4v" (UID: "d96baaf6-7e89-4c38-8824-92b2df6d14ef") : secret "samples-operator-tls" not found
Jul 31 20:30:34.165132 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:34.164790    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 20:30:34.165132 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:34.164848    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs podName:ff238e54-d1f3-4c02-87f1-857f3b510b84 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:42.164832904 +0000 UTC m=+50.770127247 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs") pod "router-default-6bc9d75b56-fmv5h" (UID: "ff238e54-d1f3-4c02-87f1-857f3b510b84") : secret "router-metrics-certs-default" not found
Jul 31 20:30:34.165132 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:34.164933    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle podName:ff238e54-d1f3-4c02-87f1-857f3b510b84 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:42.164922657 +0000 UTC m=+50.770217002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle") pod "router-default-6bc9d75b56-fmv5h" (UID: "ff238e54-d1f3-4c02-87f1-857f3b510b84") : configmap references non-existent config key: service-ca.crt
Jul 31 20:30:34.165132 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:34.165000    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 20:30:34.165132 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:34.165011    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cfbf8c644-ghtcq: secret "image-registry-tls" not found
Jul 31 20:30:34.165132 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:34.165042    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls podName:9b9948a1-099f-4f1c-98a1-99155b23bebe nodeName:}" failed. No retries permitted until 2026-07-31 20:30:42.165031984 +0000 UTC m=+50.770326337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls") pod "image-registry-5cfbf8c644-ghtcq" (UID: "9b9948a1-099f-4f1c-98a1-99155b23bebe") : secret "image-registry-tls" not found
Jul 31 20:30:34.165132 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:34.165087    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 20:30:34.165132 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:34.165108    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls podName:c565a1e5-6a0d-4655-93ae-606d7f18049c nodeName:}" failed. No retries permitted until 2026-07-31 20:30:42.165101574 +0000 UTC m=+50.770395915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls") pod "dns-default-tsqzv" (UID: "c565a1e5-6a0d-4655-93ae-606d7f18049c") : secret "dns-default-metrics-tls" not found
Jul 31 20:30:35.131670 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:35.131635    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-68khq" event={"ID":"b24a63c2-0cf8-478c-a622-869116d09329","Type":"ContainerStarted","Data":"f9c47955588aeacfb5cd1c15969ae119334c5549e211608fbda8262602fffb99"}
Jul 31 20:30:35.136088 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:35.136066    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/0.log"
Jul 31 20:30:35.136328 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:35.136107    2565 generic.go:356] "Generic (PLEG): container finished" podID="2cfe485d-9832-42d7-bf3f-03ee9f76fc84" containerID="00a4b5711caf15d7ed2ba504811ef72fd3aed9f63b3804fac349fa6859a9eba9" exitCode=255
Jul 31 20:30:35.136328 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:35.136201    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72" event={"ID":"2cfe485d-9832-42d7-bf3f-03ee9f76fc84","Type":"ContainerDied","Data":"00a4b5711caf15d7ed2ba504811ef72fd3aed9f63b3804fac349fa6859a9eba9"}
Jul 31 20:30:35.139000 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:35.138975    2565 scope.go:117] "RemoveContainer" containerID="00a4b5711caf15d7ed2ba504811ef72fd3aed9f63b3804fac349fa6859a9eba9"
Jul 31 20:30:35.149872 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:35.148115    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-68khq" podStartSLOduration=1.2251528010000001 podStartE2EDuration="9.148090218s" totalImagesPullingTime="7.922937417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:35.14550407 +0000 UTC m=+43.750798433" watchObservedRunningTime="2026-07-31 20:30:35.148090218 +0000 UTC m=+43.753384579"
Jul 31 20:30:35.149872 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:35.148181    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6" event={"ID":"85ab1ab6-5d3a-4173-8e9a-85ca012925fd","Type":"ContainerStarted","Data":"ff4daeb66d83c2037e847191b36ac7d442c379469436a34086e33a2d03a112c1"}
Jul 31 20:30:35.153834 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:35.153807    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5" event={"ID":"f405b67c-4d95-4880-8ad3-2915433fe139","Type":"ContainerStarted","Data":"09c26f512b2f01d40b9fc17bd8c20aaa28f09b4e973f14a900b967e60021c061"}
Jul 31 20:30:35.180124 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:35.179576    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5" podStartSLOduration=21.150564956 podStartE2EDuration="29.179554818s" totalImagesPullingTime="8.028989862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:35.178460606 +0000 UTC m=+43.783754982" watchObservedRunningTime="2026-07-31 20:30:35.179554818 +0000 UTC m=+43.784849175"
Jul 31 20:30:35.194018 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:35.193978    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6" podStartSLOduration=21.287689435 podStartE2EDuration="29.193962738s" totalImagesPullingTime="7.906273303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:35.193610096 +0000 UTC m=+43.798904458" watchObservedRunningTime="2026-07-31 20:30:35.193962738 +0000 UTC m=+43.799257078"
Jul 31 20:30:36.159163 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.159065    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-vfkvs" event={"ID":"d8329200-4000-4de4-8ef7-abf447f2e636","Type":"ContainerStarted","Data":"09fe3f898edd8ebaa1aae98343b40b4e54e6fc3480810890e3581a6187993929"}
Jul 31 20:30:36.161070 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.161043    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-wt4mx" event={"ID":"3cac8fa3-385e-4753-92de-de2489ad9a73","Type":"ContainerStarted","Data":"db556371dfd0b57a1408e029957bdd2f1aa0e781fe7ce854751020881e5960b7"}
Jul 31 20:30:36.162838 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.162812    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/1.log"
Jul 31 20:30:36.163244 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.163224    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/0.log"
Jul 31 20:30:36.163334 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.163265    2565 generic.go:356] "Generic (PLEG): container finished" podID="2cfe485d-9832-42d7-bf3f-03ee9f76fc84" containerID="661abc8bbfed6036b8718b79feb37907e786f2fa7a3c95947c87ce7355ab48e1" exitCode=255
Jul 31 20:30:36.163389 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.163342    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72" event={"ID":"2cfe485d-9832-42d7-bf3f-03ee9f76fc84","Type":"ContainerDied","Data":"661abc8bbfed6036b8718b79feb37907e786f2fa7a3c95947c87ce7355ab48e1"}
Jul 31 20:30:36.163389 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.163384    2565 scope.go:117] "RemoveContainer" containerID="00a4b5711caf15d7ed2ba504811ef72fd3aed9f63b3804fac349fa6859a9eba9"
Jul 31 20:30:36.163975 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.163674    2565 scope.go:117] "RemoveContainer" containerID="661abc8bbfed6036b8718b79feb37907e786f2fa7a3c95947c87ce7355ab48e1"
Jul 31 20:30:36.163975 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:36.163896    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-fmf72_openshift-console-operator(2cfe485d-9832-42d7-bf3f-03ee9f76fc84)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72" podUID="2cfe485d-9832-42d7-bf3f-03ee9f76fc84"
Jul 31 20:30:36.175852 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.175802    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-vfkvs" podStartSLOduration=22.245448635 podStartE2EDuration="30.175784242s" totalImagesPullingTime="7.930335607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:36.175312244 +0000 UTC m=+44.780606608" watchObservedRunningTime="2026-07-31 20:30:36.175784242 +0000 UTC m=+44.781078610"
Jul 31 20:30:36.188581 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.188535    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-wt4mx" podStartSLOduration=13.274097084 podStartE2EDuration="21.188518214s" totalImagesPullingTime="7.91442113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:36.188183455 +0000 UTC m=+44.793477799" watchObservedRunningTime="2026-07-31 20:30:36.188518214 +0000 UTC m=+44.793812590"
Jul 31 20:30:36.384090 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.384052    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:36.483703 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.483618    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:36.596952 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.596902    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:36.677240 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.677185    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ztzkk"]
Jul 31 20:30:36.679079 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.678986    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:36.702680 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.702642    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ztzkk"]
Jul 31 20:30:36.702861 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.702691    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:30:36.702861 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.702713    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:30:36.702861 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.702795    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:36.704656 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.704590    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 31 20:30:36.704656 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.704633    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cdl8z\""
Jul 31 20:30:36.704854 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.704591    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 31 20:30:36.742121 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.742057    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:36.790421 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.790391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:36.790556 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.790425    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-data-volume\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:36.790556 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.790510    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9h7w\" (UniqueName: \"kubernetes.io/projected/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-kube-api-access-v9h7w\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:36.790556 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.790533    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:36.790556 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.790551    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-crio-socket\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:36.865131 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.865096    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:36.891875 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.891837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-data-volume\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:36.892069 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.891956    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9h7w\" (UniqueName: \"kubernetes.io/projected/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-kube-api-access-v9h7w\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:36.892069 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.891989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:36.892069 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.892016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-crio-socket\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:36.892258 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:36.892136    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:36.892258 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.892177    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:36.892258 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:36.892218    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls podName:2ed7357c-b4e0-4cc7-a96c-5752b81bde53 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:37.392197328 +0000 UTC m=+45.997491683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ztzkk" (UID: "2ed7357c-b4e0-4cc7-a96c-5752b81bde53") : secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:36.892258 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.892238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-data-volume\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:36.892469 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:36.892262    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 20:30:36.892469 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:36.892315    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-kube-rbac-proxy-cm podName:2ed7357c-b4e0-4cc7-a96c-5752b81bde53 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:37.392298919 +0000 UTC m=+45.997593278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ztzkk" (UID: "2ed7357c-b4e0-4cc7-a96c-5752b81bde53") : configmap "kube-rbac-proxy" not found
Jul 31 20:30:36.892469 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.892431    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-crio-socket\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:36.901941 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.901910    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9h7w\" (UniqueName: \"kubernetes.io/projected/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-kube-api-access-v9h7w\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:36.952474 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:36.952433    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:37.052631 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:37.052538    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:37.105086 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:37.105046    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:37.169342 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:37.169316    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/1.log"
Jul 31 20:30:37.170667 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:37.170641    2565 scope.go:117] "RemoveContainer" containerID="661abc8bbfed6036b8718b79feb37907e786f2fa7a3c95947c87ce7355ab48e1"
Jul 31 20:30:37.171278 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:37.171231    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-fmf72_openshift-console-operator(2cfe485d-9832-42d7-bf3f-03ee9f76fc84)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72" podUID="2cfe485d-9832-42d7-bf3f-03ee9f76fc84"
Jul 31 20:30:37.300318 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:37.300250    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:37.397990 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:37.397899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:37.398148 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:37.398000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:37.398148 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:37.398024    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 20:30:37.398148 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:37.398089    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-kube-rbac-proxy-cm podName:2ed7357c-b4e0-4cc7-a96c-5752b81bde53 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:38.398071081 +0000 UTC m=+47.003365445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ztzkk" (UID: "2ed7357c-b4e0-4cc7-a96c-5752b81bde53") : configmap "kube-rbac-proxy" not found
Jul 31 20:30:37.398310 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:37.398148    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:37.398310 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:37.398211    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls podName:2ed7357c-b4e0-4cc7-a96c-5752b81bde53 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:38.398196983 +0000 UTC m=+47.003491357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ztzkk" (UID: "2ed7357c-b4e0-4cc7-a96c-5752b81bde53") : secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:37.400357 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:37.400332    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:38.049557 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:38.049530    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2xczz_bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f/dns-node-resolver/0.log"
Jul 31 20:30:38.174008 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:38.173981    2565 scope.go:117] "RemoveContainer" containerID="661abc8bbfed6036b8718b79feb37907e786f2fa7a3c95947c87ce7355ab48e1"
Jul 31 20:30:38.174464 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:38.174187    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-fmf72_openshift-console-operator(2cfe485d-9832-42d7-bf3f-03ee9f76fc84)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72" podUID="2cfe485d-9832-42d7-bf3f-03ee9f76fc84"
Jul 31 20:30:38.350575 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:38.350490    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:38.408458 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:38.408422    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:38.408647 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:38.408520    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:38.408647 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:38.408542    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 20:30:38.408647 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:38.408610    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-kube-rbac-proxy-cm podName:2ed7357c-b4e0-4cc7-a96c-5752b81bde53 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:40.408589549 +0000 UTC m=+49.013883903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ztzkk" (UID: "2ed7357c-b4e0-4cc7-a96c-5752b81bde53") : configmap "kube-rbac-proxy" not found
Jul 31 20:30:38.408811 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:38.408666    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:38.408811 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:38.408754    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls podName:2ed7357c-b4e0-4cc7-a96c-5752b81bde53 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:40.408713637 +0000 UTC m=+49.014007978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ztzkk" (UID: "2ed7357c-b4e0-4cc7-a96c-5752b81bde53") : secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:38.450975 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:38.450925    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:38.927157 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:38.927124    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:39.450702 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:39.450668    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ttm25_e0d719da-980c-4f82-8dbe-c0c416ce0a66/node-ca/0.log"
Jul 31 20:30:39.587175 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:39.587142    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:39.755945 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:39.755867    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:39.850613 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:39.850584    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-68khq_b24a63c2-0cf8-478c-a622-869116d09329/serve-healthcheck-canary/0.log"
Jul 31 20:30:40.426420 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:40.426381    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:40.426616 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:40.426478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:40.426616 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:40.426513    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 20:30:40.426616 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:40.426581    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-kube-rbac-proxy-cm podName:2ed7357c-b4e0-4cc7-a96c-5752b81bde53 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:44.426566156 +0000 UTC m=+53.031860497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ztzkk" (UID: "2ed7357c-b4e0-4cc7-a96c-5752b81bde53") : configmap "kube-rbac-proxy" not found
Jul 31 20:30:40.426785 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:40.426633    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:40.426785 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:40.426695    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls podName:2ed7357c-b4e0-4cc7-a96c-5752b81bde53 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:44.426683146 +0000 UTC m=+53.031977486 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ztzkk" (UID: "2ed7357c-b4e0-4cc7-a96c-5752b81bde53") : secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:41.821691 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:41.821658    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:41.880205 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:41.880164    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:42.141176 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:42.141091    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-sxw2g\" (UID: \"ed08f05d-1fb1-46a5-8c13-102bea748361\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"
Jul 31 20:30:42.141326 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:42.141243    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 31 20:30:42.141326 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:42.141310    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls podName:ed08f05d-1fb1-46a5-8c13-102bea748361 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:58.141291542 +0000 UTC m=+66.746585886 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-sxw2g" (UID: "ed08f05d-1fb1-46a5-8c13-102bea748361") : secret "cluster-monitoring-operator-tls" not found
Jul 31 20:30:42.241639 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:42.241606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:42.241857 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:42.241666    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:42.241857 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:42.241708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:42.241857 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:42.241756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls\") pod \"dns-default-tsqzv\" (UID: \"c565a1e5-6a0d-4655-93ae-606d7f18049c\") " pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:42.241857 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:42.241781    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 20:30:42.241857 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:42.241836    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 20:30:42.241857 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:42.241852    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle podName:ff238e54-d1f3-4c02-87f1-857f3b510b84 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:58.241835663 +0000 UTC m=+66.847130003 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle") pod "router-default-6bc9d75b56-fmv5h" (UID: "ff238e54-d1f3-4c02-87f1-857f3b510b84") : configmap references non-existent config key: service-ca.crt
Jul 31 20:30:42.241857 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:42.241858    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cfbf8c644-ghtcq: secret "image-registry-tls" not found
Jul 31 20:30:42.242169 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:42.241877    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 20:30:42.242169 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:42.241883    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs podName:ff238e54-d1f3-4c02-87f1-857f3b510b84 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:58.241867167 +0000 UTC m=+66.847161528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs") pod "router-default-6bc9d75b56-fmv5h" (UID: "ff238e54-d1f3-4c02-87f1-857f3b510b84") : secret "router-metrics-certs-default" not found
Jul 31 20:30:42.242169 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:42.241814    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zbw4v\" (UID: \"d96baaf6-7e89-4c38-8824-92b2df6d14ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v"
Jul 31 20:30:42.242169 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:42.241916    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls podName:9b9948a1-099f-4f1c-98a1-99155b23bebe nodeName:}" failed. No retries permitted until 2026-07-31 20:30:58.241902919 +0000 UTC m=+66.847197274 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls") pod "image-registry-5cfbf8c644-ghtcq" (UID: "9b9948a1-099f-4f1c-98a1-99155b23bebe") : secret "image-registry-tls" not found
Jul 31 20:30:42.242169 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:42.241940    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls podName:d96baaf6-7e89-4c38-8824-92b2df6d14ef nodeName:}" failed. No retries permitted until 2026-07-31 20:30:58.241930944 +0000 UTC m=+66.847225336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-zbw4v" (UID: "d96baaf6-7e89-4c38-8824-92b2df6d14ef") : secret "samples-operator-tls" not found
Jul 31 20:30:42.242169 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:42.241950    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 20:30:42.242169 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:42.242036    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls podName:c565a1e5-6a0d-4655-93ae-606d7f18049c nodeName:}" failed. No retries permitted until 2026-07-31 20:30:58.24200645 +0000 UTC m=+66.847300808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls") pod "dns-default-tsqzv" (UID: "c565a1e5-6a0d-4655-93ae-606d7f18049c") : secret "dns-default-metrics-tls" not found
Jul 31 20:30:42.280257 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:42.280232    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:42.605327 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:42.605296    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:42.706974 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:42.706941    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:43.010025 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:43.009991    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:43.113377 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:43.113342    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:43.795400 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:43.795364    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:44.197951 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:44.197922    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:44.461848 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:44.461758    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:44.461848 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:44.461836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:44.462043 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:44.461946    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:44.462043 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:44.462005    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls podName:2ed7357c-b4e0-4cc7-a96c-5752b81bde53 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:52.461988933 +0000 UTC m=+61.067283277 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ztzkk" (UID: "2ed7357c-b4e0-4cc7-a96c-5752b81bde53") : secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:44.462295 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:44.462273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:44.593693 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:44.593660    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:44.994643 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:44.994613    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:45.318087 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:45.318011    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:45.392927 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:45.392891    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:45.597629 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:45.597542    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:45.790505 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:45.790467    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:45.891074 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:45.891001    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:46.299984 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:46.299950    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:46.595905 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:46.595825    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:46.992099 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:46.992068    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:47.092879 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:47.092846    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:47.394455 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:47.394374    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:47.788062 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:47.788030    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:47.842003 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:47.841968    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:47.991597 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:47.991558    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:48.591379 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:48.591338    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:48.789879 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:48.789849    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:48.989564 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:48.989530    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:50.108670 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:50.108626    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:50.209787 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:50.209752    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:50.395528 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:50.395444    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:50.591011 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:50.590981    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:50.790421 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:50.790388    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:51.014865 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:51.014835    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:51.911330 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:51.911302    2565 scope.go:117] "RemoveContainer" containerID="661abc8bbfed6036b8718b79feb37907e786f2fa7a3c95947c87ce7355ab48e1"
Jul 31 20:30:51.992697 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:51.992656    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:52.077854 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:52.077820    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zf99r"
Jul 31 20:30:52.217894 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:52.217872    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 20:30:52.218279 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:52.218264    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/1.log"
Jul 31 20:30:52.218338 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:52.218301    2565 generic.go:356] "Generic (PLEG): container finished" podID="2cfe485d-9832-42d7-bf3f-03ee9f76fc84" containerID="0070843edc1551f76957e229e07e8d336ffb8d3fb92432d50db7a49cac35d91e" exitCode=255
Jul 31 20:30:52.218378 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:52.218357    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72" event={"ID":"2cfe485d-9832-42d7-bf3f-03ee9f76fc84","Type":"ContainerDied","Data":"0070843edc1551f76957e229e07e8d336ffb8d3fb92432d50db7a49cac35d91e"}
Jul 31 20:30:52.218427 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:52.218413    2565 scope.go:117] "RemoveContainer" containerID="661abc8bbfed6036b8718b79feb37907e786f2fa7a3c95947c87ce7355ab48e1"
Jul 31 20:30:52.218769 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:52.218724    2565 scope.go:117] "RemoveContainer" containerID="0070843edc1551f76957e229e07e8d336ffb8d3fb92432d50db7a49cac35d91e"
Jul 31 20:30:52.218951 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:52.218934    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-fmf72_openshift-console-operator(2cfe485d-9832-42d7-bf3f-03ee9f76fc84)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72" podUID="2cfe485d-9832-42d7-bf3f-03ee9f76fc84"
Jul 31 20:30:52.392906 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:52.392874    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:52.529799 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:52.529712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:30:52.529938 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:52.529878    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:52.529976 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:52.529937    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls podName:2ed7357c-b4e0-4cc7-a96c-5752b81bde53 nodeName:}" failed. No retries permitted until 2026-07-31 20:31:08.52992219 +0000 UTC m=+77.135216534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ztzkk" (UID: "2ed7357c-b4e0-4cc7-a96c-5752b81bde53") : secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:52.589981 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:52.589951    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:52.805297 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:52.805216    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:53.194114 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:53.194083    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:53.223059 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:53.223033    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 20:30:53.392879 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:53.392846    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:56.677403 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:56.677367    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:30:56.677833 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:56.677425    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:30:56.677833 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:56.677752    2565 scope.go:117] "RemoveContainer" containerID="0070843edc1551f76957e229e07e8d336ffb8d3fb92432d50db7a49cac35d91e"
Jul 31 20:30:56.677931 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:30:56.677911    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-fmf72_openshift-console-operator(2cfe485d-9832-42d7-bf3f-03ee9f76fc84)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72" podUID="2cfe485d-9832-42d7-bf3f-03ee9f76fc84"
Jul 31 20:30:56.818580 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:56.818545    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:56.871969 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:56.871921    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:57.574605 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:57.574563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs\") pod \"network-metrics-daemon-dqzzx\" (UID: \"78163815-3577-406a-ba59-f7e6784b6377\") " pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:57.576696 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:57.576677    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 20:30:57.587471 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:57.587448    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78163815-3577-406a-ba59-f7e6784b6377-metrics-certs\") pod \"network-metrics-daemon-dqzzx\" (UID: \"78163815-3577-406a-ba59-f7e6784b6377\") " pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:57.675157 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:57.675124    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret\") pod \"global-pull-secret-syncer-h7klt\" (UID: \"d6c4d228-4d34-47bd-9881-60e38a8a56e3\") " pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:57.676956 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:57.676941    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 20:30:57.688583 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:57.688554    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d6c4d228-4d34-47bd-9881-60e38a8a56e3-original-pull-secret\") pod \"global-pull-secret-syncer-h7klt\" (UID: \"d6c4d228-4d34-47bd-9881-60e38a8a56e3\") " pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:57.775822 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:57.775788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t4hv\" (UniqueName: \"kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv\") pod \"network-check-target-nbhtt\" (UID: \"184c96b5-fe65-47a8-a9d1-a0d590bd1765\") " pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:57.778397 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:57.778376    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t4hv\" (UniqueName: \"kubernetes.io/projected/184c96b5-fe65-47a8-a9d1-a0d590bd1765-kube-api-access-8t4hv\") pod \"network-check-target-nbhtt\" (UID: \"184c96b5-fe65-47a8-a9d1-a0d590bd1765\") " pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:57.834636 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:57.834558    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9lfhf\""
Jul 31 20:30:57.843094 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:57.843071    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dqzzx"
Jul 31 20:30:57.843213 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:57.843099    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7klt"
Jul 31 20:30:57.927111 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:57.927082    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w6hmj\""
Jul 31 20:30:57.936238 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:57.936021    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:58.016417 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.016390    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dqzzx"]
Jul 31 20:30:58.021097 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:30:58.021066    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78163815_3577_406a_ba59_f7e6784b6377.slice/crio-16a7e4a697620f5527aaa10828601dffaf2ae07216020750dd9b556aba057dab WatchSource:0}: Error finding container 16a7e4a697620f5527aaa10828601dffaf2ae07216020750dd9b556aba057dab: Status 404 returned error can't find the container with id 16a7e4a697620f5527aaa10828601dffaf2ae07216020750dd9b556aba057dab
Jul 31 20:30:58.038092 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.038067    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h7klt"]
Jul 31 20:30:58.041556 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:30:58.041533    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6c4d228_4d34_47bd_9881_60e38a8a56e3.slice/crio-e16ce48ab6798a24579931d5bd5e831c93c0d8cbadd6235fcf96bb82f74b508c WatchSource:0}: Error finding container e16ce48ab6798a24579931d5bd5e831c93c0d8cbadd6235fcf96bb82f74b508c: Status 404 returned error can't find the container with id e16ce48ab6798a24579931d5bd5e831c93c0d8cbadd6235fcf96bb82f74b508c
Jul 31 20:30:58.094485 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.094409    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nbhtt"]
Jul 31 20:30:58.097472 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:30:58.097443    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184c96b5_fe65_47a8_a9d1_a0d590bd1765.slice/crio-f81640c5862ff406e3d9aa948a09ca29fad7a01c590e93e081d5639012b2371d WatchSource:0}: Error finding container f81640c5862ff406e3d9aa948a09ca29fad7a01c590e93e081d5639012b2371d: Status 404 returned error can't find the container with id f81640c5862ff406e3d9aa948a09ca29fad7a01c590e93e081d5639012b2371d
Jul 31 20:30:58.180229 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.180202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-sxw2g\" (UID: \"ed08f05d-1fb1-46a5-8c13-102bea748361\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"
Jul 31 20:30:58.182705 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.182680    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed08f05d-1fb1-46a5-8c13-102bea748361-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-sxw2g\" (UID: \"ed08f05d-1fb1-46a5-8c13-102bea748361\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"
Jul 31 20:30:58.240992 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.240955    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nbhtt" event={"ID":"184c96b5-fe65-47a8-a9d1-a0d590bd1765","Type":"ContainerStarted","Data":"09ec0cbe881c6958c6def18874db4cedd8e61ab03c24c5cfe97415efd2dc5957"}
Jul 31 20:30:58.241134 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.241005    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nbhtt" event={"ID":"184c96b5-fe65-47a8-a9d1-a0d590bd1765","Type":"ContainerStarted","Data":"f81640c5862ff406e3d9aa948a09ca29fad7a01c590e93e081d5639012b2371d"}
Jul 31 20:30:58.241134 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.241064    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:30:58.242193 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.242173    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h7klt" event={"ID":"d6c4d228-4d34-47bd-9881-60e38a8a56e3","Type":"ContainerStarted","Data":"e16ce48ab6798a24579931d5bd5e831c93c0d8cbadd6235fcf96bb82f74b508c"}
Jul 31 20:30:58.243459 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.243436    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dqzzx" event={"ID":"78163815-3577-406a-ba59-f7e6784b6377","Type":"ContainerStarted","Data":"16a7e4a697620f5527aaa10828601dffaf2ae07216020750dd9b556aba057dab"}
Jul 31 20:30:58.253534 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.253493    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nbhtt" podStartSLOduration=65.253480385 podStartE2EDuration="1m5.253480385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:29:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:58.253022614 +0000 UTC m=+66.858316979" watchObservedRunningTime="2026-07-31 20:30:58.253480385 +0000 UTC m=+66.858774747"
Jul 31 20:30:58.281360 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.281337    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:58.281434 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.281386    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:58.281434 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.281421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:58.281525 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.281450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls\") pod \"dns-default-tsqzv\" (UID: \"c565a1e5-6a0d-4655-93ae-606d7f18049c\") " pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:58.281525 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.281494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zbw4v\" (UID: \"d96baaf6-7e89-4c38-8824-92b2df6d14ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v"
Jul 31 20:30:58.282460 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.282422    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff238e54-d1f3-4c02-87f1-857f3b510b84-service-ca-bundle\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:58.284012 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.283987    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c565a1e5-6a0d-4655-93ae-606d7f18049c-metrics-tls\") pod \"dns-default-tsqzv\" (UID: \"c565a1e5-6a0d-4655-93ae-606d7f18049c\") " pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:58.284099 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.283989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff238e54-d1f3-4c02-87f1-857f3b510b84-metrics-certs\") pod \"router-default-6bc9d75b56-fmv5h\" (UID: \"ff238e54-d1f3-4c02-87f1-857f3b510b84\") " pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:58.284099 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.284050    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d96baaf6-7e89-4c38-8824-92b2df6d14ef-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zbw4v\" (UID: \"d96baaf6-7e89-4c38-8824-92b2df6d14ef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v"
Jul 31 20:30:58.284099 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.284059    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls\") pod \"image-registry-5cfbf8c644-ghtcq\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") " pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:58.421584 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.421508    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ks9k7\""
Jul 31 20:30:58.429529 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.429499    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2j4vz\""
Jul 31 20:30:58.429671 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.429557    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"
Jul 31 20:30:58.438994 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.438966    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:58.441698 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.441682    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wfcpd\""
Jul 31 20:30:58.450346 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.450324    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:58.470563 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.470546    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4mkrf\""
Jul 31 20:30:58.479714 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.479695    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v"
Jul 31 20:30:58.501527 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.501284    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w7w5c\""
Jul 31 20:30:58.510313 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.510211    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:30:58.617628 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.617477    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g"]
Jul 31 20:30:58.665044 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:30:58.664569    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b9948a1_099f_4f1c_98a1_99155b23bebe.slice/crio-4a9dcd3e839aec9cf963fb39a5a6175f94370d05c0940b1617731972bb650043 WatchSource:0}: Error finding container 4a9dcd3e839aec9cf963fb39a5a6175f94370d05c0940b1617731972bb650043: Status 404 returned error can't find the container with id 4a9dcd3e839aec9cf963fb39a5a6175f94370d05c0940b1617731972bb650043
Jul 31 20:30:58.666815 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.666719    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cfbf8c644-ghtcq"]
Jul 31 20:30:58.693136 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.693066    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v"]
Jul 31 20:30:58.705253 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.703982    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n"]
Jul 31 20:30:58.710235 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.710214    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n"
Jul 31 20:30:58.714748 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.714710    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 31 20:30:58.715260 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.715241    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 31 20:30:58.719494 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.715881    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 31 20:30:58.719494 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.716421    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 31 20:30:58.728668 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.728646    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n"]
Jul 31 20:30:58.735465 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.735445    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bc9d75b56-fmv5h"]
Jul 31 20:30:58.750986 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.750927    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tsqzv"]
Jul 31 20:30:58.785495 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.785470    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0fb23bce-a961-4087-968a-66320f751819-klusterlet-config\") pod \"klusterlet-addon-workmgr-66f46668fd-wlp7n\" (UID: \"0fb23bce-a961-4087-968a-66320f751819\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n"
Jul 31 20:30:58.785609 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.785563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnml6\" (UniqueName: \"kubernetes.io/projected/0fb23bce-a961-4087-968a-66320f751819-kube-api-access-cnml6\") pod \"klusterlet-addon-workmgr-66f46668fd-wlp7n\" (UID: \"0fb23bce-a961-4087-968a-66320f751819\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n"
Jul 31 20:30:58.785668 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.785608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fb23bce-a961-4087-968a-66320f751819-tmp\") pod \"klusterlet-addon-workmgr-66f46668fd-wlp7n\" (UID: \"0fb23bce-a961-4087-968a-66320f751819\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n"
Jul 31 20:30:58.886355 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.886317    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fb23bce-a961-4087-968a-66320f751819-tmp\") pod \"klusterlet-addon-workmgr-66f46668fd-wlp7n\" (UID: \"0fb23bce-a961-4087-968a-66320f751819\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n"
Jul 31 20:30:58.886509 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.886386    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0fb23bce-a961-4087-968a-66320f751819-klusterlet-config\") pod \"klusterlet-addon-workmgr-66f46668fd-wlp7n\" (UID: \"0fb23bce-a961-4087-968a-66320f751819\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n"
Jul 31 20:30:58.886552 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.886514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnml6\" (UniqueName: \"kubernetes.io/projected/0fb23bce-a961-4087-968a-66320f751819-kube-api-access-cnml6\") pod \"klusterlet-addon-workmgr-66f46668fd-wlp7n\" (UID: \"0fb23bce-a961-4087-968a-66320f751819\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n"
Jul 31 20:30:58.886801 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.886776    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fb23bce-a961-4087-968a-66320f751819-tmp\") pod \"klusterlet-addon-workmgr-66f46668fd-wlp7n\" (UID: \"0fb23bce-a961-4087-968a-66320f751819\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n"
Jul 31 20:30:58.889428 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.889378    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0fb23bce-a961-4087-968a-66320f751819-klusterlet-config\") pod \"klusterlet-addon-workmgr-66f46668fd-wlp7n\" (UID: \"0fb23bce-a961-4087-968a-66320f751819\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n"
Jul 31 20:30:58.899257 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:58.899236    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnml6\" (UniqueName: \"kubernetes.io/projected/0fb23bce-a961-4087-968a-66320f751819-kube-api-access-cnml6\") pod \"klusterlet-addon-workmgr-66f46668fd-wlp7n\" (UID: \"0fb23bce-a961-4087-968a-66320f751819\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n"
Jul 31 20:30:59.038207 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:59.037940    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n"
Jul 31 20:30:59.039314 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:59.039283    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:59.135291 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:59.135217    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:59.215383 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:59.215352    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n"]
Jul 31 20:30:59.218799 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:59.218704    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:30:59.252283 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:59.252169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bc9d75b56-fmv5h" event={"ID":"ff238e54-d1f3-4c02-87f1-857f3b510b84","Type":"ContainerStarted","Data":"5fcee8c13184c58561ecff819cc56d14599f4e6f7b8891794559a7b02b030ff0"}
Jul 31 20:30:59.252283 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:59.252238    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bc9d75b56-fmv5h" event={"ID":"ff238e54-d1f3-4c02-87f1-857f3b510b84","Type":"ContainerStarted","Data":"f1f108e574f607a3310be8047409d8dc2822484c0e86e2799a0802dfc16c1559"}
Jul 31 20:30:59.253695 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:59.253663    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tsqzv" event={"ID":"c565a1e5-6a0d-4655-93ae-606d7f18049c","Type":"ContainerStarted","Data":"2ef6b787779782deb3f67cbf1f7a49f8fc203fb4e0b2cf132d67af67dfd5e0af"}
Jul 31 20:30:59.255702 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:59.255673    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v" event={"ID":"d96baaf6-7e89-4c38-8824-92b2df6d14ef","Type":"ContainerStarted","Data":"fec32c8a3ff1a0571740f878c73152335b60913bd1062ad7918dc79f59fbd017"}
Jul 31 20:30:59.259810 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:59.259184    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq" event={"ID":"9b9948a1-099f-4f1c-98a1-99155b23bebe","Type":"ContainerStarted","Data":"085847f9333fbd4f9c2e57b1b705d8e0da72cbd6680ff680b668adc08009cf01"}
Jul 31 20:30:59.259810 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:59.259222    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq" event={"ID":"9b9948a1-099f-4f1c-98a1-99155b23bebe","Type":"ContainerStarted","Data":"4a9dcd3e839aec9cf963fb39a5a6175f94370d05c0940b1617731972bb650043"}
Jul 31 20:30:59.259810 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:59.259768    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:30:59.261808 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:59.261759    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g" event={"ID":"ed08f05d-1fb1-46a5-8c13-102bea748361","Type":"ContainerStarted","Data":"5937f0863ed8b86065dd266ec23a8e5a708d00c48954b9f4edd0e8bcdfdddd2f"}
Jul 31 20:30:59.269860 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:59.269817    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6bc9d75b56-fmv5h" podStartSLOduration=63.269804123 podStartE2EDuration="1m3.269804123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:29:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:59.269492786 +0000 UTC m=+67.874787151" watchObservedRunningTime="2026-07-31 20:30:59.269804123 +0000 UTC m=+67.875098486"
Jul 31 20:30:59.289611 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:59.289514    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq" podStartSLOduration=66.289496056 podStartE2EDuration="1m6.289496056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:29:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:59.288868085 +0000 UTC m=+67.894162448" watchObservedRunningTime="2026-07-31 20:30:59.289496056 +0000 UTC m=+67.894790417"
Jul 31 20:30:59.346707 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:30:59.346676    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fb23bce_a961_4087_968a_66320f751819.slice/crio-e7373058c3aaec45fc7cae6882dfe28394f555451df89c633b311d597ade30fd WatchSource:0}: Error finding container e7373058c3aaec45fc7cae6882dfe28394f555451df89c633b311d597ade30fd: Status 404 returned error can't find the container with id e7373058c3aaec45fc7cae6882dfe28394f555451df89c633b311d597ade30fd
Jul 31 20:30:59.450983 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:59.450695    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:30:59.453694 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:30:59.453674    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:31:00.268283 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:00.268199    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n" event={"ID":"0fb23bce-a961-4087-968a-66320f751819","Type":"ContainerStarted","Data":"e7373058c3aaec45fc7cae6882dfe28394f555451df89c633b311d597ade30fd"}
Jul 31 20:31:00.273502 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:00.273462    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dqzzx" event={"ID":"78163815-3577-406a-ba59-f7e6784b6377","Type":"ContainerStarted","Data":"804d3ecce2302e33ecc077e9573ebc3f2dd0c2bd9f198376e25b244f0bb7887f"}
Jul 31 20:31:00.273645 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:00.273513    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dqzzx" event={"ID":"78163815-3577-406a-ba59-f7e6784b6377","Type":"ContainerStarted","Data":"167c0c972ab4baa4fa2d8ee523f96da62ac438d9f085384170e2d452092d0982"}
Jul 31 20:31:00.273645 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:00.273545    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:31:00.275298 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:00.275273    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6bc9d75b56-fmv5h"
Jul 31 20:31:00.287503 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:00.287447    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dqzzx" podStartSLOduration=66.940995155 podStartE2EDuration="1m8.287429023s" totalImagesPullingTime="1.346433868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:00.286685653 +0000 UTC m=+68.891980016" watchObservedRunningTime="2026-07-31 20:31:00.287429023 +0000 UTC m=+68.892723387"
Jul 31 20:31:00.405000 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:00.404958    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:00.462219 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:00.462124    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:01.489644 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:01.489574    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:01.541660 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:01.541621    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:05.151287 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:05.151250    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:05.205535 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:05.205494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:05.521424 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:05.521394    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:05.621091 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:05.621056    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:06.535231 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:06.532063    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:06.627986 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:06.627914    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:06.898672 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:06.898592    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:07.054088 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:07.054048    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:07.301791 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:07.301756    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tsqzv" event={"ID":"c565a1e5-6a0d-4655-93ae-606d7f18049c","Type":"ContainerStarted","Data":"85a61cd739063d46ee88f901ec725b910c78a43589a41c42bb48d88dc77e6646"}
Jul 31 20:31:07.301971 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:07.301843    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tsqzv" event={"ID":"c565a1e5-6a0d-4655-93ae-606d7f18049c","Type":"ContainerStarted","Data":"abc42376fa19632f6c4c79c9816aab169534bd27fc37b1085bba33cfa87ba993"}
Jul 31 20:31:07.301971 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:07.301892    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:31:07.303617 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:07.303588    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v" event={"ID":"d96baaf6-7e89-4c38-8824-92b2df6d14ef","Type":"ContainerStarted","Data":"29f8b1cc2a9b5dfdd17786d37399d0e15dd90b8cc92ea30337902e205b1b84c9"}
Jul 31 20:31:07.303762 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:07.303639    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v" event={"ID":"d96baaf6-7e89-4c38-8824-92b2df6d14ef","Type":"ContainerStarted","Data":"ba28bd44432eb63302432ad6277dc15ef857e998df2968ce274819f91a159c11"}
Jul 31 20:31:07.305213 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:07.305193    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g" event={"ID":"ed08f05d-1fb1-46a5-8c13-102bea748361","Type":"ContainerStarted","Data":"1e0f5c31e36ca1dbb55b4224f4723fa4d2fe29454420b071a2d853ebf930ed29"}
Jul 31 20:31:07.306644 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:07.306624    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n" event={"ID":"0fb23bce-a961-4087-968a-66320f751819","Type":"ContainerStarted","Data":"d593c1fd718923e4871e81f865ad2595c68f7c23327224f282fa222f015b7fc0"}
Jul 31 20:31:07.306769 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:07.306666    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n"
Jul 31 20:31:07.308200 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:07.308169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h7klt" event={"ID":"d6c4d228-4d34-47bd-9881-60e38a8a56e3","Type":"ContainerStarted","Data":"5eebf7b1b78a26188673e01bab7eae253b90d2ea7208d305b56311680b4f63ce"}
Jul 31 20:31:07.308824 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:07.308808    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n"
Jul 31 20:31:07.318387 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:07.317798    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tsqzv" podStartSLOduration=33.707606943 podStartE2EDuration="41.317781083s" totalImagesPullingTime="7.61017414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:07.316774359 +0000 UTC m=+75.922068722" watchObservedRunningTime="2026-07-31 20:31:07.317781083 +0000 UTC m=+75.923075447"
Jul 31 20:31:07.358781 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:07.358651    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbw4v" podStartSLOduration=53.764270587 podStartE2EDuration="1m1.358633384s" totalImagesPullingTime="7.594362797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:07.358442056 +0000 UTC m=+75.963736421" watchObservedRunningTime="2026-07-31 20:31:07.358633384 +0000 UTC m=+75.963927748"
Jul 31 20:31:07.359470 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:07.359437    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h7klt" podStartSLOduration=67.020121146 podStartE2EDuration="1m15.359428155s" totalImagesPullingTime="8.339307009s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:07.339222482 +0000 UTC m=+75.944516836" watchObservedRunningTime="2026-07-31 20:31:07.359428155 +0000 UTC m=+75.964722517"
Jul 31 20:31:07.371262 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:07.371218    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-sxw2g" podStartSLOduration=63.631958944 podStartE2EDuration="1m11.371204215s" totalImagesPullingTime="7.739245271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:07.37058979 +0000 UTC m=+75.975884165" watchObservedRunningTime="2026-07-31 20:31:07.371204215 +0000 UTC m=+75.976498627"
Jul 31 20:31:07.387384 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:07.387330    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f46668fd-wlp7n" podStartSLOduration=2.367325049 podStartE2EDuration="9.38731219s" totalImagesPullingTime="7.019987141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:07.386542878 +0000 UTC m=+75.991837242" watchObservedRunningTime="2026-07-31 20:31:07.38731219 +0000 UTC m=+75.992606554"
Jul 31 20:31:07.641615 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:07.641530    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:07.909660 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:07.909577    2565 scope.go:117] "RemoveContainer" containerID="0070843edc1551f76957e229e07e8d336ffb8d3fb92432d50db7a49cac35d91e"
Jul 31 20:31:07.909861 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:31:07.909728    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-fmf72_openshift-console-operator(2cfe485d-9832-42d7-bf3f-03ee9f76fc84)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72" podUID="2cfe485d-9832-42d7-bf3f-03ee9f76fc84"
Jul 31 20:31:08.570789 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:08.570752    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:31:08.573151 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:08.573131    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ed7357c-b4e0-4cc7-a96c-5752b81bde53-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ztzkk\" (UID: \"2ed7357c-b4e0-4cc7-a96c-5752b81bde53\") " pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:31:08.813978 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:08.813942    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cdl8z\""
Jul 31 20:31:08.822783 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:08.822689    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ztzkk"
Jul 31 20:31:08.979414 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:08.979379    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ztzkk"]
Jul 31 20:31:08.983549 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:31:08.983520    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed7357c_b4e0_4cc7_a96c_5752b81bde53.slice/crio-14cf03e75580d5bbfd72d2b14786d6093f04a681cdf0e374dfabde5cc0f7c441 WatchSource:0}: Error finding container 14cf03e75580d5bbfd72d2b14786d6093f04a681cdf0e374dfabde5cc0f7c441: Status 404 returned error can't find the container with id 14cf03e75580d5bbfd72d2b14786d6093f04a681cdf0e374dfabde5cc0f7c441
Jul 31 20:31:09.316261 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:09.316226    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ztzkk" event={"ID":"2ed7357c-b4e0-4cc7-a96c-5752b81bde53","Type":"ContainerStarted","Data":"7bdb611eb8f7c53c7ec177098240b657d78c0ac4e04681be414fe77e02f622e8"}
Jul 31 20:31:09.316419 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:09.316307    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ztzkk" event={"ID":"2ed7357c-b4e0-4cc7-a96c-5752b81bde53","Type":"ContainerStarted","Data":"14cf03e75580d5bbfd72d2b14786d6093f04a681cdf0e374dfabde5cc0f7c441"}
Jul 31 20:31:09.404758 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:09.404659    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:09.975967 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:09.975932    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:10.028691 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:10.028652    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:10.321712 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:10.321633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ztzkk" event={"ID":"2ed7357c-b4e0-4cc7-a96c-5752b81bde53","Type":"ContainerStarted","Data":"33f4ac5739509a5fd5adba8e49df2ae83d98423ecd77523fda2285c3bebc422a"}
Jul 31 20:31:11.818468 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:11.818347    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:11.874221 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:11.874137    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:12.083354 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:12.083323    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:12.154801 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:12.154711    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:12.332059 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:12.332027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ztzkk" event={"ID":"2ed7357c-b4e0-4cc7-a96c-5752b81bde53","Type":"ContainerStarted","Data":"5429b99dcc8f3ef0da20888d34442f1045a6a39805889700decb7f4595f1c3dc"}
Jul 31 20:31:12.348231 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:12.348172    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ztzkk" podStartSLOduration=33.983155271 podStartE2EDuration="36.348155941s" totalImagesPullingTime="2.36500067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:30:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:12.347017693 +0000 UTC m=+80.952312069" watchObservedRunningTime="2026-07-31 20:31:12.348155941 +0000 UTC m=+80.953450304"
Jul 31 20:31:12.953914 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:12.953778    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:15.958444 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:15.958407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:17.153627 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:17.153595    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:17.314020 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:17.313992    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tsqzv"
Jul 31 20:31:17.322382 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:17.322356    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:18.335887 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.335848    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:18.443631 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.443604    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:18.476947 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.476913    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p2hlc"]
Jul 31 20:31:18.481928 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.481897    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.484049 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.484027    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mbphr\""
Jul 31 20:31:18.484425 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.484408    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 31 20:31:18.484649 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.484633    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 31 20:31:18.484697 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.484661    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 31 20:31:18.484697 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.484665    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 31 20:31:18.538523 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.538470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:18.543818 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.543788    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/079fc084-28ef-4ae5-a5a8-8854662e29ff-root\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.543952 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.543826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/079fc084-28ef-4ae5-a5a8-8854662e29ff-node-exporter-textfile\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.543952 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.543860    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/079fc084-28ef-4ae5-a5a8-8854662e29ff-node-exporter-tls\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.543952 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.543887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/079fc084-28ef-4ae5-a5a8-8854662e29ff-node-exporter-accelerators-collector-config\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.543952 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.543914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/079fc084-28ef-4ae5-a5a8-8854662e29ff-sys\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.543952 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.543927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/079fc084-28ef-4ae5-a5a8-8854662e29ff-metrics-client-ca\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.543952 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.543943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/079fc084-28ef-4ae5-a5a8-8854662e29ff-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.544169 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.543980    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/079fc084-28ef-4ae5-a5a8-8854662e29ff-node-exporter-wtmp\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.544169 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.544009    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwgpj\" (UniqueName: \"kubernetes.io/projected/079fc084-28ef-4ae5-a5a8-8854662e29ff-kube-api-access-mwgpj\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.607486 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.607406    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:18.644749 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.644713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/079fc084-28ef-4ae5-a5a8-8854662e29ff-sys\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.644945 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.644770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/079fc084-28ef-4ae5-a5a8-8854662e29ff-metrics-client-ca\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.644945 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.644791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/079fc084-28ef-4ae5-a5a8-8854662e29ff-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.644945 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.644817    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/079fc084-28ef-4ae5-a5a8-8854662e29ff-node-exporter-wtmp\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.644945 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.644836    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/079fc084-28ef-4ae5-a5a8-8854662e29ff-sys\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.644945 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.644846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwgpj\" (UniqueName: \"kubernetes.io/projected/079fc084-28ef-4ae5-a5a8-8854662e29ff-kube-api-access-mwgpj\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.644945 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.644893    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/079fc084-28ef-4ae5-a5a8-8854662e29ff-root\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.644945 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.644931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/079fc084-28ef-4ae5-a5a8-8854662e29ff-node-exporter-textfile\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.645293 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.644983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/079fc084-28ef-4ae5-a5a8-8854662e29ff-node-exporter-tls\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.645293 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.645009    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/079fc084-28ef-4ae5-a5a8-8854662e29ff-node-exporter-wtmp\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.645293 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.645011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/079fc084-28ef-4ae5-a5a8-8854662e29ff-node-exporter-accelerators-collector-config\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.645293 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.645033    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/079fc084-28ef-4ae5-a5a8-8854662e29ff-root\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.645293 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:31:18.645145    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 31 20:31:18.645293 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:31:18.645216    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/079fc084-28ef-4ae5-a5a8-8854662e29ff-node-exporter-tls podName:079fc084-28ef-4ae5-a5a8-8854662e29ff nodeName:}" failed. No retries permitted until 2026-07-31 20:31:19.145193598 +0000 UTC m=+87.750487948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/079fc084-28ef-4ae5-a5a8-8854662e29ff-node-exporter-tls") pod "node-exporter-p2hlc" (UID: "079fc084-28ef-4ae5-a5a8-8854662e29ff") : secret "node-exporter-tls" not found
Jul 31 20:31:18.645612 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.645339    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/079fc084-28ef-4ae5-a5a8-8854662e29ff-node-exporter-textfile\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.645612 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.645517    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/079fc084-28ef-4ae5-a5a8-8854662e29ff-metrics-client-ca\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.645700 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.645607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/079fc084-28ef-4ae5-a5a8-8854662e29ff-node-exporter-accelerators-collector-config\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.647410 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.647371    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/079fc084-28ef-4ae5-a5a8-8854662e29ff-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.653107 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.653087    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwgpj\" (UniqueName: \"kubernetes.io/projected/079fc084-28ef-4ae5-a5a8-8854662e29ff-kube-api-access-mwgpj\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:18.706248 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.706214    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:18.805483 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.805453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:18.907441 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.907359    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:18.909397 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:18.909381    2565 scope.go:117] "RemoveContainer" containerID="0070843edc1551f76957e229e07e8d336ffb8d3fb92432d50db7a49cac35d91e"
Jul 31 20:31:19.009503 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:19.009453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:19.110252 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:19.110218    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:19.147914 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:19.147875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/079fc084-28ef-4ae5-a5a8-8854662e29ff-node-exporter-tls\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:19.150322 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:19.150294    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/079fc084-28ef-4ae5-a5a8-8854662e29ff-node-exporter-tls\") pod \"node-exporter-p2hlc\" (UID: \"079fc084-28ef-4ae5-a5a8-8854662e29ff\") " pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:19.359585 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:19.359561    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 20:31:19.359991 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:19.359646    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72" event={"ID":"2cfe485d-9832-42d7-bf3f-03ee9f76fc84","Type":"ContainerStarted","Data":"44f63929cd31b9528cf3ffb1e0be5f652e34cdf4a83cd51cac1fe55ab36884de"}
Jul 31 20:31:19.360051 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:19.360029    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:31:19.380792 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:19.380710    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72" podStartSLOduration=65.420353684 podStartE2EDuration="1m13.380696219s" totalImagesPullingTime="7.960342535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:19.380177382 +0000 UTC m=+87.985471744" watchObservedRunningTime="2026-07-31 20:31:19.380696219 +0000 UTC m=+87.985990582"
Jul 31 20:31:19.391449 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:19.391422    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p2hlc"
Jul 31 20:31:19.402713 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:31:19.402683    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079fc084_28ef_4ae5_a5a8_8854662e29ff.slice/crio-62972eeb13f85c9471f133d0db14098d40720afbb0220f7d642f719d255d7df6 WatchSource:0}: Error finding container 62972eeb13f85c9471f133d0db14098d40720afbb0220f7d642f719d255d7df6: Status 404 returned error can't find the container with id 62972eeb13f85c9471f133d0db14098d40720afbb0220f7d642f719d255d7df6
Jul 31 20:31:19.473044 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:19.473012    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:19.538536 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:19.538499    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:19.830747 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:19.830704    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-fmf72"
Jul 31 20:31:19.850647 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:19.850610    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:19.915354 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:19.915325    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:20.006949 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:20.006910    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:20.115580 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:20.115502    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:20.219380 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:20.219350    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:20.323922 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:20.323881    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:20.365950 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:20.365861    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p2hlc" event={"ID":"079fc084-28ef-4ae5-a5a8-8854662e29ff","Type":"ContainerStarted","Data":"62972eeb13f85c9471f133d0db14098d40720afbb0220f7d642f719d255d7df6"}
Jul 31 20:31:20.545653 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:20.545622    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:20.950167 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:20.950114    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:21.053155 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:21.053122    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:21.147639 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:21.147605    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:21.281988 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:21.281920    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:31:21.290975 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:21.290944    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:21.370440 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:21.370408    2565 generic.go:356] "Generic (PLEG): container finished" podID="079fc084-28ef-4ae5-a5a8-8854662e29ff" containerID="268d565da0720c97f806b56e0b1f7c5210b746b4bdf1e1ff11303cd943aae192" exitCode=0
Jul 31 20:31:21.370862 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:21.370491    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p2hlc" event={"ID":"079fc084-28ef-4ae5-a5a8-8854662e29ff","Type":"ContainerDied","Data":"268d565da0720c97f806b56e0b1f7c5210b746b4bdf1e1ff11303cd943aae192"}
Jul 31 20:31:21.391833 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:21.391808    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:21.489116 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:21.489091    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:21.614190 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:21.614113    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:21.714399 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:21.714356    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:21.814131 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:21.814103    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:21.936593 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:21.936563    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:22.139151 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:22.139098    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:22.336161 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:22.336036    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:22.376060 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:22.376025    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p2hlc" event={"ID":"079fc084-28ef-4ae5-a5a8-8854662e29ff","Type":"ContainerStarted","Data":"1be81ac9f73cbe743bca864fbb9f29a41de4188f8f5c5152683c4044794256a9"}
Jul 31 20:31:22.376517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:22.376089    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p2hlc" event={"ID":"079fc084-28ef-4ae5-a5a8-8854662e29ff","Type":"ContainerStarted","Data":"35b36f5ec4289e9e6c61cde3c503255f2374f7208d12e7ee9c45851fbd9c6aed"}
Jul 31 20:31:22.395464 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:22.395418    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p2hlc" podStartSLOduration=3.195475983 podStartE2EDuration="4.395402576s" totalImagesPullingTime="1.127980058s" totalInitContainerRuntime="71.946535ms" isStatefulPod=true podCreationTimestamp="2026-07-31 20:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:22.394227281 +0000 UTC m=+90.999521673" watchObservedRunningTime="2026-07-31 20:31:22.395402576 +0000 UTC m=+91.000696938"
Jul 31 20:31:22.415101 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:22.415073    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cfbf8c644-ghtcq"]
Jul 31 20:31:22.538480 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:22.538436    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:22.738084 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:22.738054    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:22.985623 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:22.985576    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:23.138630 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:23.138551    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:23.382701 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:23.382670    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:23.541333 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:23.541300    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:23.775069 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:23.775040    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:23.941268 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:23.941242    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:24.790594 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:24.790559    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:26.422579 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.422548    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c6f546c5b-725lv"]
Jul 31 20:31:26.425891 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.425865    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.429103 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.429076    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 31 20:31:26.429226 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.429114    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 31 20:31:26.429226 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.429076    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 31 20:31:26.429226 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.429114    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 31 20:31:26.429645 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.429627    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 31 20:31:26.429966 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.429946    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-w2xgb\""
Jul 31 20:31:26.430072 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.430001    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 31 20:31:26.430072 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.430008    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 31 20:31:26.434482 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.434463    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6f546c5b-725lv"]
Jul 31 20:31:26.444092 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.444072    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:26.496987 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.496958    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:26.504676 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.504656    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhbjt\" (UniqueName: \"kubernetes.io/projected/942f192a-9a2b-4951-989a-403dacad8756-kube-api-access-fhbjt\") pod \"console-c6f546c5b-725lv\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") " pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.504789 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.504684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/942f192a-9a2b-4951-989a-403dacad8756-oauth-serving-cert\") pod \"console-c6f546c5b-725lv\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") " pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.504789 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.504707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/942f192a-9a2b-4951-989a-403dacad8756-console-serving-cert\") pod \"console-c6f546c5b-725lv\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") " pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.504871 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.504786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/942f192a-9a2b-4951-989a-403dacad8756-console-config\") pod \"console-c6f546c5b-725lv\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") " pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.504871 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.504838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/942f192a-9a2b-4951-989a-403dacad8756-console-oauth-config\") pod \"console-c6f546c5b-725lv\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") " pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.504871 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.504856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/942f192a-9a2b-4951-989a-403dacad8756-service-ca\") pod \"console-c6f546c5b-725lv\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") " pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.605576 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.605530    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhbjt\" (UniqueName: \"kubernetes.io/projected/942f192a-9a2b-4951-989a-403dacad8756-kube-api-access-fhbjt\") pod \"console-c6f546c5b-725lv\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") " pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.605576 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.605577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/942f192a-9a2b-4951-989a-403dacad8756-oauth-serving-cert\") pod \"console-c6f546c5b-725lv\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") " pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.605838 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.605596    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/942f192a-9a2b-4951-989a-403dacad8756-console-serving-cert\") pod \"console-c6f546c5b-725lv\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") " pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.605838 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.605617    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/942f192a-9a2b-4951-989a-403dacad8756-console-config\") pod \"console-c6f546c5b-725lv\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") " pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.605838 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.605643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/942f192a-9a2b-4951-989a-403dacad8756-console-oauth-config\") pod \"console-c6f546c5b-725lv\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") " pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.605838 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.605660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/942f192a-9a2b-4951-989a-403dacad8756-service-ca\") pod \"console-c6f546c5b-725lv\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") " pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.606374 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.606329    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/942f192a-9a2b-4951-989a-403dacad8756-service-ca\") pod \"console-c6f546c5b-725lv\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") " pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.606472 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.606380    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/942f192a-9a2b-4951-989a-403dacad8756-console-config\") pod \"console-c6f546c5b-725lv\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") " pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.606580 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.606542    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/942f192a-9a2b-4951-989a-403dacad8756-oauth-serving-cert\") pod \"console-c6f546c5b-725lv\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") " pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.608139 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.608122    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/942f192a-9a2b-4951-989a-403dacad8756-console-oauth-config\") pod \"console-c6f546c5b-725lv\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") " pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.608243 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.608220    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/942f192a-9a2b-4951-989a-403dacad8756-console-serving-cert\") pod \"console-c6f546c5b-725lv\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") " pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.612466 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.612444    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhbjt\" (UniqueName: \"kubernetes.io/projected/942f192a-9a2b-4951-989a-403dacad8756-kube-api-access-fhbjt\") pod \"console-c6f546c5b-725lv\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") " pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.736297 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.736263    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:26.818484 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.818389    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:26.872559 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.872535    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6f546c5b-725lv"]
Jul 31 20:31:26.875280 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:31:26.875253    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod942f192a_9a2b_4951_989a_403dacad8756.slice/crio-a9b4d0dddeb56c7f996035b14f5c8b9213fdbcb9700fbf1f5698f9c2decd8695 WatchSource:0}: Error finding container a9b4d0dddeb56c7f996035b14f5c8b9213fdbcb9700fbf1f5698f9c2decd8695: Status 404 returned error can't find the container with id a9b4d0dddeb56c7f996035b14f5c8b9213fdbcb9700fbf1f5698f9c2decd8695
Jul 31 20:31:26.875436 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:26.875346    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:27.398170 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:27.398139    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6f546c5b-725lv" event={"ID":"942f192a-9a2b-4951-989a-403dacad8756","Type":"ContainerStarted","Data":"a9b4d0dddeb56c7f996035b14f5c8b9213fdbcb9700fbf1f5698f9c2decd8695"}
Jul 31 20:31:29.265175 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:29.265147    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nbhtt"
Jul 31 20:31:30.113543 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:30.113516    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:30.217263 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:30.217227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:30.411115 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:30.411031    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6f546c5b-725lv" event={"ID":"942f192a-9a2b-4951-989a-403dacad8756","Type":"ContainerStarted","Data":"50a60830997832c32c2dcc76713814d9b59bf7cd487eff01e0f76052cf92b47d"}
Jul 31 20:31:30.427467 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:30.427415    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c6f546c5b-725lv" podStartSLOduration=1.227275892 podStartE2EDuration="4.427398654s" totalImagesPullingTime="3.200122762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:31:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:30.426677663 +0000 UTC m=+99.031972046" watchObservedRunningTime="2026-07-31 20:31:30.427398654 +0000 UTC m=+99.032693017"
Jul 31 20:31:30.658316 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:30.658278    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:30.747520 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:30.747487    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:35.313346 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:35.313309    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:35.413255 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:35.413214    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:35.461356 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:35.461326    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:35.913521 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:35.913486    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-995fbcdc5-d5ll9"]
Jul 31 20:31:35.916601 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:35.916580    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:35.924174 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:35.924119    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 31 20:31:35.925442 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:35.925409    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-995fbcdc5-d5ll9"]
Jul 31 20:31:35.984190 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:35.984152    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffae6ab8-9841-47f2-924a-ab7395a1e34d-console-serving-cert\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:35.984190 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:35.984186    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-trusted-ca-bundle\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:35.984463 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:35.984271    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl7k8\" (UniqueName: \"kubernetes.io/projected/ffae6ab8-9841-47f2-924a-ab7395a1e34d-kube-api-access-gl7k8\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:35.984463 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:35.984411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffae6ab8-9841-47f2-924a-ab7395a1e34d-console-oauth-config\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:35.984463 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:35.984436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-oauth-serving-cert\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:35.984619 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:35.984465    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-service-ca\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:35.984619 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:35.984484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-console-config\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:36.085542 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.085498    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffae6ab8-9841-47f2-924a-ab7395a1e34d-console-oauth-config\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:36.085542 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.085543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-oauth-serving-cert\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:36.085846 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.085679    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-service-ca\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:36.085846 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.085717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-console-config\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:36.085846 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.085799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffae6ab8-9841-47f2-924a-ab7395a1e34d-console-serving-cert\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:36.085846 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.085816    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-trusted-ca-bundle\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:36.085846 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.085842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl7k8\" (UniqueName: \"kubernetes.io/projected/ffae6ab8-9841-47f2-924a-ab7395a1e34d-kube-api-access-gl7k8\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:36.086346 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.086322    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-oauth-serving-cert\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:36.086432 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.086396    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-service-ca\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:36.086631 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.086610    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-console-config\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:36.086854 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.086836    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-trusted-ca-bundle\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:36.088151 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.088127    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffae6ab8-9841-47f2-924a-ab7395a1e34d-console-oauth-config\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:36.088328 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.088311    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffae6ab8-9841-47f2-924a-ab7395a1e34d-console-serving-cert\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:36.092722 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.092701    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl7k8\" (UniqueName: \"kubernetes.io/projected/ffae6ab8-9841-47f2-924a-ab7395a1e34d-kube-api-access-gl7k8\") pod \"console-995fbcdc5-d5ll9\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") " pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:36.226461 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.226428    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:36.352194 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.352169    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-995fbcdc5-d5ll9"]
Jul 31 20:31:36.354697 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:31:36.354670    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffae6ab8_9841_47f2_924a_ab7395a1e34d.slice/crio-51512b9d40dfab1098d1d3d6fb96561c45b4ccee9f69e88093a9fd7035c71acf WatchSource:0}: Error finding container 51512b9d40dfab1098d1d3d6fb96561c45b4ccee9f69e88093a9fd7035c71acf: Status 404 returned error can't find the container with id 51512b9d40dfab1098d1d3d6fb96561c45b4ccee9f69e88093a9fd7035c71acf
Jul 31 20:31:36.435182 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.435152    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-995fbcdc5-d5ll9" event={"ID":"ffae6ab8-9841-47f2-924a-ab7395a1e34d","Type":"ContainerStarted","Data":"de56acfb07896a21bfdfd2da1a68cd8aeceffa555629028540f55ece83f12973"}
Jul 31 20:31:36.435323 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.435205    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-995fbcdc5-d5ll9" event={"ID":"ffae6ab8-9841-47f2-924a-ab7395a1e34d","Type":"ContainerStarted","Data":"51512b9d40dfab1098d1d3d6fb96561c45b4ccee9f69e88093a9fd7035c71acf"}
Jul 31 20:31:36.449890 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.449830    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-995fbcdc5-d5ll9" podStartSLOduration=1.4498137899999999 podStartE2EDuration="1.44981379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:31:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:36.449053954 +0000 UTC m=+105.054348317" watchObservedRunningTime="2026-07-31 20:31:36.44981379 +0000 UTC m=+105.055108153"
Jul 31 20:31:36.737341 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.737307    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:36.737517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.737372    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:36.742217 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:36.742195    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:37.442517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:37.442489    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:31:38.913312 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:38.913273    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:39.014687 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:39.014655    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:40.514380 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:40.514342    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:40.614278 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:40.614227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:41.816235 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:41.816197    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:41.869324 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:41.869291    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:45.714102 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:45.714066    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:45.815062 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:45.815027    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:46.226895 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:46.226858    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:46.227067 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:46.226934    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:46.231797 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:46.231776    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:46.475166 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:46.475120    2565 generic.go:356] "Generic (PLEG): container finished" podID="f405b67c-4d95-4880-8ad3-2915433fe139" containerID="09c26f512b2f01d40b9fc17bd8c20aaa28f09b4e973f14a900b967e60021c061" exitCode=0
Jul 31 20:31:46.475519 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:46.475482    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5" event={"ID":"f405b67c-4d95-4880-8ad3-2915433fe139","Type":"ContainerDied","Data":"09c26f512b2f01d40b9fc17bd8c20aaa28f09b4e973f14a900b967e60021c061"}
Jul 31 20:31:46.475969 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:46.475946    2565 scope.go:117] "RemoveContainer" containerID="09c26f512b2f01d40b9fc17bd8c20aaa28f09b4e973f14a900b967e60021c061"
Jul 31 20:31:46.480711 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:46.480690    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:31:46.532075 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:46.532048    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c6f546c5b-725lv"]
Jul 31 20:31:46.542021 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:46.541980    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:46.634531 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:46.634499    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:47.116394 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.116355    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:47.442568 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.442527    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq" podUID="9b9948a1-099f-4f1c-98a1-99155b23bebe" containerName="registry" containerID="cri-o://085847f9333fbd4f9c2e57b1b705d8e0da72cbd6680ff680b668adc08009cf01" gracePeriod=30
Jul 31 20:31:47.480199 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.480171    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-z9sj5" event={"ID":"f405b67c-4d95-4880-8ad3-2915433fe139","Type":"ContainerStarted","Data":"2fc45e0e4cc26f63b6c81c068d19007153f2f8edbf99d48fc63248a0899f09c0"}
Jul 31 20:31:47.688005 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.687980    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:31:47.783971 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.783874    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls\") pod \"9b9948a1-099f-4f1c-98a1-99155b23bebe\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") "
Jul 31 20:31:47.783971 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.783947    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b9948a1-099f-4f1c-98a1-99155b23bebe-ca-trust-extracted\") pod \"9b9948a1-099f-4f1c-98a1-99155b23bebe\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") "
Jul 31 20:31:47.783971 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.783972    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b9948a1-099f-4f1c-98a1-99155b23bebe-trusted-ca\") pod \"9b9948a1-099f-4f1c-98a1-99155b23bebe\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") "
Jul 31 20:31:47.784254 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.784013    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-bound-sa-token\") pod \"9b9948a1-099f-4f1c-98a1-99155b23bebe\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") "
Jul 31 20:31:47.784254 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.784037    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b9948a1-099f-4f1c-98a1-99155b23bebe-image-registry-private-configuration\") pod \"9b9948a1-099f-4f1c-98a1-99155b23bebe\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") "
Jul 31 20:31:47.784254 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.784059    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzs72\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-kube-api-access-dzs72\") pod \"9b9948a1-099f-4f1c-98a1-99155b23bebe\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") "
Jul 31 20:31:47.784254 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.784134    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b9948a1-099f-4f1c-98a1-99155b23bebe-installation-pull-secrets\") pod \"9b9948a1-099f-4f1c-98a1-99155b23bebe\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") "
Jul 31 20:31:47.784254 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.784161    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-certificates\") pod \"9b9948a1-099f-4f1c-98a1-99155b23bebe\" (UID: \"9b9948a1-099f-4f1c-98a1-99155b23bebe\") "
Jul 31 20:31:47.784504 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.784466    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b9948a1-099f-4f1c-98a1-99155b23bebe-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9b9948a1-099f-4f1c-98a1-99155b23bebe" (UID: "9b9948a1-099f-4f1c-98a1-99155b23bebe"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:31:47.784776 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.784717    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9b9948a1-099f-4f1c-98a1-99155b23bebe" (UID: "9b9948a1-099f-4f1c-98a1-99155b23bebe"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:31:47.786583 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.786557    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9b9948a1-099f-4f1c-98a1-99155b23bebe" (UID: "9b9948a1-099f-4f1c-98a1-99155b23bebe"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:31:47.786772 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.786706    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9b9948a1-099f-4f1c-98a1-99155b23bebe" (UID: "9b9948a1-099f-4f1c-98a1-99155b23bebe"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:31:47.787036 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.787008    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-kube-api-access-dzs72" (OuterVolumeSpecName: "kube-api-access-dzs72") pod "9b9948a1-099f-4f1c-98a1-99155b23bebe" (UID: "9b9948a1-099f-4f1c-98a1-99155b23bebe"). InnerVolumeSpecName "kube-api-access-dzs72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:31:47.787131 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.787091    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b9948a1-099f-4f1c-98a1-99155b23bebe-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9b9948a1-099f-4f1c-98a1-99155b23bebe" (UID: "9b9948a1-099f-4f1c-98a1-99155b23bebe"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:31:47.787189 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.787140    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b9948a1-099f-4f1c-98a1-99155b23bebe-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9b9948a1-099f-4f1c-98a1-99155b23bebe" (UID: "9b9948a1-099f-4f1c-98a1-99155b23bebe"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:31:47.792912 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.792885    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b9948a1-099f-4f1c-98a1-99155b23bebe-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9b9948a1-099f-4f1c-98a1-99155b23bebe" (UID: "9b9948a1-099f-4f1c-98a1-99155b23bebe"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:31:47.885148 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.885115    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b9948a1-099f-4f1c-98a1-99155b23bebe-trusted-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:31:47.885148 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.885143    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-bound-sa-token\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:31:47.885148 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.885154    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b9948a1-099f-4f1c-98a1-99155b23bebe-image-registry-private-configuration\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:31:47.885369 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.885164    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzs72\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-kube-api-access-dzs72\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:31:47.885369 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.885174    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b9948a1-099f-4f1c-98a1-99155b23bebe-installation-pull-secrets\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:31:47.885369 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.885183    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-certificates\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:31:47.885369 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.885191    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b9948a1-099f-4f1c-98a1-99155b23bebe-registry-tls\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:31:47.885369 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:47.885199    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b9948a1-099f-4f1c-98a1-99155b23bebe-ca-trust-extracted\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:31:48.485040 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:48.485006    2565 generic.go:356] "Generic (PLEG): container finished" podID="9b9948a1-099f-4f1c-98a1-99155b23bebe" containerID="085847f9333fbd4f9c2e57b1b705d8e0da72cbd6680ff680b668adc08009cf01" exitCode=0
Jul 31 20:31:48.485498 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:48.485052    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq"
Jul 31 20:31:48.485498 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:48.485093    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq" event={"ID":"9b9948a1-099f-4f1c-98a1-99155b23bebe","Type":"ContainerDied","Data":"085847f9333fbd4f9c2e57b1b705d8e0da72cbd6680ff680b668adc08009cf01"}
Jul 31 20:31:48.485498 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:48.485144    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cfbf8c644-ghtcq" event={"ID":"9b9948a1-099f-4f1c-98a1-99155b23bebe","Type":"ContainerDied","Data":"4a9dcd3e839aec9cf963fb39a5a6175f94370d05c0940b1617731972bb650043"}
Jul 31 20:31:48.485498 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:48.485164    2565 scope.go:117] "RemoveContainer" containerID="085847f9333fbd4f9c2e57b1b705d8e0da72cbd6680ff680b668adc08009cf01"
Jul 31 20:31:48.493214 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:48.493200    2565 scope.go:117] "RemoveContainer" containerID="085847f9333fbd4f9c2e57b1b705d8e0da72cbd6680ff680b668adc08009cf01"
Jul 31 20:31:48.493464 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:31:48.493443    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"085847f9333fbd4f9c2e57b1b705d8e0da72cbd6680ff680b668adc08009cf01\": container with ID starting with 085847f9333fbd4f9c2e57b1b705d8e0da72cbd6680ff680b668adc08009cf01 not found: ID does not exist" containerID="085847f9333fbd4f9c2e57b1b705d8e0da72cbd6680ff680b668adc08009cf01"
Jul 31 20:31:48.493501 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:48.493473    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"085847f9333fbd4f9c2e57b1b705d8e0da72cbd6680ff680b668adc08009cf01"} err="failed to get container status \"085847f9333fbd4f9c2e57b1b705d8e0da72cbd6680ff680b668adc08009cf01\": rpc error: code = NotFound desc = could not find container \"085847f9333fbd4f9c2e57b1b705d8e0da72cbd6680ff680b668adc08009cf01\": container with ID starting with 085847f9333fbd4f9c2e57b1b705d8e0da72cbd6680ff680b668adc08009cf01 not found: ID does not exist"
Jul 31 20:31:48.499124 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:48.499103    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cfbf8c644-ghtcq"]
Jul 31 20:31:48.502467 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:48.502447    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5cfbf8c644-ghtcq"]
Jul 31 20:31:49.913631 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:49.913599    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b9948a1-099f-4f1c-98a1-99155b23bebe" path="/var/lib/kubelet/pods/9b9948a1-099f-4f1c-98a1-99155b23bebe/volumes"
Jul 31 20:31:52.215037 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:52.214988    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:52.266469 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:52.266438    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:31:56.516818 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:56.516783    2565 generic.go:356] "Generic (PLEG): container finished" podID="85ab1ab6-5d3a-4173-8e9a-85ca012925fd" containerID="ff4daeb66d83c2037e847191b36ac7d442c379469436a34086e33a2d03a112c1" exitCode=0
Jul 31 20:31:56.517207 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:56.516858    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6" event={"ID":"85ab1ab6-5d3a-4173-8e9a-85ca012925fd","Type":"ContainerDied","Data":"ff4daeb66d83c2037e847191b36ac7d442c379469436a34086e33a2d03a112c1"}
Jul 31 20:31:56.517207 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:56.517193    2565 scope.go:117] "RemoveContainer" containerID="ff4daeb66d83c2037e847191b36ac7d442c379469436a34086e33a2d03a112c1"
Jul 31 20:31:57.522411 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:31:57.522366    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vxlv6" event={"ID":"85ab1ab6-5d3a-4173-8e9a-85ca012925fd","Type":"ContainerStarted","Data":"6e97a970f6ad96f4551937aeb5f2d17711b34721fa0fff87bc7ebf30c2808b82"}
Jul 31 20:32:00.971360 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:00.971326    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:32:01.031497 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:01.031464    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:32:06.899535 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:06.899498    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:32:11.552944 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.552904    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c6f546c5b-725lv" podUID="942f192a-9a2b-4951-989a-403dacad8756" containerName="console" containerID="cri-o://50a60830997832c32c2dcc76713814d9b59bf7cd487eff01e0f76052cf92b47d" gracePeriod=15
Jul 31 20:32:11.575692 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.575662    2565 generic.go:356] "Generic (PLEG): container finished" podID="d8329200-4000-4de4-8ef7-abf447f2e636" containerID="09fe3f898edd8ebaa1aae98343b40b4e54e6fc3480810890e3581a6187993929" exitCode=0
Jul 31 20:32:11.575834 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.575724    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-vfkvs" event={"ID":"d8329200-4000-4de4-8ef7-abf447f2e636","Type":"ContainerDied","Data":"09fe3f898edd8ebaa1aae98343b40b4e54e6fc3480810890e3581a6187993929"}
Jul 31 20:32:11.576072 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.576058    2565 scope.go:117] "RemoveContainer" containerID="09fe3f898edd8ebaa1aae98343b40b4e54e6fc3480810890e3581a6187993929"
Jul 31 20:32:11.737089 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.737023    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:32:11.807520 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.807458    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:32:11.828558 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.828521    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:32:11.885107 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.885072    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:32:11.988863 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.988824    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/942f192a-9a2b-4951-989a-403dacad8756-service-ca\") pod \"942f192a-9a2b-4951-989a-403dacad8756\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") "
Jul 31 20:32:11.988863 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.988865    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/942f192a-9a2b-4951-989a-403dacad8756-console-config\") pod \"942f192a-9a2b-4951-989a-403dacad8756\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") "
Jul 31 20:32:11.989116 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.988896    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhbjt\" (UniqueName: \"kubernetes.io/projected/942f192a-9a2b-4951-989a-403dacad8756-kube-api-access-fhbjt\") pod \"942f192a-9a2b-4951-989a-403dacad8756\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") "
Jul 31 20:32:11.989116 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.988942    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/942f192a-9a2b-4951-989a-403dacad8756-console-oauth-config\") pod \"942f192a-9a2b-4951-989a-403dacad8756\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") "
Jul 31 20:32:11.989116 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.988969    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/942f192a-9a2b-4951-989a-403dacad8756-console-serving-cert\") pod \"942f192a-9a2b-4951-989a-403dacad8756\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") "
Jul 31 20:32:11.989116 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.989029    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/942f192a-9a2b-4951-989a-403dacad8756-oauth-serving-cert\") pod \"942f192a-9a2b-4951-989a-403dacad8756\" (UID: \"942f192a-9a2b-4951-989a-403dacad8756\") "
Jul 31 20:32:11.989315 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.989293    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/942f192a-9a2b-4951-989a-403dacad8756-console-config" (OuterVolumeSpecName: "console-config") pod "942f192a-9a2b-4951-989a-403dacad8756" (UID: "942f192a-9a2b-4951-989a-403dacad8756"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:32:11.989373 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.989301    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/942f192a-9a2b-4951-989a-403dacad8756-service-ca" (OuterVolumeSpecName: "service-ca") pod "942f192a-9a2b-4951-989a-403dacad8756" (UID: "942f192a-9a2b-4951-989a-403dacad8756"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:32:11.989565 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.989536    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/942f192a-9a2b-4951-989a-403dacad8756-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "942f192a-9a2b-4951-989a-403dacad8756" (UID: "942f192a-9a2b-4951-989a-403dacad8756"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:32:11.991434 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.991411    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/942f192a-9a2b-4951-989a-403dacad8756-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "942f192a-9a2b-4951-989a-403dacad8756" (UID: "942f192a-9a2b-4951-989a-403dacad8756"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:32:11.991730 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.991703    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/942f192a-9a2b-4951-989a-403dacad8756-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "942f192a-9a2b-4951-989a-403dacad8756" (UID: "942f192a-9a2b-4951-989a-403dacad8756"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:32:11.991821 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:11.991705    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/942f192a-9a2b-4951-989a-403dacad8756-kube-api-access-fhbjt" (OuterVolumeSpecName: "kube-api-access-fhbjt") pod "942f192a-9a2b-4951-989a-403dacad8756" (UID: "942f192a-9a2b-4951-989a-403dacad8756"). InnerVolumeSpecName "kube-api-access-fhbjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:32:12.089995 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:12.089901    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/942f192a-9a2b-4951-989a-403dacad8756-oauth-serving-cert\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:32:12.089995 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:12.089937    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/942f192a-9a2b-4951-989a-403dacad8756-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:32:12.089995 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:12.089950    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/942f192a-9a2b-4951-989a-403dacad8756-console-config\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:32:12.089995 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:12.089962    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhbjt\" (UniqueName: \"kubernetes.io/projected/942f192a-9a2b-4951-989a-403dacad8756-kube-api-access-fhbjt\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:32:12.089995 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:12.089977    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/942f192a-9a2b-4951-989a-403dacad8756-console-oauth-config\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:32:12.089995 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:12.089988    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/942f192a-9a2b-4951-989a-403dacad8756-console-serving-cert\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:32:12.581280 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:12.581244    2565 generic.go:356] "Generic (PLEG): container finished" podID="942f192a-9a2b-4951-989a-403dacad8756" containerID="50a60830997832c32c2dcc76713814d9b59bf7cd487eff01e0f76052cf92b47d" exitCode=0
Jul 31 20:32:12.581699 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:12.581288    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6f546c5b-725lv"
Jul 31 20:32:12.581699 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:12.581336    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6f546c5b-725lv" event={"ID":"942f192a-9a2b-4951-989a-403dacad8756","Type":"ContainerDied","Data":"50a60830997832c32c2dcc76713814d9b59bf7cd487eff01e0f76052cf92b47d"}
Jul 31 20:32:12.581699 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:12.581388    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6f546c5b-725lv" event={"ID":"942f192a-9a2b-4951-989a-403dacad8756","Type":"ContainerDied","Data":"a9b4d0dddeb56c7f996035b14f5c8b9213fdbcb9700fbf1f5698f9c2decd8695"}
Jul 31 20:32:12.581699 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:12.581411    2565 scope.go:117] "RemoveContainer" containerID="50a60830997832c32c2dcc76713814d9b59bf7cd487eff01e0f76052cf92b47d"
Jul 31 20:32:12.583485 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:12.583458    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-vfkvs" event={"ID":"d8329200-4000-4de4-8ef7-abf447f2e636","Type":"ContainerStarted","Data":"6fdc9980ef4969fc69e4bd1187ea5f0871a27887afad1c9f791d122ea663517e"}
Jul 31 20:32:12.595885 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:12.595857    2565 scope.go:117] "RemoveContainer" containerID="50a60830997832c32c2dcc76713814d9b59bf7cd487eff01e0f76052cf92b47d"
Jul 31 20:32:12.596202 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:32:12.596180    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50a60830997832c32c2dcc76713814d9b59bf7cd487eff01e0f76052cf92b47d\": container with ID starting with 50a60830997832c32c2dcc76713814d9b59bf7cd487eff01e0f76052cf92b47d not found: ID does not exist" containerID="50a60830997832c32c2dcc76713814d9b59bf7cd487eff01e0f76052cf92b47d"
Jul 31 20:32:12.596278 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:12.596209    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50a60830997832c32c2dcc76713814d9b59bf7cd487eff01e0f76052cf92b47d"} err="failed to get container status \"50a60830997832c32c2dcc76713814d9b59bf7cd487eff01e0f76052cf92b47d\": rpc error: code = NotFound desc = could not find container \"50a60830997832c32c2dcc76713814d9b59bf7cd487eff01e0f76052cf92b47d\": container with ID starting with 50a60830997832c32c2dcc76713814d9b59bf7cd487eff01e0f76052cf92b47d not found: ID does not exist"
Jul 31 20:32:12.603348 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:12.603315    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:32:12.615397 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:12.615368    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c6f546c5b-725lv"]
Jul 31 20:32:12.622483 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:12.622458    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c6f546c5b-725lv"]
Jul 31 20:32:12.658091 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:12.658052    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:32:13.914299 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:13.914260    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="942f192a-9a2b-4951-989a-403dacad8756" path="/var/lib/kubelet/pods/942f192a-9a2b-4951-989a-403dacad8756/volumes"
Jul 31 20:32:37.763499 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:37.763462    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:32:37.965710 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:37.965674    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:32:46.038261 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.038171    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f974bbc75-wtvh2"]
Jul 31 20:32:46.041114 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.038446    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b9948a1-099f-4f1c-98a1-99155b23bebe" containerName="registry"
Jul 31 20:32:46.041114 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.038456    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b9948a1-099f-4f1c-98a1-99155b23bebe" containerName="registry"
Jul 31 20:32:46.041114 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.038468    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="942f192a-9a2b-4951-989a-403dacad8756" containerName="console"
Jul 31 20:32:46.041114 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.038473    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="942f192a-9a2b-4951-989a-403dacad8756" containerName="console"
Jul 31 20:32:46.041114 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.038524    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="942f192a-9a2b-4951-989a-403dacad8756" containerName="console"
Jul 31 20:32:46.041114 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.038535    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b9948a1-099f-4f1c-98a1-99155b23bebe" containerName="registry"
Jul 31 20:32:46.041114 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.040359    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.050272 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.050245    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f974bbc75-wtvh2"]
Jul 31 20:32:46.094454 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.094429    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:32:46.149676 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.149643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-console-config\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.149676 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.149680    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls8j5\" (UniqueName: \"kubernetes.io/projected/78cefeff-868a-4644-ab81-d44b569b15fe-kube-api-access-ls8j5\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.149895 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.149712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78cefeff-868a-4644-ab81-d44b569b15fe-console-serving-cert\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.149895 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.149789    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-oauth-serving-cert\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.149895 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.149812    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78cefeff-868a-4644-ab81-d44b569b15fe-console-oauth-config\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.149895 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.149879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-trusted-ca-bundle\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.150017 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.149926    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-service-ca\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.195584 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.195549    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:32:46.250929 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.250891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-service-ca\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.251151 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.250958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-console-config\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.251151 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.250982    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls8j5\" (UniqueName: \"kubernetes.io/projected/78cefeff-868a-4644-ab81-d44b569b15fe-kube-api-access-ls8j5\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.251151 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.251017    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78cefeff-868a-4644-ab81-d44b569b15fe-console-serving-cert\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.251151 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.251059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-oauth-serving-cert\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.251151 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.251092    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78cefeff-868a-4644-ab81-d44b569b15fe-console-oauth-config\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.251423 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.251244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-trusted-ca-bundle\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.251675 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.251650    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-service-ca\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.251781 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.251761    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-console-config\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.251960 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.251938    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-oauth-serving-cert\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.252379 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.252360    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-trusted-ca-bundle\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.254120 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.254094    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78cefeff-868a-4644-ab81-d44b569b15fe-console-oauth-config\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.254209 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.254181    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78cefeff-868a-4644-ab81-d44b569b15fe-console-serving-cert\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.258503 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.258483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls8j5\" (UniqueName: \"kubernetes.io/projected/78cefeff-868a-4644-ab81-d44b569b15fe-kube-api-access-ls8j5\") pod \"console-5f974bbc75-wtvh2\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") " pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.351894 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.351792    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:46.482664 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.482631    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f974bbc75-wtvh2"]
Jul 31 20:32:46.485499 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:32:46.485464    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78cefeff_868a_4644_ab81_d44b569b15fe.slice/crio-4094e768dd42279c1f0c38fd573a4db6157d01450c0f1699cdf88a12c06792b5 WatchSource:0}: Error finding container 4094e768dd42279c1f0c38fd573a4db6157d01450c0f1699cdf88a12c06792b5: Status 404 returned error can't find the container with id 4094e768dd42279c1f0c38fd573a4db6157d01450c0f1699cdf88a12c06792b5
Jul 31 20:32:46.718451 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.718412    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f974bbc75-wtvh2" event={"ID":"78cefeff-868a-4644-ab81-d44b569b15fe","Type":"ContainerStarted","Data":"705355e01d69ce8ca34ed79e691b7a273670f413c055ef380028c985835af836"}
Jul 31 20:32:46.718622 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.718460    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f974bbc75-wtvh2" event={"ID":"78cefeff-868a-4644-ab81-d44b569b15fe","Type":"ContainerStarted","Data":"4094e768dd42279c1f0c38fd573a4db6157d01450c0f1699cdf88a12c06792b5"}
Jul 31 20:32:46.734599 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:46.734551    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f974bbc75-wtvh2" podStartSLOduration=0.734534577 podStartE2EDuration="734.534577ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:32:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:32:46.733619539 +0000 UTC m=+175.338913900" watchObservedRunningTime="2026-07-31 20:32:46.734534577 +0000 UTC m=+175.339828940"
Jul 31 20:32:56.352245 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:56.352202    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:56.352674 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:56.352282    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:56.356992 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:56.356972    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:56.760819 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:56.760784    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:32:56.801894 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:56.801862    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-995fbcdc5-d5ll9"]
Jul 31 20:32:56.907372 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:56.907344    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:32:57.002906 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:57.002873    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:32:57.053944 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:32:57.053863    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:33:21.824470 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:21.824400    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-995fbcdc5-d5ll9" podUID="ffae6ab8-9841-47f2-924a-ab7395a1e34d" containerName="console" containerID="cri-o://de56acfb07896a21bfdfd2da1a68cd8aeceffa555629028540f55ece83f12973" gracePeriod=15
Jul 31 20:33:22.064596 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.064572    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:33:22.137794 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.137688    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-service-ca\") pod \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") "
Jul 31 20:33:22.137794 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.137759    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl7k8\" (UniqueName: \"kubernetes.io/projected/ffae6ab8-9841-47f2-924a-ab7395a1e34d-kube-api-access-gl7k8\") pod \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") "
Jul 31 20:33:22.138016 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.137796    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-trusted-ca-bundle\") pod \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") "
Jul 31 20:33:22.138016 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.137839    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffae6ab8-9841-47f2-924a-ab7395a1e34d-console-oauth-config\") pod \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") "
Jul 31 20:33:22.138016 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.137866    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-oauth-serving-cert\") pod \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") "
Jul 31 20:33:22.138016 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.137924    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-console-config\") pod \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") "
Jul 31 20:33:22.138016 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.137955    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffae6ab8-9841-47f2-924a-ab7395a1e34d-console-serving-cert\") pod \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\" (UID: \"ffae6ab8-9841-47f2-924a-ab7395a1e34d\") "
Jul 31 20:33:22.138266 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.138084    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-service-ca" (OuterVolumeSpecName: "service-ca") pod "ffae6ab8-9841-47f2-924a-ab7395a1e34d" (UID: "ffae6ab8-9841-47f2-924a-ab7395a1e34d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:33:22.138323 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.138298    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ffae6ab8-9841-47f2-924a-ab7395a1e34d" (UID: "ffae6ab8-9841-47f2-924a-ab7395a1e34d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:33:22.138370 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.138305    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ffae6ab8-9841-47f2-924a-ab7395a1e34d" (UID: "ffae6ab8-9841-47f2-924a-ab7395a1e34d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:33:22.138370 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.138333    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-console-config" (OuterVolumeSpecName: "console-config") pod "ffae6ab8-9841-47f2-924a-ab7395a1e34d" (UID: "ffae6ab8-9841-47f2-924a-ab7395a1e34d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:33:22.140055 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.140030    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffae6ab8-9841-47f2-924a-ab7395a1e34d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ffae6ab8-9841-47f2-924a-ab7395a1e34d" (UID: "ffae6ab8-9841-47f2-924a-ab7395a1e34d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:33:22.140178 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.140111    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffae6ab8-9841-47f2-924a-ab7395a1e34d-kube-api-access-gl7k8" (OuterVolumeSpecName: "kube-api-access-gl7k8") pod "ffae6ab8-9841-47f2-924a-ab7395a1e34d" (UID: "ffae6ab8-9841-47f2-924a-ab7395a1e34d"). InnerVolumeSpecName "kube-api-access-gl7k8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:33:22.140178 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.140172    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffae6ab8-9841-47f2-924a-ab7395a1e34d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ffae6ab8-9841-47f2-924a-ab7395a1e34d" (UID: "ffae6ab8-9841-47f2-924a-ab7395a1e34d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:33:22.238624 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.238588    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-console-config\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:33:22.238624 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.238617    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffae6ab8-9841-47f2-924a-ab7395a1e34d-console-serving-cert\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:33:22.238624 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.238628    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:33:22.238624 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.238636    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl7k8\" (UniqueName: \"kubernetes.io/projected/ffae6ab8-9841-47f2-924a-ab7395a1e34d-kube-api-access-gl7k8\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:33:22.238921 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.238644    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-trusted-ca-bundle\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:33:22.238921 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.238654    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffae6ab8-9841-47f2-924a-ab7395a1e34d-console-oauth-config\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:33:22.238921 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.238661    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffae6ab8-9841-47f2-924a-ab7395a1e34d-oauth-serving-cert\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:33:22.857006 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.856966    2565 generic.go:356] "Generic (PLEG): container finished" podID="ffae6ab8-9841-47f2-924a-ab7395a1e34d" containerID="de56acfb07896a21bfdfd2da1a68cd8aeceffa555629028540f55ece83f12973" exitCode=0
Jul 31 20:33:22.857006 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.857008    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-995fbcdc5-d5ll9"
Jul 31 20:33:22.857436 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.857009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-995fbcdc5-d5ll9" event={"ID":"ffae6ab8-9841-47f2-924a-ab7395a1e34d","Type":"ContainerDied","Data":"de56acfb07896a21bfdfd2da1a68cd8aeceffa555629028540f55ece83f12973"}
Jul 31 20:33:22.857436 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.857128    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-995fbcdc5-d5ll9" event={"ID":"ffae6ab8-9841-47f2-924a-ab7395a1e34d","Type":"ContainerDied","Data":"51512b9d40dfab1098d1d3d6fb96561c45b4ccee9f69e88093a9fd7035c71acf"}
Jul 31 20:33:22.857436 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.857156    2565 scope.go:117] "RemoveContainer" containerID="de56acfb07896a21bfdfd2da1a68cd8aeceffa555629028540f55ece83f12973"
Jul 31 20:33:22.865671 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.865655    2565 scope.go:117] "RemoveContainer" containerID="de56acfb07896a21bfdfd2da1a68cd8aeceffa555629028540f55ece83f12973"
Jul 31 20:33:22.865961 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:33:22.865940    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de56acfb07896a21bfdfd2da1a68cd8aeceffa555629028540f55ece83f12973\": container with ID starting with de56acfb07896a21bfdfd2da1a68cd8aeceffa555629028540f55ece83f12973 not found: ID does not exist" containerID="de56acfb07896a21bfdfd2da1a68cd8aeceffa555629028540f55ece83f12973"
Jul 31 20:33:22.866016 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.865969    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de56acfb07896a21bfdfd2da1a68cd8aeceffa555629028540f55ece83f12973"} err="failed to get container status \"de56acfb07896a21bfdfd2da1a68cd8aeceffa555629028540f55ece83f12973\": rpc error: code = NotFound desc = could not find container \"de56acfb07896a21bfdfd2da1a68cd8aeceffa555629028540f55ece83f12973\": container with ID starting with de56acfb07896a21bfdfd2da1a68cd8aeceffa555629028540f55ece83f12973 not found: ID does not exist"
Jul 31 20:33:22.875869 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.875844    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-995fbcdc5-d5ll9"]
Jul 31 20:33:22.877536 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:22.877517    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-995fbcdc5-d5ll9"]
Jul 31 20:33:23.918624 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:23.918590    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffae6ab8-9841-47f2-924a-ab7395a1e34d" path="/var/lib/kubelet/pods/ffae6ab8-9841-47f2-924a-ab7395a1e34d/volumes"
Jul 31 20:33:42.748539 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:42.748500    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:33:52.999987 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:52.999957    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:33:53.052065 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:53.052020    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:33:56.318918 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.318884    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dc5664685-mc9xx"]
Jul 31 20:33:56.319420 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.319400    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffae6ab8-9841-47f2-924a-ab7395a1e34d" containerName="console"
Jul 31 20:33:56.319477 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.319425    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffae6ab8-9841-47f2-924a-ab7395a1e34d" containerName="console"
Jul 31 20:33:56.319512 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.319492    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffae6ab8-9841-47f2-924a-ab7395a1e34d" containerName="console"
Jul 31 20:33:56.323943 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.323919    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.331633 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.331599    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc5664685-mc9xx"]
Jul 31 20:33:56.362718 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.362685    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-console-config\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.362894 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.362722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-852hb\" (UniqueName: \"kubernetes.io/projected/97379182-4588-446f-8a19-9aaf50c96903-kube-api-access-852hb\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.362894 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.362767    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97379182-4588-446f-8a19-9aaf50c96903-console-serving-cert\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.362894 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.362817    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-oauth-serving-cert\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.362894 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.362877    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-service-ca\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.363053 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.362904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-trusted-ca-bundle\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.363053 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.362929    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97379182-4588-446f-8a19-9aaf50c96903-console-oauth-config\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.384711 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.384681    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:33:56.438048 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.438013    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:33:56.464142 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.464112    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-service-ca\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.464142 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.464146    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-trusted-ca-bundle\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.464309 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.464172    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97379182-4588-446f-8a19-9aaf50c96903-console-oauth-config\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.464309 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.464221    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-console-config\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.464309 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.464253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-852hb\" (UniqueName: \"kubernetes.io/projected/97379182-4588-446f-8a19-9aaf50c96903-kube-api-access-852hb\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.464309 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.464282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97379182-4588-446f-8a19-9aaf50c96903-console-serving-cert\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.464309 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.464301    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-oauth-serving-cert\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.464997 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.464972    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-service-ca\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.465283 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.465046    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-oauth-serving-cert\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.465283 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.465079    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-console-config\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.465283 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.465123    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-trusted-ca-bundle\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.467033 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.467002    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97379182-4588-446f-8a19-9aaf50c96903-console-serving-cert\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.467033 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.467021    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97379182-4588-446f-8a19-9aaf50c96903-console-oauth-config\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.471813 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.471791    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-852hb\" (UniqueName: \"kubernetes.io/projected/97379182-4588-446f-8a19-9aaf50c96903-kube-api-access-852hb\") pod \"console-7dc5664685-mc9xx\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") " pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.518957 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.518914    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:33:56.620370 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.620229    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:33:56.635683 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.635660    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:33:56.769928 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.769898    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc5664685-mc9xx"]
Jul 31 20:33:56.773025 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:33:56.772999    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97379182_4588_446f_8a19_9aaf50c96903.slice/crio-84ecb383bf80d2f6e5160579192d084a254e6321fa8892f25a55a06755602161 WatchSource:0}: Error finding container 84ecb383bf80d2f6e5160579192d084a254e6321fa8892f25a55a06755602161: Status 404 returned error can't find the container with id 84ecb383bf80d2f6e5160579192d084a254e6321fa8892f25a55a06755602161
Jul 31 20:33:56.978808 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.978772    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc5664685-mc9xx" event={"ID":"97379182-4588-446f-8a19-9aaf50c96903","Type":"ContainerStarted","Data":"ee893adbe93ea6f05ac277c2b85cc5103476914b6ac40cd68e24ceaa0069d755"}
Jul 31 20:33:56.978979 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.978828    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc5664685-mc9xx" event={"ID":"97379182-4588-446f-8a19-9aaf50c96903","Type":"ContainerStarted","Data":"84ecb383bf80d2f6e5160579192d084a254e6321fa8892f25a55a06755602161"}
Jul 31 20:33:56.995326 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:56.995281    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dc5664685-mc9xx" podStartSLOduration=0.995265779 podStartE2EDuration="995.265779ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:33:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:33:56.994630437 +0000 UTC m=+245.599924823" watchObservedRunningTime="2026-07-31 20:33:56.995265779 +0000 UTC m=+245.600560142"
Jul 31 20:33:57.116772 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:33:57.116724    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:34:04.447617 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:04.447577    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:34:04.982012 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:04.981977    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:34:05.050292 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:05.050256    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:34:06.636722 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:06.636689    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:34:06.637116 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:06.636762    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:34:06.641496 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:06.641475    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:34:07.017415 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:07.017382    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:34:07.055965 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:07.055936    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f974bbc75-wtvh2"]
Jul 31 20:34:07.171712 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:07.171679    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:34:07.272859 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:07.272770    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:34:07.326718 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:07.326685    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:34:11.891957 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:11.891912    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:34:11.981446 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:11.981406    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:34:12.083392 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:12.083362    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:34:12.183281 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:12.183244    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:34:32.076892 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.076829    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f974bbc75-wtvh2" podUID="78cefeff-868a-4644-ab81-d44b569b15fe" containerName="console" containerID="cri-o://705355e01d69ce8ca34ed79e691b7a273670f413c055ef380028c985835af836" gracePeriod=15
Jul 31 20:34:32.310852 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.310829    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:34:32.452106 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.452078    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls8j5\" (UniqueName: \"kubernetes.io/projected/78cefeff-868a-4644-ab81-d44b569b15fe-kube-api-access-ls8j5\") pod \"78cefeff-868a-4644-ab81-d44b569b15fe\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") "
Jul 31 20:34:32.452278 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.452113    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78cefeff-868a-4644-ab81-d44b569b15fe-console-serving-cert\") pod \"78cefeff-868a-4644-ab81-d44b569b15fe\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") "
Jul 31 20:34:32.452278 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.452146    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-oauth-serving-cert\") pod \"78cefeff-868a-4644-ab81-d44b569b15fe\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") "
Jul 31 20:34:32.452278 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.452164    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-trusted-ca-bundle\") pod \"78cefeff-868a-4644-ab81-d44b569b15fe\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") "
Jul 31 20:34:32.452278 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.452190    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78cefeff-868a-4644-ab81-d44b569b15fe-console-oauth-config\") pod \"78cefeff-868a-4644-ab81-d44b569b15fe\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") "
Jul 31 20:34:32.452278 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.452232    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-console-config\") pod \"78cefeff-868a-4644-ab81-d44b569b15fe\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") "
Jul 31 20:34:32.452546 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.452294    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-service-ca\") pod \"78cefeff-868a-4644-ab81-d44b569b15fe\" (UID: \"78cefeff-868a-4644-ab81-d44b569b15fe\") "
Jul 31 20:34:32.452688 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.452654    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "78cefeff-868a-4644-ab81-d44b569b15fe" (UID: "78cefeff-868a-4644-ab81-d44b569b15fe"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:34:32.452688 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.452672    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-service-ca" (OuterVolumeSpecName: "service-ca") pod "78cefeff-868a-4644-ab81-d44b569b15fe" (UID: "78cefeff-868a-4644-ab81-d44b569b15fe"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:34:32.452688 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.452668    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-console-config" (OuterVolumeSpecName: "console-config") pod "78cefeff-868a-4644-ab81-d44b569b15fe" (UID: "78cefeff-868a-4644-ab81-d44b569b15fe"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:34:32.453054 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.452684    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "78cefeff-868a-4644-ab81-d44b569b15fe" (UID: "78cefeff-868a-4644-ab81-d44b569b15fe"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:34:32.453054 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.452858    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-oauth-serving-cert\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:34:32.453054 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.452876    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-trusted-ca-bundle\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:34:32.453054 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.452891    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-console-config\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:34:32.453054 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.452903    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78cefeff-868a-4644-ab81-d44b569b15fe-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:34:32.454437 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.454411    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78cefeff-868a-4644-ab81-d44b569b15fe-kube-api-access-ls8j5" (OuterVolumeSpecName: "kube-api-access-ls8j5") pod "78cefeff-868a-4644-ab81-d44b569b15fe" (UID: "78cefeff-868a-4644-ab81-d44b569b15fe"). InnerVolumeSpecName "kube-api-access-ls8j5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:34:32.454437 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.454414    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78cefeff-868a-4644-ab81-d44b569b15fe-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "78cefeff-868a-4644-ab81-d44b569b15fe" (UID: "78cefeff-868a-4644-ab81-d44b569b15fe"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:34:32.454437 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.454429    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78cefeff-868a-4644-ab81-d44b569b15fe-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "78cefeff-868a-4644-ab81-d44b569b15fe" (UID: "78cefeff-868a-4644-ab81-d44b569b15fe"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:34:32.553568 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.553539    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78cefeff-868a-4644-ab81-d44b569b15fe-console-oauth-config\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:34:32.553568 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.553562    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls8j5\" (UniqueName: \"kubernetes.io/projected/78cefeff-868a-4644-ab81-d44b569b15fe-kube-api-access-ls8j5\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:34:32.553568 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:32.553572    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78cefeff-868a-4644-ab81-d44b569b15fe-console-serving-cert\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:34:33.114327 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:33.114288    2565 generic.go:356] "Generic (PLEG): container finished" podID="78cefeff-868a-4644-ab81-d44b569b15fe" containerID="705355e01d69ce8ca34ed79e691b7a273670f413c055ef380028c985835af836" exitCode=0
Jul 31 20:34:33.114815 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:33.114342    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f974bbc75-wtvh2"
Jul 31 20:34:33.114815 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:33.114373    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f974bbc75-wtvh2" event={"ID":"78cefeff-868a-4644-ab81-d44b569b15fe","Type":"ContainerDied","Data":"705355e01d69ce8ca34ed79e691b7a273670f413c055ef380028c985835af836"}
Jul 31 20:34:33.114815 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:33.114420    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f974bbc75-wtvh2" event={"ID":"78cefeff-868a-4644-ab81-d44b569b15fe","Type":"ContainerDied","Data":"4094e768dd42279c1f0c38fd573a4db6157d01450c0f1699cdf88a12c06792b5"}
Jul 31 20:34:33.114815 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:33.114438    2565 scope.go:117] "RemoveContainer" containerID="705355e01d69ce8ca34ed79e691b7a273670f413c055ef380028c985835af836"
Jul 31 20:34:33.123020 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:33.123004    2565 scope.go:117] "RemoveContainer" containerID="705355e01d69ce8ca34ed79e691b7a273670f413c055ef380028c985835af836"
Jul 31 20:34:33.123311 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:34:33.123293    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"705355e01d69ce8ca34ed79e691b7a273670f413c055ef380028c985835af836\": container with ID starting with 705355e01d69ce8ca34ed79e691b7a273670f413c055ef380028c985835af836 not found: ID does not exist" containerID="705355e01d69ce8ca34ed79e691b7a273670f413c055ef380028c985835af836"
Jul 31 20:34:33.123357 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:33.123323    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"705355e01d69ce8ca34ed79e691b7a273670f413c055ef380028c985835af836"} err="failed to get container status \"705355e01d69ce8ca34ed79e691b7a273670f413c055ef380028c985835af836\": rpc error: code = NotFound desc = could not find container \"705355e01d69ce8ca34ed79e691b7a273670f413c055ef380028c985835af836\": container with ID starting with 705355e01d69ce8ca34ed79e691b7a273670f413c055ef380028c985835af836 not found: ID does not exist"
Jul 31 20:34:33.134050 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:33.134019    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f974bbc75-wtvh2"]
Jul 31 20:34:33.137855 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:33.137831    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f974bbc75-wtvh2"]
Jul 31 20:34:33.913971 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:33.913932    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78cefeff-868a-4644-ab81-d44b569b15fe" path="/var/lib/kubelet/pods/78cefeff-868a-4644-ab81-d44b569b15fe/volumes"
Jul 31 20:34:43.050595 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:43.050558    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:34:43.175679 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:43.175643    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:34:44.428702 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.428666    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk"]
Jul 31 20:34:44.429105 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.428937    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78cefeff-868a-4644-ab81-d44b569b15fe" containerName="console"
Jul 31 20:34:44.429105 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.428948    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="78cefeff-868a-4644-ab81-d44b569b15fe" containerName="console"
Jul 31 20:34:44.429105 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.429028    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="78cefeff-868a-4644-ab81-d44b569b15fe" containerName="console"
Jul 31 20:34:44.431947 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.431931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk"
Jul 31 20:34:44.434247 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.434224    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hdzv2\""
Jul 31 20:34:44.434445 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.434431    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 20:34:44.434839 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.434825    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 20:34:44.445998 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.445975    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk"]
Jul 31 20:34:44.544798 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.544760    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2w9t\" (UniqueName: \"kubernetes.io/projected/35405a20-35be-43b1-affe-446341c6df5f-kube-api-access-j2w9t\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk\" (UID: \"35405a20-35be-43b1-affe-446341c6df5f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk"
Jul 31 20:34:44.544963 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.544818    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35405a20-35be-43b1-affe-446341c6df5f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk\" (UID: \"35405a20-35be-43b1-affe-446341c6df5f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk"
Jul 31 20:34:44.544963 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.544844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35405a20-35be-43b1-affe-446341c6df5f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk\" (UID: \"35405a20-35be-43b1-affe-446341c6df5f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk"
Jul 31 20:34:44.646043 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.646009    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2w9t\" (UniqueName: \"kubernetes.io/projected/35405a20-35be-43b1-affe-446341c6df5f-kube-api-access-j2w9t\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk\" (UID: \"35405a20-35be-43b1-affe-446341c6df5f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk"
Jul 31 20:34:44.646200 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.646056    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35405a20-35be-43b1-affe-446341c6df5f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk\" (UID: \"35405a20-35be-43b1-affe-446341c6df5f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk"
Jul 31 20:34:44.646200 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.646078    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35405a20-35be-43b1-affe-446341c6df5f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk\" (UID: \"35405a20-35be-43b1-affe-446341c6df5f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk"
Jul 31 20:34:44.646422 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.646404    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35405a20-35be-43b1-affe-446341c6df5f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk\" (UID: \"35405a20-35be-43b1-affe-446341c6df5f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk"
Jul 31 20:34:44.646459 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.646424    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35405a20-35be-43b1-affe-446341c6df5f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk\" (UID: \"35405a20-35be-43b1-affe-446341c6df5f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk"
Jul 31 20:34:44.654786 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.654754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2w9t\" (UniqueName: \"kubernetes.io/projected/35405a20-35be-43b1-affe-446341c6df5f-kube-api-access-j2w9t\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk\" (UID: \"35405a20-35be-43b1-affe-446341c6df5f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk"
Jul 31 20:34:44.740607 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.740527    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk"
Jul 31 20:34:44.873401 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:44.873379    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk"]
Jul 31 20:34:44.875860 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:34:44.875832    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35405a20_35be_43b1_affe_446341c6df5f.slice/crio-b463d02bb1d83fe2e4f9c08a6821543e377c225a9dca01517dd8350532cdc846 WatchSource:0}: Error finding container b463d02bb1d83fe2e4f9c08a6821543e377c225a9dca01517dd8350532cdc846: Status 404 returned error can't find the container with id b463d02bb1d83fe2e4f9c08a6821543e377c225a9dca01517dd8350532cdc846
Jul 31 20:34:45.160366 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:45.160264    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk" event={"ID":"35405a20-35be-43b1-affe-446341c6df5f","Type":"ContainerStarted","Data":"b463d02bb1d83fe2e4f9c08a6821543e377c225a9dca01517dd8350532cdc846"}
Jul 31 20:34:51.812571 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:51.812542    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 20:34:51.815004 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:51.814981    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 20:34:51.817510 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:51.817492    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 20:34:51.819547 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:51.819529    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 20:34:51.822256 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:51.822240    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 31 20:34:52.189177 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:52.189140    2565 generic.go:356] "Generic (PLEG): container finished" podID="35405a20-35be-43b1-affe-446341c6df5f" containerID="4f6b097944c46e6da05d8250f3f6a9da84ff12cfad4425e2302d598f830b7be2" exitCode=0
Jul 31 20:34:52.191187 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:52.189231    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk" event={"ID":"35405a20-35be-43b1-affe-446341c6df5f","Type":"ContainerDied","Data":"4f6b097944c46e6da05d8250f3f6a9da84ff12cfad4425e2302d598f830b7be2"}
Jul 31 20:34:55.203246 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:55.203209    2565 generic.go:356] "Generic (PLEG): container finished" podID="35405a20-35be-43b1-affe-446341c6df5f" containerID="6796f7b11166fa344522bebeff8cdc968a60827616959e6e15e2ab0253836840" exitCode=0
Jul 31 20:34:55.203613 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:55.203254    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk" event={"ID":"35405a20-35be-43b1-affe-446341c6df5f","Type":"ContainerDied","Data":"6796f7b11166fa344522bebeff8cdc968a60827616959e6e15e2ab0253836840"}
Jul 31 20:34:55.204350 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:34:55.204332    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 20:35:02.233793 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:02.233755    2565 generic.go:356] "Generic (PLEG): container finished" podID="35405a20-35be-43b1-affe-446341c6df5f" containerID="0460bdaf2b76a20b84fad23859a1b74a3c86e17a5f566a27776c1609768893a6" exitCode=0
Jul 31 20:35:02.234179 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:02.233837    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk" event={"ID":"35405a20-35be-43b1-affe-446341c6df5f","Type":"ContainerDied","Data":"0460bdaf2b76a20b84fad23859a1b74a3c86e17a5f566a27776c1609768893a6"}
Jul 31 20:35:03.361175 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:03.361148    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk"
Jul 31 20:35:03.393933 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:03.393906    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2w9t\" (UniqueName: \"kubernetes.io/projected/35405a20-35be-43b1-affe-446341c6df5f-kube-api-access-j2w9t\") pod \"35405a20-35be-43b1-affe-446341c6df5f\" (UID: \"35405a20-35be-43b1-affe-446341c6df5f\") "
Jul 31 20:35:03.394063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:03.393990    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35405a20-35be-43b1-affe-446341c6df5f-bundle\") pod \"35405a20-35be-43b1-affe-446341c6df5f\" (UID: \"35405a20-35be-43b1-affe-446341c6df5f\") "
Jul 31 20:35:03.394063 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:03.394024    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35405a20-35be-43b1-affe-446341c6df5f-util\") pod \"35405a20-35be-43b1-affe-446341c6df5f\" (UID: \"35405a20-35be-43b1-affe-446341c6df5f\") "
Jul 31 20:35:03.394668 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:03.394606    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35405a20-35be-43b1-affe-446341c6df5f-bundle" (OuterVolumeSpecName: "bundle") pod "35405a20-35be-43b1-affe-446341c6df5f" (UID: "35405a20-35be-43b1-affe-446341c6df5f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:35:03.396288 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:03.396259    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35405a20-35be-43b1-affe-446341c6df5f-kube-api-access-j2w9t" (OuterVolumeSpecName: "kube-api-access-j2w9t") pod "35405a20-35be-43b1-affe-446341c6df5f" (UID: "35405a20-35be-43b1-affe-446341c6df5f"). InnerVolumeSpecName "kube-api-access-j2w9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:35:03.400412 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:03.400386    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35405a20-35be-43b1-affe-446341c6df5f-util" (OuterVolumeSpecName: "util") pod "35405a20-35be-43b1-affe-446341c6df5f" (UID: "35405a20-35be-43b1-affe-446341c6df5f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:35:03.494513 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:03.494444    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35405a20-35be-43b1-affe-446341c6df5f-bundle\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:35:03.494513 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:03.494470    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35405a20-35be-43b1-affe-446341c6df5f-util\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:35:03.494513 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:03.494480    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2w9t\" (UniqueName: \"kubernetes.io/projected/35405a20-35be-43b1-affe-446341c6df5f-kube-api-access-j2w9t\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:35:04.243413 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:04.243376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk" event={"ID":"35405a20-35be-43b1-affe-446341c6df5f","Type":"ContainerDied","Data":"b463d02bb1d83fe2e4f9c08a6821543e377c225a9dca01517dd8350532cdc846"}
Jul 31 20:35:04.243579 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:04.243429    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b463d02bb1d83fe2e4f9c08a6821543e377c225a9dca01517dd8350532cdc846"
Jul 31 20:35:04.243579 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:04.243381    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dn4dk"
Jul 31 20:35:06.144588 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:06.144555    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:35:08.270438 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.270407    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qdpwr"]
Jul 31 20:35:08.270825 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.270690    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35405a20-35be-43b1-affe-446341c6df5f" containerName="util"
Jul 31 20:35:08.270825 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.270702    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="35405a20-35be-43b1-affe-446341c6df5f" containerName="util"
Jul 31 20:35:08.270825 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.270720    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35405a20-35be-43b1-affe-446341c6df5f" containerName="pull"
Jul 31 20:35:08.270825 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.270726    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="35405a20-35be-43b1-affe-446341c6df5f" containerName="pull"
Jul 31 20:35:08.270825 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.270749    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35405a20-35be-43b1-affe-446341c6df5f" containerName="extract"
Jul 31 20:35:08.270825 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.270759    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="35405a20-35be-43b1-affe-446341c6df5f" containerName="extract"
Jul 31 20:35:08.270825 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.270808    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="35405a20-35be-43b1-affe-446341c6df5f" containerName="extract"
Jul 31 20:35:08.273998 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.273977    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qdpwr"
Jul 31 20:35:08.276199 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.276174    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 31 20:35:08.276801 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.276779    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8p59b\""
Jul 31 20:35:08.276978 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.276952    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 31 20:35:08.288202 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.288178    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qdpwr"]
Jul 31 20:35:08.330186 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.330153    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8sdp\" (UniqueName: \"kubernetes.io/projected/e43e8f07-512a-41f5-bb22-69f5dcedf267-kube-api-access-n8sdp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qdpwr\" (UID: \"e43e8f07-512a-41f5-bb22-69f5dcedf267\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qdpwr"
Jul 31 20:35:08.330351 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.330192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e43e8f07-512a-41f5-bb22-69f5dcedf267-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qdpwr\" (UID: \"e43e8f07-512a-41f5-bb22-69f5dcedf267\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qdpwr"
Jul 31 20:35:08.431042 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.431000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8sdp\" (UniqueName: \"kubernetes.io/projected/e43e8f07-512a-41f5-bb22-69f5dcedf267-kube-api-access-n8sdp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qdpwr\" (UID: \"e43e8f07-512a-41f5-bb22-69f5dcedf267\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qdpwr"
Jul 31 20:35:08.431042 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.431044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e43e8f07-512a-41f5-bb22-69f5dcedf267-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qdpwr\" (UID: \"e43e8f07-512a-41f5-bb22-69f5dcedf267\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qdpwr"
Jul 31 20:35:08.431370 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.431356    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e43e8f07-512a-41f5-bb22-69f5dcedf267-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qdpwr\" (UID: \"e43e8f07-512a-41f5-bb22-69f5dcedf267\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qdpwr"
Jul 31 20:35:08.447206 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.447180    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8sdp\" (UniqueName: \"kubernetes.io/projected/e43e8f07-512a-41f5-bb22-69f5dcedf267-kube-api-access-n8sdp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qdpwr\" (UID: \"e43e8f07-512a-41f5-bb22-69f5dcedf267\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qdpwr"
Jul 31 20:35:08.587707 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.587621    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qdpwr"
Jul 31 20:35:08.729661 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:08.729638    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qdpwr"]
Jul 31 20:35:08.731864 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:35:08.731839    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43e8f07_512a_41f5_bb22_69f5dcedf267.slice/crio-992609aeeb0f6507f099d96af9104cea3484ca5a7648e1dc649a22f9c9f37b11 WatchSource:0}: Error finding container 992609aeeb0f6507f099d96af9104cea3484ca5a7648e1dc649a22f9c9f37b11: Status 404 returned error can't find the container with id 992609aeeb0f6507f099d96af9104cea3484ca5a7648e1dc649a22f9c9f37b11
Jul 31 20:35:09.263587 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:09.263553    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qdpwr" event={"ID":"e43e8f07-512a-41f5-bb22-69f5dcedf267","Type":"ContainerStarted","Data":"992609aeeb0f6507f099d96af9104cea3484ca5a7648e1dc649a22f9c9f37b11"}
Jul 31 20:35:10.270340 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:10.270301    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qdpwr" event={"ID":"e43e8f07-512a-41f5-bb22-69f5dcedf267","Type":"ContainerStarted","Data":"99d70aa77dc4d841a8a954c1de8b6dbffc977bbdf604013d9081237e747de5bc"}
Jul 31 20:35:10.297898 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:10.297846    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qdpwr" podStartSLOduration=0.954124731 podStartE2EDuration="2.29782867s" totalImagesPullingTime="1.343703939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:35:10.295391159 +0000 UTC m=+318.900685521" watchObservedRunningTime="2026-07-31 20:35:10.29782867 +0000 UTC m=+318.903123033"
Jul 31 20:35:10.944879 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:10.944842    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:35:11.671115 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.671084    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt"]
Jul 31 20:35:11.673516 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.673493    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt"
Jul 31 20:35:11.676163 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.676141    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 20:35:11.676947 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.676927    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hdzv2\""
Jul 31 20:35:11.677056 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.677023    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 20:35:11.689625 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.689600    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt"]
Jul 31 20:35:11.759225 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.759194    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9312670d-ee79-47ef-9767-4fcba55cfb5a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt\" (UID: \"9312670d-ee79-47ef-9767-4fcba55cfb5a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt"
Jul 31 20:35:11.759398 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.759271    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zcp9\" (UniqueName: \"kubernetes.io/projected/9312670d-ee79-47ef-9767-4fcba55cfb5a-kube-api-access-4zcp9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt\" (UID: \"9312670d-ee79-47ef-9767-4fcba55cfb5a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt"
Jul 31 20:35:11.759398 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.759297    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9312670d-ee79-47ef-9767-4fcba55cfb5a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt\" (UID: \"9312670d-ee79-47ef-9767-4fcba55cfb5a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt"
Jul 31 20:35:11.860692 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.860657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9312670d-ee79-47ef-9767-4fcba55cfb5a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt\" (UID: \"9312670d-ee79-47ef-9767-4fcba55cfb5a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt"
Jul 31 20:35:11.860876 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.860710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zcp9\" (UniqueName: \"kubernetes.io/projected/9312670d-ee79-47ef-9767-4fcba55cfb5a-kube-api-access-4zcp9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt\" (UID: \"9312670d-ee79-47ef-9767-4fcba55cfb5a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt"
Jul 31 20:35:11.860876 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.860754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9312670d-ee79-47ef-9767-4fcba55cfb5a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt\" (UID: \"9312670d-ee79-47ef-9767-4fcba55cfb5a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt"
Jul 31 20:35:11.861067 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.861048    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9312670d-ee79-47ef-9767-4fcba55cfb5a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt\" (UID: \"9312670d-ee79-47ef-9767-4fcba55cfb5a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt"
Jul 31 20:35:11.861106 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.861072    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9312670d-ee79-47ef-9767-4fcba55cfb5a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt\" (UID: \"9312670d-ee79-47ef-9767-4fcba55cfb5a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt"
Jul 31 20:35:11.871968 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.871940    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zcp9\" (UniqueName: \"kubernetes.io/projected/9312670d-ee79-47ef-9767-4fcba55cfb5a-kube-api-access-4zcp9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt\" (UID: \"9312670d-ee79-47ef-9767-4fcba55cfb5a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt"
Jul 31 20:35:11.884450 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.884422    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-28d5p"]
Jul 31 20:35:11.886676 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.886659    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-28d5p"
Jul 31 20:35:11.888811 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.888793    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-44kdk\""
Jul 31 20:35:11.889049 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.889032    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 31 20:35:11.889142 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.889126    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 31 20:35:11.898316 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.898297    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-28d5p"]
Jul 31 20:35:11.961233 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.961208    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b1ac510-f96f-45ed-af41-488496cdec48-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-28d5p\" (UID: \"3b1ac510-f96f-45ed-af41-488496cdec48\") " pod="cert-manager/cert-manager-webhook-6486ffd997-28d5p"
Jul 31 20:35:11.961387 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.961250    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjx4c\" (UniqueName: \"kubernetes.io/projected/3b1ac510-f96f-45ed-af41-488496cdec48-kube-api-access-pjx4c\") pod \"cert-manager-webhook-6486ffd997-28d5p\" (UID: \"3b1ac510-f96f-45ed-af41-488496cdec48\") " pod="cert-manager/cert-manager-webhook-6486ffd997-28d5p"
Jul 31 20:35:11.984690 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:11.984654    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt"
Jul 31 20:35:12.063046 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:12.062484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b1ac510-f96f-45ed-af41-488496cdec48-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-28d5p\" (UID: \"3b1ac510-f96f-45ed-af41-488496cdec48\") " pod="cert-manager/cert-manager-webhook-6486ffd997-28d5p"
Jul 31 20:35:12.063046 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:12.062566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjx4c\" (UniqueName: \"kubernetes.io/projected/3b1ac510-f96f-45ed-af41-488496cdec48-kube-api-access-pjx4c\") pod \"cert-manager-webhook-6486ffd997-28d5p\" (UID: \"3b1ac510-f96f-45ed-af41-488496cdec48\") " pod="cert-manager/cert-manager-webhook-6486ffd997-28d5p"
Jul 31 20:35:12.073979 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:12.073951    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b1ac510-f96f-45ed-af41-488496cdec48-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-28d5p\" (UID: \"3b1ac510-f96f-45ed-af41-488496cdec48\") " pod="cert-manager/cert-manager-webhook-6486ffd997-28d5p"
Jul 31 20:35:12.074633 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:12.074606    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjx4c\" (UniqueName: \"kubernetes.io/projected/3b1ac510-f96f-45ed-af41-488496cdec48-kube-api-access-pjx4c\") pod \"cert-manager-webhook-6486ffd997-28d5p\" (UID: \"3b1ac510-f96f-45ed-af41-488496cdec48\") " pod="cert-manager/cert-manager-webhook-6486ffd997-28d5p"
Jul 31 20:35:12.119346 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:12.119314    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt"]
Jul 31 20:35:12.121996 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:35:12.121966    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9312670d_ee79_47ef_9767_4fcba55cfb5a.slice/crio-39f259b896cf6cbde915dc3bf97a257bb40aebad1d3572ec004f4b185f88cf34 WatchSource:0}: Error finding container 39f259b896cf6cbde915dc3bf97a257bb40aebad1d3572ec004f4b185f88cf34: Status 404 returned error can't find the container with id 39f259b896cf6cbde915dc3bf97a257bb40aebad1d3572ec004f4b185f88cf34
Jul 31 20:35:12.207446 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:12.207405    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-28d5p"
Jul 31 20:35:12.286324 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:12.286289    2565 generic.go:356] "Generic (PLEG): container finished" podID="9312670d-ee79-47ef-9767-4fcba55cfb5a" containerID="a80b073de0cd70f240be9bd969b1bbf7e300f4aed6a157dac6f879a949507ce9" exitCode=0
Jul 31 20:35:12.286501 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:12.286328    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt" event={"ID":"9312670d-ee79-47ef-9767-4fcba55cfb5a","Type":"ContainerDied","Data":"a80b073de0cd70f240be9bd969b1bbf7e300f4aed6a157dac6f879a949507ce9"}
Jul 31 20:35:12.286501 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:12.286414    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt" event={"ID":"9312670d-ee79-47ef-9767-4fcba55cfb5a","Type":"ContainerStarted","Data":"39f259b896cf6cbde915dc3bf97a257bb40aebad1d3572ec004f4b185f88cf34"}
Jul 31 20:35:12.346499 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:12.346476    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-28d5p"]
Jul 31 20:35:12.348857 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:35:12.348824    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b1ac510_f96f_45ed_af41_488496cdec48.slice/crio-d11fb7b8504aed751fdf312e7a1e1feb52e5cd6435e3fba6b07ae3d6d312c7f7 WatchSource:0}: Error finding container d11fb7b8504aed751fdf312e7a1e1feb52e5cd6435e3fba6b07ae3d6d312c7f7: Status 404 returned error can't find the container with id d11fb7b8504aed751fdf312e7a1e1feb52e5cd6435e3fba6b07ae3d6d312c7f7
Jul 31 20:35:12.913227 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:12.913190    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:35:13.292606 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:13.292566    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-28d5p" event={"ID":"3b1ac510-f96f-45ed-af41-488496cdec48","Type":"ContainerStarted","Data":"d11fb7b8504aed751fdf312e7a1e1feb52e5cd6435e3fba6b07ae3d6d312c7f7"}
Jul 31 20:35:13.344223 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:13.344194    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:35:15.302799 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:15.302724    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-28d5p" event={"ID":"3b1ac510-f96f-45ed-af41-488496cdec48","Type":"ContainerStarted","Data":"6835adefcd2de77e85eb225049c2c08eb7dd9cac019df0078a00a47f42a1f5d9"}
Jul 31 20:35:15.303162 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:15.302841    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-28d5p"
Jul 31 20:35:15.318401 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:15.318354    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-28d5p" podStartSLOduration=1.745621665 podStartE2EDuration="4.318340701s" totalImagesPullingTime="2.572719036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:35:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:35:15.317971006 +0000 UTC m=+323.923265369" watchObservedRunningTime="2026-07-31 20:35:15.318340701 +0000 UTC m=+323.923635063"
Jul 31 20:35:16.486284 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:16.486250    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:35:16.586173 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:16.586138    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:35:20.918789 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:20.918756    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:35:21.309578 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:21.309542    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-28d5p"
Jul 31 20:35:23.876681 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:23.876637    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:35:23.944598 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:23.944560    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:35:35.389403 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:35.389368    2565 generic.go:356] "Generic (PLEG): container finished" podID="9312670d-ee79-47ef-9767-4fcba55cfb5a" containerID="811eab8aee6a4e377d1c8bc803da430722a016c08a788894f52b52f71b311053" exitCode=0
Jul 31 20:35:35.389864 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:35.389453    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt" event={"ID":"9312670d-ee79-47ef-9767-4fcba55cfb5a","Type":"ContainerDied","Data":"811eab8aee6a4e377d1c8bc803da430722a016c08a788894f52b52f71b311053"}
Jul 31 20:35:36.396265 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:36.396229    2565 generic.go:356] "Generic (PLEG): container finished" podID="9312670d-ee79-47ef-9767-4fcba55cfb5a" containerID="91d3909cacb1eba5ce6821eab67543a7907b8e83f681b78e60b7554a021e360a" exitCode=0
Jul 31 20:35:36.396647 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:36.396313    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt" event={"ID":"9312670d-ee79-47ef-9767-4fcba55cfb5a","Type":"ContainerDied","Data":"91d3909cacb1eba5ce6821eab67543a7907b8e83f681b78e60b7554a021e360a"}
Jul 31 20:35:37.521903 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:37.521879    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt"
Jul 31 20:35:37.569470 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:37.569442    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9312670d-ee79-47ef-9767-4fcba55cfb5a-util\") pod \"9312670d-ee79-47ef-9767-4fcba55cfb5a\" (UID: \"9312670d-ee79-47ef-9767-4fcba55cfb5a\") "
Jul 31 20:35:37.569610 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:37.569515    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zcp9\" (UniqueName: \"kubernetes.io/projected/9312670d-ee79-47ef-9767-4fcba55cfb5a-kube-api-access-4zcp9\") pod \"9312670d-ee79-47ef-9767-4fcba55cfb5a\" (UID: \"9312670d-ee79-47ef-9767-4fcba55cfb5a\") "
Jul 31 20:35:37.569610 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:37.569549    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9312670d-ee79-47ef-9767-4fcba55cfb5a-bundle\") pod \"9312670d-ee79-47ef-9767-4fcba55cfb5a\" (UID: \"9312670d-ee79-47ef-9767-4fcba55cfb5a\") "
Jul 31 20:35:37.569983 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:37.569960    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9312670d-ee79-47ef-9767-4fcba55cfb5a-bundle" (OuterVolumeSpecName: "bundle") pod "9312670d-ee79-47ef-9767-4fcba55cfb5a" (UID: "9312670d-ee79-47ef-9767-4fcba55cfb5a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:35:37.571774 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:37.571748    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9312670d-ee79-47ef-9767-4fcba55cfb5a-kube-api-access-4zcp9" (OuterVolumeSpecName: "kube-api-access-4zcp9") pod "9312670d-ee79-47ef-9767-4fcba55cfb5a" (UID: "9312670d-ee79-47ef-9767-4fcba55cfb5a"). InnerVolumeSpecName "kube-api-access-4zcp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:35:37.574210 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:37.574190    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9312670d-ee79-47ef-9767-4fcba55cfb5a-util" (OuterVolumeSpecName: "util") pod "9312670d-ee79-47ef-9767-4fcba55cfb5a" (UID: "9312670d-ee79-47ef-9767-4fcba55cfb5a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:35:37.671064 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:37.670985    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9312670d-ee79-47ef-9767-4fcba55cfb5a-bundle\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:35:37.671064 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:37.671021    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9312670d-ee79-47ef-9767-4fcba55cfb5a-util\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:35:37.671064 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:37.671032    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zcp9\" (UniqueName: \"kubernetes.io/projected/9312670d-ee79-47ef-9767-4fcba55cfb5a-kube-api-access-4zcp9\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:35:38.407906 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:38.407875    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt"
Jul 31 20:35:38.407906 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:38.407892    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcgqvt" event={"ID":"9312670d-ee79-47ef-9767-4fcba55cfb5a","Type":"ContainerDied","Data":"39f259b896cf6cbde915dc3bf97a257bb40aebad1d3572ec004f4b185f88cf34"}
Jul 31 20:35:38.408102 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:38.407935    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39f259b896cf6cbde915dc3bf97a257bb40aebad1d3572ec004f4b185f88cf34"
Jul 31 20:35:43.668860 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:43.668785    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:35:43.763111 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:43.763079    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:35:45.095445 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.095413    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cgtdh"]
Jul 31 20:35:45.095844 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.095677    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9312670d-ee79-47ef-9767-4fcba55cfb5a" containerName="util"
Jul 31 20:35:45.095844 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.095687    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9312670d-ee79-47ef-9767-4fcba55cfb5a" containerName="util"
Jul 31 20:35:45.095844 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.095694    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9312670d-ee79-47ef-9767-4fcba55cfb5a" containerName="extract"
Jul 31 20:35:45.095844 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.095700    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9312670d-ee79-47ef-9767-4fcba55cfb5a" containerName="extract"
Jul 31 20:35:45.095844 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.095719    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9312670d-ee79-47ef-9767-4fcba55cfb5a" containerName="pull"
Jul 31 20:35:45.095844 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.095725    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9312670d-ee79-47ef-9767-4fcba55cfb5a" containerName="pull"
Jul 31 20:35:45.095844 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.095793    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9312670d-ee79-47ef-9767-4fcba55cfb5a" containerName="extract"
Jul 31 20:35:45.098374 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.098358    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cgtdh"
Jul 31 20:35:45.100241 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.100215    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 31 20:35:45.100375 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.100279    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zzzc9\""
Jul 31 20:35:45.100662 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.100644    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 31 20:35:45.106136 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.106115    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cgtdh"]
Jul 31 20:35:45.235513 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.235468    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/141de2d6-c064-4611-a316-9fb2439f68f6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cgtdh\" (UID: \"141de2d6-c064-4611-a316-9fb2439f68f6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cgtdh"
Jul 31 20:35:45.235513 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.235518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4hg7\" (UniqueName: \"kubernetes.io/projected/141de2d6-c064-4611-a316-9fb2439f68f6-kube-api-access-m4hg7\") pod \"openshift-lws-operator-fd8ccff4c-cgtdh\" (UID: \"141de2d6-c064-4611-a316-9fb2439f68f6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cgtdh"
Jul 31 20:35:45.336435 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.336400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/141de2d6-c064-4611-a316-9fb2439f68f6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cgtdh\" (UID: \"141de2d6-c064-4611-a316-9fb2439f68f6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cgtdh"
Jul 31 20:35:45.336554 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.336450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4hg7\" (UniqueName: \"kubernetes.io/projected/141de2d6-c064-4611-a316-9fb2439f68f6-kube-api-access-m4hg7\") pod \"openshift-lws-operator-fd8ccff4c-cgtdh\" (UID: \"141de2d6-c064-4611-a316-9fb2439f68f6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cgtdh"
Jul 31 20:35:45.336874 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.336854    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/141de2d6-c064-4611-a316-9fb2439f68f6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cgtdh\" (UID: \"141de2d6-c064-4611-a316-9fb2439f68f6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cgtdh"
Jul 31 20:35:45.344299 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.344272    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4hg7\" (UniqueName: \"kubernetes.io/projected/141de2d6-c064-4611-a316-9fb2439f68f6-kube-api-access-m4hg7\") pod \"openshift-lws-operator-fd8ccff4c-cgtdh\" (UID: \"141de2d6-c064-4611-a316-9fb2439f68f6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cgtdh"
Jul 31 20:35:45.408830 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.408719    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cgtdh"
Jul 31 20:35:45.539158 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:45.539111    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cgtdh"]
Jul 31 20:35:45.541706 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:35:45.541675    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod141de2d6_c064_4611_a316_9fb2439f68f6.slice/crio-eeb8d8dbb190c3559adabce1e5ed30b4bf36af272b401b1cdf65bb1e1cfc7161 WatchSource:0}: Error finding container eeb8d8dbb190c3559adabce1e5ed30b4bf36af272b401b1cdf65bb1e1cfc7161: Status 404 returned error can't find the container with id eeb8d8dbb190c3559adabce1e5ed30b4bf36af272b401b1cdf65bb1e1cfc7161
Jul 31 20:35:46.442894 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:46.442860    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cgtdh" event={"ID":"141de2d6-c064-4611-a316-9fb2439f68f6","Type":"ContainerStarted","Data":"eeb8d8dbb190c3559adabce1e5ed30b4bf36af272b401b1cdf65bb1e1cfc7161"}
Jul 31 20:35:47.449050 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:47.449014    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cgtdh" event={"ID":"141de2d6-c064-4611-a316-9fb2439f68f6","Type":"ContainerStarted","Data":"558bac2976208baee7e8989e017fb66ea351dda6dc68039967205515d5def0a8"}
Jul 31 20:35:47.464658 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:47.464610    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cgtdh" podStartSLOduration=0.683536528 podStartE2EDuration="2.464588424s" totalImagesPullingTime="1.781051896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:35:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:35:47.463964602 +0000 UTC m=+356.069258965" watchObservedRunningTime="2026-07-31 20:35:47.464588424 +0000 UTC m=+356.069882791"
Jul 31 20:35:48.228318 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:48.228279    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:35:48.330365 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:48.330332    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:35:50.479008 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:50.478974    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh"]
Jul 31 20:35:50.482385 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:50.482366    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh"
Jul 31 20:35:50.484500 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:50.484474    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 20:35:50.484660 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:50.484527    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 20:35:50.484660 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:50.484535    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hdzv2\""
Jul 31 20:35:50.490079 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:50.490051    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh"]
Jul 31 20:35:50.490403 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:50.490360    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:35:50.580061 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:50.580027    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js6lp\" (UniqueName: \"kubernetes.io/projected/e3fe4830-578c-4fba-a975-d27966175cae-kube-api-access-js6lp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh\" (UID: \"e3fe4830-578c-4fba-a975-d27966175cae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh"
Jul 31 20:35:50.580257 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:50.580080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3fe4830-578c-4fba-a975-d27966175cae-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh\" (UID: \"e3fe4830-578c-4fba-a975-d27966175cae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh"
Jul 31 20:35:50.580257 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:50.580111    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3fe4830-578c-4fba-a975-d27966175cae-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh\" (UID: \"e3fe4830-578c-4fba-a975-d27966175cae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh"
Jul 31 20:35:50.681321 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:50.681287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js6lp\" (UniqueName: \"kubernetes.io/projected/e3fe4830-578c-4fba-a975-d27966175cae-kube-api-access-js6lp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh\" (UID: \"e3fe4830-578c-4fba-a975-d27966175cae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh"
Jul 31 20:35:50.681506 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:50.681344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3fe4830-578c-4fba-a975-d27966175cae-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh\" (UID: \"e3fe4830-578c-4fba-a975-d27966175cae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh"
Jul 31 20:35:50.681506 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:50.681365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3fe4830-578c-4fba-a975-d27966175cae-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh\" (UID: \"e3fe4830-578c-4fba-a975-d27966175cae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh"
Jul 31 20:35:50.681796 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:50.681779    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3fe4830-578c-4fba-a975-d27966175cae-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh\" (UID: \"e3fe4830-578c-4fba-a975-d27966175cae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh"
Jul 31 20:35:50.681862 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:50.681778    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3fe4830-578c-4fba-a975-d27966175cae-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh\" (UID: \"e3fe4830-578c-4fba-a975-d27966175cae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh"
Jul 31 20:35:50.689417 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:50.689397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js6lp\" (UniqueName: \"kubernetes.io/projected/e3fe4830-578c-4fba-a975-d27966175cae-kube-api-access-js6lp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh\" (UID: \"e3fe4830-578c-4fba-a975-d27966175cae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh"
Jul 31 20:35:50.792765 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:50.792674    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh"
Jul 31 20:35:50.923212 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:50.923176    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh"]
Jul 31 20:35:50.926467 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:35:50.926437    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3fe4830_578c_4fba_a975_d27966175cae.slice/crio-f1fcc1c4025009d67e9025dc274b50a3064643830548694e242f4619f0a95e6d WatchSource:0}: Error finding container f1fcc1c4025009d67e9025dc274b50a3064643830548694e242f4619f0a95e6d: Status 404 returned error can't find the container with id f1fcc1c4025009d67e9025dc274b50a3064643830548694e242f4619f0a95e6d
Jul 31 20:35:51.467814 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:51.467779    2565 generic.go:356] "Generic (PLEG): container finished" podID="e3fe4830-578c-4fba-a975-d27966175cae" containerID="862b8dc631ae9c55ec35ce159b8ac81e4200bd7997281600a942a795bea0e8b7" exitCode=0
Jul 31 20:35:51.467982 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:51.467869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh" event={"ID":"e3fe4830-578c-4fba-a975-d27966175cae","Type":"ContainerDied","Data":"862b8dc631ae9c55ec35ce159b8ac81e4200bd7997281600a942a795bea0e8b7"}
Jul 31 20:35:51.467982 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:51.467920    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh" event={"ID":"e3fe4830-578c-4fba-a975-d27966175cae","Type":"ContainerStarted","Data":"f1fcc1c4025009d67e9025dc274b50a3064643830548694e242f4619f0a95e6d"}
Jul 31 20:35:52.474233 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:52.474199    2565 generic.go:356] "Generic (PLEG): container finished" podID="e3fe4830-578c-4fba-a975-d27966175cae" containerID="4e02199572a50e493e4c342783d86968f6ff6c1fb718951b82c613eb9a360de3" exitCode=0
Jul 31 20:35:52.474581 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:52.474251    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh" event={"ID":"e3fe4830-578c-4fba-a975-d27966175cae","Type":"ContainerDied","Data":"4e02199572a50e493e4c342783d86968f6ff6c1fb718951b82c613eb9a360de3"}
Jul 31 20:35:53.480141 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:53.480109    2565 generic.go:356] "Generic (PLEG): container finished" podID="e3fe4830-578c-4fba-a975-d27966175cae" containerID="455e3109259f4a767924946416249a0e5530914c38b1874f40b700166a35fd00" exitCode=0
Jul 31 20:35:53.480547 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:53.480152    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh" event={"ID":"e3fe4830-578c-4fba-a975-d27966175cae","Type":"ContainerDied","Data":"455e3109259f4a767924946416249a0e5530914c38b1874f40b700166a35fd00"}
Jul 31 20:35:54.615600 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.615571    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh"
Jul 31 20:35:54.716357 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.716313    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3fe4830-578c-4fba-a975-d27966175cae-bundle\") pod \"e3fe4830-578c-4fba-a975-d27966175cae\" (UID: \"e3fe4830-578c-4fba-a975-d27966175cae\") "
Jul 31 20:35:54.716520 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.716367    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js6lp\" (UniqueName: \"kubernetes.io/projected/e3fe4830-578c-4fba-a975-d27966175cae-kube-api-access-js6lp\") pod \"e3fe4830-578c-4fba-a975-d27966175cae\" (UID: \"e3fe4830-578c-4fba-a975-d27966175cae\") "
Jul 31 20:35:54.716520 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.716404    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3fe4830-578c-4fba-a975-d27966175cae-util\") pod \"e3fe4830-578c-4fba-a975-d27966175cae\" (UID: \"e3fe4830-578c-4fba-a975-d27966175cae\") "
Jul 31 20:35:54.717298 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.717262    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3fe4830-578c-4fba-a975-d27966175cae-bundle" (OuterVolumeSpecName: "bundle") pod "e3fe4830-578c-4fba-a975-d27966175cae" (UID: "e3fe4830-578c-4fba-a975-d27966175cae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:35:54.718619 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.718591    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3fe4830-578c-4fba-a975-d27966175cae-kube-api-access-js6lp" (OuterVolumeSpecName: "kube-api-access-js6lp") pod "e3fe4830-578c-4fba-a975-d27966175cae" (UID: "e3fe4830-578c-4fba-a975-d27966175cae"). InnerVolumeSpecName "kube-api-access-js6lp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:35:54.722223 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.722196    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3fe4830-578c-4fba-a975-d27966175cae-util" (OuterVolumeSpecName: "util") pod "e3fe4830-578c-4fba-a975-d27966175cae" (UID: "e3fe4830-578c-4fba-a975-d27966175cae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:35:54.742800 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.742710    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:35:54.804459 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.804423    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"]
Jul 31 20:35:54.804713 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.804700    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3fe4830-578c-4fba-a975-d27966175cae" containerName="util"
Jul 31 20:35:54.804784 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.804715    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3fe4830-578c-4fba-a975-d27966175cae" containerName="util"
Jul 31 20:35:54.804784 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.804726    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3fe4830-578c-4fba-a975-d27966175cae" containerName="pull"
Jul 31 20:35:54.804784 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.804758    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3fe4830-578c-4fba-a975-d27966175cae" containerName="pull"
Jul 31 20:35:54.804784 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.804770    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3fe4830-578c-4fba-a975-d27966175cae" containerName="extract"
Jul 31 20:35:54.804784 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.804775    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3fe4830-578c-4fba-a975-d27966175cae" containerName="extract"
Jul 31 20:35:54.804935 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.804825    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3fe4830-578c-4fba-a975-d27966175cae" containerName="extract"
Jul 31 20:35:54.807636 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.807619    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"
Jul 31 20:35:54.809665 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.809638    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 31 20:35:54.809873 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.809715    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 31 20:35:54.809873 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.809799    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 31 20:35:54.809873 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.809808    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-g6mj8\""
Jul 31 20:35:54.817172 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.817020    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3fe4830-578c-4fba-a975-d27966175cae-bundle\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:35:54.817172 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.817048    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js6lp\" (UniqueName: \"kubernetes.io/projected/e3fe4830-578c-4fba-a975-d27966175cae-kube-api-access-js6lp\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:35:54.817172 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.817063    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3fe4830-578c-4fba-a975-d27966175cae-util\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:35:54.818654 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.818634    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"]
Jul 31 20:35:54.821634 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.821614    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:35:54.917889 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.917849    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/175cc4e2-895f-4318-9b34-04cb812d9300-manager-config\") pod \"lws-controller-manager-595ffc7687-jnprh\" (UID: \"175cc4e2-895f-4318-9b34-04cb812d9300\") " pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"
Jul 31 20:35:54.917889 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.917893    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/175cc4e2-895f-4318-9b34-04cb812d9300-cert\") pod \"lws-controller-manager-595ffc7687-jnprh\" (UID: \"175cc4e2-895f-4318-9b34-04cb812d9300\") " pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"
Jul 31 20:35:54.918118 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.917961    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/175cc4e2-895f-4318-9b34-04cb812d9300-metrics-cert\") pod \"lws-controller-manager-595ffc7687-jnprh\" (UID: \"175cc4e2-895f-4318-9b34-04cb812d9300\") " pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"
Jul 31 20:35:54.918118 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:54.917982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfdzx\" (UniqueName: \"kubernetes.io/projected/175cc4e2-895f-4318-9b34-04cb812d9300-kube-api-access-lfdzx\") pod \"lws-controller-manager-595ffc7687-jnprh\" (UID: \"175cc4e2-895f-4318-9b34-04cb812d9300\") " pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"
Jul 31 20:35:55.019103 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:55.019019    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/175cc4e2-895f-4318-9b34-04cb812d9300-cert\") pod \"lws-controller-manager-595ffc7687-jnprh\" (UID: \"175cc4e2-895f-4318-9b34-04cb812d9300\") " pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"
Jul 31 20:35:55.019266 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:55.019158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/175cc4e2-895f-4318-9b34-04cb812d9300-metrics-cert\") pod \"lws-controller-manager-595ffc7687-jnprh\" (UID: \"175cc4e2-895f-4318-9b34-04cb812d9300\") " pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"
Jul 31 20:35:55.019266 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:55.019202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfdzx\" (UniqueName: \"kubernetes.io/projected/175cc4e2-895f-4318-9b34-04cb812d9300-kube-api-access-lfdzx\") pod \"lws-controller-manager-595ffc7687-jnprh\" (UID: \"175cc4e2-895f-4318-9b34-04cb812d9300\") " pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"
Jul 31 20:35:55.019383 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:55.019296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/175cc4e2-895f-4318-9b34-04cb812d9300-manager-config\") pod \"lws-controller-manager-595ffc7687-jnprh\" (UID: \"175cc4e2-895f-4318-9b34-04cb812d9300\") " pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"
Jul 31 20:35:55.019974 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:55.019943    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/175cc4e2-895f-4318-9b34-04cb812d9300-manager-config\") pod \"lws-controller-manager-595ffc7687-jnprh\" (UID: \"175cc4e2-895f-4318-9b34-04cb812d9300\") " pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"
Jul 31 20:35:55.021748 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:55.021709    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/175cc4e2-895f-4318-9b34-04cb812d9300-metrics-cert\") pod \"lws-controller-manager-595ffc7687-jnprh\" (UID: \"175cc4e2-895f-4318-9b34-04cb812d9300\") " pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"
Jul 31 20:35:55.021833 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:55.021764    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/175cc4e2-895f-4318-9b34-04cb812d9300-cert\") pod \"lws-controller-manager-595ffc7687-jnprh\" (UID: \"175cc4e2-895f-4318-9b34-04cb812d9300\") " pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"
Jul 31 20:35:55.026699 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:55.026680    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfdzx\" (UniqueName: \"kubernetes.io/projected/175cc4e2-895f-4318-9b34-04cb812d9300-kube-api-access-lfdzx\") pod \"lws-controller-manager-595ffc7687-jnprh\" (UID: \"175cc4e2-895f-4318-9b34-04cb812d9300\") " pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"
Jul 31 20:35:55.117085 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:55.117049    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"
Jul 31 20:35:55.252761 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:55.252718    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"]
Jul 31 20:35:55.255100 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:35:55.255076    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod175cc4e2_895f_4318_9b34_04cb812d9300.slice/crio-8591acd0a745614577151930bfc9cfcfd453516c2dde8167074b40bf566eb3b0 WatchSource:0}: Error finding container 8591acd0a745614577151930bfc9cfcfd453516c2dde8167074b40bf566eb3b0: Status 404 returned error can't find the container with id 8591acd0a745614577151930bfc9cfcfd453516c2dde8167074b40bf566eb3b0
Jul 31 20:35:55.490982 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:55.490948    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh" event={"ID":"175cc4e2-895f-4318-9b34-04cb812d9300","Type":"ContainerStarted","Data":"8591acd0a745614577151930bfc9cfcfd453516c2dde8167074b40bf566eb3b0"}
Jul 31 20:35:55.492859 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:55.492841    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh"
Jul 31 20:35:55.492937 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:55.492854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af27qzh" event={"ID":"e3fe4830-578c-4fba-a975-d27966175cae","Type":"ContainerDied","Data":"f1fcc1c4025009d67e9025dc274b50a3064643830548694e242f4619f0a95e6d"}
Jul 31 20:35:55.492937 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:55.492889    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1fcc1c4025009d67e9025dc274b50a3064643830548694e242f4619f0a95e6d"
Jul 31 20:35:58.556599 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:58.556560    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:35:58.609716 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:58.609681    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:35:59.517476 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:59.517441    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh" event={"ID":"175cc4e2-895f-4318-9b34-04cb812d9300","Type":"ContainerStarted","Data":"363c4a75c3cb80d45d7fa41f21de5e528fdb9fa6e4b9fc81d93560786ef07213"}
Jul 31 20:35:59.517650 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:59.517559    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"
Jul 31 20:35:59.531725 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:35:59.531672    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh" podStartSLOduration=1.998289367 podStartE2EDuration="5.53165875s" totalImagesPullingTime="3.533369383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:35:59.530932742 +0000 UTC m=+368.136227106" watchObservedRunningTime="2026-07-31 20:35:59.53165875 +0000 UTC m=+368.136953112"
Jul 31 20:36:07.016705 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:07.016672    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:07.109981 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:07.109938    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:07.614432 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:07.614403    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:07.931975 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:07.931941    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:08.015647 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.015616    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"]
Jul 31 20:36:08.022564 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.022534    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:08.024876 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.024849    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-66k6x\""
Jul 31 20:36:08.024992 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.024893    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 31 20:36:08.024992 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.024852    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 31 20:36:08.024992 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.024981    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 31 20:36:08.025110 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.025102    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 31 20:36:08.037678 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.037648    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"]
Jul 31 20:36:08.043722 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.043696    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:08.121048 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.121009    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92tc9\" (UniqueName: \"kubernetes.io/projected/888fa80c-242a-489f-bf27-e61948de6262-kube-api-access-92tc9\") pod \"opendatahub-operator-controller-manager-786d856849-fr5cl\" (UID: \"888fa80c-242a-489f-bf27-e61948de6262\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:08.121048 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.121049    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/888fa80c-242a-489f-bf27-e61948de6262-apiservice-cert\") pod \"opendatahub-operator-controller-manager-786d856849-fr5cl\" (UID: \"888fa80c-242a-489f-bf27-e61948de6262\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:08.121257 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.121071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/888fa80c-242a-489f-bf27-e61948de6262-webhook-cert\") pod \"opendatahub-operator-controller-manager-786d856849-fr5cl\" (UID: \"888fa80c-242a-489f-bf27-e61948de6262\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:08.121257 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.121150    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/888fa80c-242a-489f-bf27-e61948de6262-manifests\") pod \"opendatahub-operator-controller-manager-786d856849-fr5cl\" (UID: \"888fa80c-242a-489f-bf27-e61948de6262\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:08.121257 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.121186    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/888fa80c-242a-489f-bf27-e61948de6262-tmp\") pod \"opendatahub-operator-controller-manager-786d856849-fr5cl\" (UID: \"888fa80c-242a-489f-bf27-e61948de6262\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:08.129108 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.129058    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:08.222118 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.222017    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92tc9\" (UniqueName: \"kubernetes.io/projected/888fa80c-242a-489f-bf27-e61948de6262-kube-api-access-92tc9\") pod \"opendatahub-operator-controller-manager-786d856849-fr5cl\" (UID: \"888fa80c-242a-489f-bf27-e61948de6262\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:08.222118 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.222056    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/888fa80c-242a-489f-bf27-e61948de6262-apiservice-cert\") pod \"opendatahub-operator-controller-manager-786d856849-fr5cl\" (UID: \"888fa80c-242a-489f-bf27-e61948de6262\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:08.222118 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.222079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/888fa80c-242a-489f-bf27-e61948de6262-webhook-cert\") pod \"opendatahub-operator-controller-manager-786d856849-fr5cl\" (UID: \"888fa80c-242a-489f-bf27-e61948de6262\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:08.222118 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.222098    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/888fa80c-242a-489f-bf27-e61948de6262-manifests\") pod \"opendatahub-operator-controller-manager-786d856849-fr5cl\" (UID: \"888fa80c-242a-489f-bf27-e61948de6262\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:08.222438 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.222235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/888fa80c-242a-489f-bf27-e61948de6262-tmp\") pod \"opendatahub-operator-controller-manager-786d856849-fr5cl\" (UID: \"888fa80c-242a-489f-bf27-e61948de6262\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:08.222498 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.222476    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/888fa80c-242a-489f-bf27-e61948de6262-manifests\") pod \"opendatahub-operator-controller-manager-786d856849-fr5cl\" (UID: \"888fa80c-242a-489f-bf27-e61948de6262\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:08.224726 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.224700    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/888fa80c-242a-489f-bf27-e61948de6262-tmp\") pod \"opendatahub-operator-controller-manager-786d856849-fr5cl\" (UID: \"888fa80c-242a-489f-bf27-e61948de6262\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:08.224872 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.224834    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/888fa80c-242a-489f-bf27-e61948de6262-apiservice-cert\") pod \"opendatahub-operator-controller-manager-786d856849-fr5cl\" (UID: \"888fa80c-242a-489f-bf27-e61948de6262\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:08.224940 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.224923    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/888fa80c-242a-489f-bf27-e61948de6262-webhook-cert\") pod \"opendatahub-operator-controller-manager-786d856849-fr5cl\" (UID: \"888fa80c-242a-489f-bf27-e61948de6262\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:08.228839 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.228781    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:08.229350 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.229334    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92tc9\" (UniqueName: \"kubernetes.io/projected/888fa80c-242a-489f-bf27-e61948de6262-kube-api-access-92tc9\") pod \"opendatahub-operator-controller-manager-786d856849-fr5cl\" (UID: \"888fa80c-242a-489f-bf27-e61948de6262\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:08.332633 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.332599    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:08.332869 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.332782    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:08.485043 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.485018    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"]
Jul 31 20:36:08.487564 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:36:08.487527    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod888fa80c_242a_489f_bf27_e61948de6262.slice/crio-8384db7faf9821c343536398590cd07466d1a6fa7b3da54b1874eb2c5c164ad3 WatchSource:0}: Error finding container 8384db7faf9821c343536398590cd07466d1a6fa7b3da54b1874eb2c5c164ad3: Status 404 returned error can't find the container with id 8384db7faf9821c343536398590cd07466d1a6fa7b3da54b1874eb2c5c164ad3
Jul 31 20:36:08.558012 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:08.557975    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl" event={"ID":"888fa80c-242a-489f-bf27-e61948de6262","Type":"ContainerStarted","Data":"8384db7faf9821c343536398590cd07466d1a6fa7b3da54b1874eb2c5c164ad3"}
Jul 31 20:36:09.119342 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:09.119309    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:09.220700 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:09.220639    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:10.524843 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:10.524794    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-595ffc7687-jnprh"
Jul 31 20:36:12.583047 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:12.583012    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl" event={"ID":"888fa80c-242a-489f-bf27-e61948de6262","Type":"ContainerStarted","Data":"8ae9305d25a7201f81e7a1ee4c3e39a00c485694c12cf5c159db19cb3b38ad07"}
Jul 31 20:36:13.588972 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:13.588931    2565 generic.go:356] "Generic (PLEG): container finished" podID="888fa80c-242a-489f-bf27-e61948de6262" containerID="8ae9305d25a7201f81e7a1ee4c3e39a00c485694c12cf5c159db19cb3b38ad07" exitCode=0
Jul 31 20:36:13.589324 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:13.589012    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl" event={"ID":"888fa80c-242a-489f-bf27-e61948de6262","Type":"ContainerDied","Data":"8ae9305d25a7201f81e7a1ee4c3e39a00c485694c12cf5c159db19cb3b38ad07"}
Jul 31 20:36:14.595338 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:14.595299    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl" event={"ID":"888fa80c-242a-489f-bf27-e61948de6262","Type":"ContainerStarted","Data":"35d9ace87a9732b676a84d956a6e22f2a8fbc18fac3cb98096aedf2474aa4c24"}
Jul 31 20:36:14.595823 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:14.595435    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:14.615187 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:14.615137    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl" podStartSLOduration=3.053430491 podStartE2EDuration="7.615121044s" totalImagesPullingTime="3.471318708s" totalInitContainerRuntime="1.090371845s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:36:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:36:14.613262667 +0000 UTC m=+383.218557030" watchObservedRunningTime="2026-07-31 20:36:14.615121044 +0000 UTC m=+383.220415408"
Jul 31 20:36:20.033424 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:20.033385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:20.135397 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:20.135364    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:24.054344 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:24.054308    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:25.602261 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:25.602225    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-786d856849-fr5cl"
Jul 31 20:36:26.101036 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:26.101004    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:26.203859 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:26.203825    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:28.464976 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:28.464944    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:28.582548 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:28.582511    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:28.872791 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:28.872689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:29.164966 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:29.164864    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:29.264208 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:29.264179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:29.363907 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:29.363874    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:29.466529 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:29.466498    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:29.846971 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:29.846891    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:29.970814 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:29.970769    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:30.181701 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:30.181651    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:30.244572 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:30.244540    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:31.175053 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.174993    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:31.285958 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.285929    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76964bb886-c4n5s"]
Jul 31 20:36:31.296332 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.296287    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.301022 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.300993    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76964bb886-c4n5s"]
Jul 31 20:36:31.348107 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.348070    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:31.410188 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.410154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8478f274-b96d-4114-bd30-f6f44d94fd17-service-ca\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.410377 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.410199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8478f274-b96d-4114-bd30-f6f44d94fd17-console-config\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.410377 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.410246    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8478f274-b96d-4114-bd30-f6f44d94fd17-oauth-serving-cert\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.410377 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.410294    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8478f274-b96d-4114-bd30-f6f44d94fd17-console-oauth-config\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.410377 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.410313    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlwlq\" (UniqueName: \"kubernetes.io/projected/8478f274-b96d-4114-bd30-f6f44d94fd17-kube-api-access-vlwlq\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.410377 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.410355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8478f274-b96d-4114-bd30-f6f44d94fd17-console-serving-cert\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.410577 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.410389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8478f274-b96d-4114-bd30-f6f44d94fd17-trusted-ca-bundle\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.511797 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.511763    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8478f274-b96d-4114-bd30-f6f44d94fd17-oauth-serving-cert\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.511994 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.511813    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8478f274-b96d-4114-bd30-f6f44d94fd17-console-oauth-config\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.511994 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.511838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlwlq\" (UniqueName: \"kubernetes.io/projected/8478f274-b96d-4114-bd30-f6f44d94fd17-kube-api-access-vlwlq\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.511994 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.511879    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8478f274-b96d-4114-bd30-f6f44d94fd17-console-serving-cert\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.511994 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.511900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8478f274-b96d-4114-bd30-f6f44d94fd17-trusted-ca-bundle\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.511994 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.511928    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8478f274-b96d-4114-bd30-f6f44d94fd17-service-ca\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.511994 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.511967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8478f274-b96d-4114-bd30-f6f44d94fd17-console-config\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.512677 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.512656    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8478f274-b96d-4114-bd30-f6f44d94fd17-console-config\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.512677 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.512664    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8478f274-b96d-4114-bd30-f6f44d94fd17-oauth-serving-cert\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.512863 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.512845    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8478f274-b96d-4114-bd30-f6f44d94fd17-trusted-ca-bundle\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.512951 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.512929    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8478f274-b96d-4114-bd30-f6f44d94fd17-service-ca\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.514461 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.514436    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8478f274-b96d-4114-bd30-f6f44d94fd17-console-oauth-config\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.514562 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.514540    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8478f274-b96d-4114-bd30-f6f44d94fd17-console-serving-cert\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.519275 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.519253    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlwlq\" (UniqueName: \"kubernetes.io/projected/8478f274-b96d-4114-bd30-f6f44d94fd17-kube-api-access-vlwlq\") pod \"console-76964bb886-c4n5s\" (UID: \"8478f274-b96d-4114-bd30-f6f44d94fd17\") " pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.607275 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.607245    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:31.742849 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:31.742824    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76964bb886-c4n5s"]
Jul 31 20:36:31.744905 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:36:31.744874    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8478f274_b96d_4114_bd30_f6f44d94fd17.slice/crio-da30923796eb18383e0b5b7abbbf057fbde1fbc6ff113b04ff0d3d48c0373225 WatchSource:0}: Error finding container da30923796eb18383e0b5b7abbbf057fbde1fbc6ff113b04ff0d3d48c0373225: Status 404 returned error can't find the container with id da30923796eb18383e0b5b7abbbf057fbde1fbc6ff113b04ff0d3d48c0373225
Jul 31 20:36:32.677595 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:32.677562    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76964bb886-c4n5s" event={"ID":"8478f274-b96d-4114-bd30-f6f44d94fd17","Type":"ContainerStarted","Data":"2b72d5712c9746e7ae43d1a87430a1c82f729aa6fef3cb16e241ca5c3eb53b02"}
Jul 31 20:36:32.677994 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:32.677609    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76964bb886-c4n5s" event={"ID":"8478f274-b96d-4114-bd30-f6f44d94fd17","Type":"ContainerStarted","Data":"da30923796eb18383e0b5b7abbbf057fbde1fbc6ff113b04ff0d3d48c0373225"}
Jul 31 20:36:32.693316 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:32.693274    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76964bb886-c4n5s" podStartSLOduration=1.693257233 podStartE2EDuration="1.693257233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:36:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:36:32.693135804 +0000 UTC m=+401.298430166" watchObservedRunningTime="2026-07-31 20:36:32.693257233 +0000 UTC m=+401.298551595"
Jul 31 20:36:36.422232 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:36.422195    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:36.515964 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:36.515929    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:37.127835 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.127805    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"]
Jul 31 20:36:37.131394 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.131375    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.133497 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.133476    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 31 20:36:37.133497 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.133483    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9jhtp\""
Jul 31 20:36:37.144620 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.144596    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"]
Jul 31 20:36:37.176203 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.176172    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:37.259756 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.259694    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80308491-badf-47ee-b32b-1197787217fc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.259946 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.259765    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80308491-badf-47ee-b32b-1197787217fc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.259946 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.259788    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2458z\" (UniqueName: \"kubernetes.io/projected/80308491-badf-47ee-b32b-1197787217fc-kube-api-access-2458z\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.259946 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.259809    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80308491-badf-47ee-b32b-1197787217fc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.259946 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.259832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80308491-badf-47ee-b32b-1197787217fc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.259946 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.259859    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80308491-badf-47ee-b32b-1197787217fc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.259946 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.259918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80308491-badf-47ee-b32b-1197787217fc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.259946 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.259933    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80308491-badf-47ee-b32b-1197787217fc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.259946 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.259947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80308491-badf-47ee-b32b-1197787217fc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.332249 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.332218    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:37.361114 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.361075    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80308491-badf-47ee-b32b-1197787217fc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.361303 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.361122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80308491-badf-47ee-b32b-1197787217fc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.361303 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.361153    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2458z\" (UniqueName: \"kubernetes.io/projected/80308491-badf-47ee-b32b-1197787217fc-kube-api-access-2458z\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.361303 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.361176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80308491-badf-47ee-b32b-1197787217fc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.361303 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.361208    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80308491-badf-47ee-b32b-1197787217fc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.361303 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.361249    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80308491-badf-47ee-b32b-1197787217fc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.361303 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.361294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80308491-badf-47ee-b32b-1197787217fc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.361603 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.361317    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80308491-badf-47ee-b32b-1197787217fc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.361603 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.361340    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80308491-badf-47ee-b32b-1197787217fc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.361603 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.361549    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80308491-badf-47ee-b32b-1197787217fc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.361791 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.361719    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80308491-badf-47ee-b32b-1197787217fc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.361854 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.361796    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80308491-badf-47ee-b32b-1197787217fc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.361960 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.361941    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80308491-badf-47ee-b32b-1197787217fc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.362018 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.361965    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80308491-badf-47ee-b32b-1197787217fc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.364132 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.364111    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80308491-badf-47ee-b32b-1197787217fc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.364348 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.364327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80308491-badf-47ee-b32b-1197787217fc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.378216 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.378159    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80308491-badf-47ee-b32b-1197787217fc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.393749 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.393705    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2458z\" (UniqueName: \"kubernetes.io/projected/80308491-badf-47ee-b32b-1197787217fc-kube-api-access-2458z\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5\" (UID: \"80308491-badf-47ee-b32b-1197787217fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.441730 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.441694    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:37.470585 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.470554    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:37.576206 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.576182    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"]
Jul 31 20:36:37.578041 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:36:37.578015    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80308491_badf_47ee_b32b_1197787217fc.slice/crio-4ff77f049563c2610c170853e4b495cc104cd353f0defcc07682759c132cf333 WatchSource:0}: Error finding container 4ff77f049563c2610c170853e4b495cc104cd353f0defcc07682759c132cf333: Status 404 returned error can't find the container with id 4ff77f049563c2610c170853e4b495cc104cd353f0defcc07682759c132cf333
Jul 31 20:36:37.701342 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:37.701311    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5" event={"ID":"80308491-badf-47ee-b32b-1197787217fc","Type":"ContainerStarted","Data":"4ff77f049563c2610c170853e4b495cc104cd353f0defcc07682759c132cf333"}
Jul 31 20:36:39.157522 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.157487    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"]
Jul 31 20:36:39.160834 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.160811    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.163083 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.163057    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 31 20:36:39.163192 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.163131    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vfdxx\""
Jul 31 20:36:39.163246 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.163198    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 31 20:36:39.163286 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.163250    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 31 20:36:39.173563 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.173540    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"]
Jul 31 20:36:39.280849 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.280818    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.280849 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.280855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.281114 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.280935    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.281114 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.280960    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.281114 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.281047    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l6xs\" (UniqueName: \"kubernetes.io/projected/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-kube-api-access-7l6xs\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.281114 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.281094    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.281332 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.281139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.382574 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.382535    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.382574 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.382579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.383072 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.382619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l6xs\" (UniqueName: \"kubernetes.io/projected/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-kube-api-access-7l6xs\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.383072 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.382663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.383072 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.382702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.383072 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.382980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.383072 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.383020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.383875 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.383850    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.385467 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.385444    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.385964 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.385940    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.386266 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.386246    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.386471 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.386424    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.398665 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.398610    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l6xs\" (UniqueName: \"kubernetes.io/projected/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-kube-api-access-7l6xs\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.398883 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.398772    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e34a8bb7-0beb-44a2-b666-09931d0bd8ad-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mvtcm\" (UID: \"e34a8bb7-0beb-44a2-b666-09931d0bd8ad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.473179 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.473134    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:39.635570 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:39.635540    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"]
Jul 31 20:36:40.304454 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:40.304396    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:40.402139 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:40.402085    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:40.466924 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:40.466878    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:40.572935 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:36:40.572871    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode34a8bb7_0beb_44a2_b666_09931d0bd8ad.slice/crio-bfcc569907fef585430b2a1e9577c079983a21932400676df8e1eda77844fa4a WatchSource:0}: Error finding container bfcc569907fef585430b2a1e9577c079983a21932400676df8e1eda77844fa4a: Status 404 returned error can't find the container with id bfcc569907fef585430b2a1e9577c079983a21932400676df8e1eda77844fa4a
Jul 31 20:36:40.645218 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:40.645175    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 20:36:40.645326 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:40.645251    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 20:36:40.645326 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:40.645282    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 20:36:40.720805 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:40.720769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5" event={"ID":"80308491-badf-47ee-b32b-1197787217fc","Type":"ContainerStarted","Data":"449b555fd2bfb821d10788bc518586b42fd863df5e67b83cb3344962d3719b18"}
Jul 31 20:36:40.721965 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:40.721943    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm" event={"ID":"e34a8bb7-0beb-44a2-b666-09931d0bd8ad","Type":"ContainerStarted","Data":"bfcc569907fef585430b2a1e9577c079983a21932400676df8e1eda77844fa4a"}
Jul 31 20:36:40.780453 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:40.780422    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:40.784313 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:40.784262    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5" podStartSLOduration=0.719290153 podStartE2EDuration="3.784246763s" totalImagesPullingTime="3.06495661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:36:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:36:40.78224768 +0000 UTC m=+409.387542044" watchObservedRunningTime="2026-07-31 20:36:40.784246763 +0000 UTC m=+409.389541125"
Jul 31 20:36:41.441941 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:41.441900    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:41.447381 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:41.447352    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:41.573031 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:41.572992    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:41.608370 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:41.608341    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:41.608533 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:41.608406    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:41.613686 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:41.613661    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:41.669706 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:41.669670    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:41.728326 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:41.728209    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:41.729351 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:41.729326    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5"
Jul 31 20:36:41.733415 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:41.733383    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76964bb886-c4n5s"
Jul 31 20:36:41.850692 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:41.850660    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:41.862299 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:41.862271    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc5664685-mc9xx"]
Jul 31 20:36:41.988066 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:41.987954    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:42.040721 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:42.040662    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:36:42.834716 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:42.834677    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 20:36:42.835121 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:42.834772    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 20:36:43.746093 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:43.746061    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm" event={"ID":"e34a8bb7-0beb-44a2-b666-09931d0bd8ad","Type":"ContainerStarted","Data":"259de4f0dab28dafb1e3223ebfeb65f40600da67ef10134f664ceb24ba65a029"}
Jul 31 20:36:43.767017 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:43.766964    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm" podStartSLOduration=2.507619996 podStartE2EDuration="4.76694946s" totalImagesPullingTime="2.259329464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:36:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:36:43.765326257 +0000 UTC m=+412.370620621" watchObservedRunningTime="2026-07-31 20:36:43.76694946 +0000 UTC m=+412.372243823"
Jul 31 20:36:44.750536 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:44.750505    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:44.752358 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:44.752338    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mvtcm"
Jul 31 20:36:51.782690 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:36:51.782657    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:06.886555 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:06.886518    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7dc5664685-mc9xx" podUID="97379182-4588-446f-8a19-9aaf50c96903" containerName="console" containerID="cri-o://ee893adbe93ea6f05ac277c2b85cc5103476914b6ac40cd68e24ceaa0069d755" gracePeriod=15
Jul 31 20:37:07.014546 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.014513    2565 patch_prober.go:28] interesting pod/console-7dc5664685-mc9xx container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body=
Jul 31 20:37:07.014695 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.014585    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-7dc5664685-mc9xx" podUID="97379182-4588-446f-8a19-9aaf50c96903" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused"
Jul 31 20:37:07.137866 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.137804    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:37:07.216109 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.216071    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97379182-4588-446f-8a19-9aaf50c96903-console-serving-cert\") pod \"97379182-4588-446f-8a19-9aaf50c96903\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") "
Jul 31 20:37:07.216290 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.216127    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97379182-4588-446f-8a19-9aaf50c96903-console-oauth-config\") pod \"97379182-4588-446f-8a19-9aaf50c96903\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") "
Jul 31 20:37:07.216290 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.216167    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-service-ca\") pod \"97379182-4588-446f-8a19-9aaf50c96903\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") "
Jul 31 20:37:07.216290 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.216233    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-852hb\" (UniqueName: \"kubernetes.io/projected/97379182-4588-446f-8a19-9aaf50c96903-kube-api-access-852hb\") pod \"97379182-4588-446f-8a19-9aaf50c96903\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") "
Jul 31 20:37:07.216401 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.216357    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-oauth-serving-cert\") pod \"97379182-4588-446f-8a19-9aaf50c96903\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") "
Jul 31 20:37:07.216447 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.216413    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-trusted-ca-bundle\") pod \"97379182-4588-446f-8a19-9aaf50c96903\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") "
Jul 31 20:37:07.216647 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.216625    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-console-config\") pod \"97379182-4588-446f-8a19-9aaf50c96903\" (UID: \"97379182-4588-446f-8a19-9aaf50c96903\") "
Jul 31 20:37:07.216960 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.216669    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-service-ca" (OuterVolumeSpecName: "service-ca") pod "97379182-4588-446f-8a19-9aaf50c96903" (UID: "97379182-4588-446f-8a19-9aaf50c96903"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:37:07.216960 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.216688    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "97379182-4588-446f-8a19-9aaf50c96903" (UID: "97379182-4588-446f-8a19-9aaf50c96903"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:37:07.216960 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.216787    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "97379182-4588-446f-8a19-9aaf50c96903" (UID: "97379182-4588-446f-8a19-9aaf50c96903"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:37:07.216960 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.216988    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-console-config" (OuterVolumeSpecName: "console-config") pod "97379182-4588-446f-8a19-9aaf50c96903" (UID: "97379182-4588-446f-8a19-9aaf50c96903"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:37:07.217477 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.217461    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-oauth-serving-cert\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:07.217477 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.217478    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-trusted-ca-bundle\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:07.217600 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.217487    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-console-config\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:07.217600 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.217496    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97379182-4588-446f-8a19-9aaf50c96903-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:07.218570 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.218549    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97379182-4588-446f-8a19-9aaf50c96903-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "97379182-4588-446f-8a19-9aaf50c96903" (UID: "97379182-4588-446f-8a19-9aaf50c96903"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:37:07.219062 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.219035    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97379182-4588-446f-8a19-9aaf50c96903-kube-api-access-852hb" (OuterVolumeSpecName: "kube-api-access-852hb") pod "97379182-4588-446f-8a19-9aaf50c96903" (UID: "97379182-4588-446f-8a19-9aaf50c96903"). InnerVolumeSpecName "kube-api-access-852hb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:37:07.219062 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.219033    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97379182-4588-446f-8a19-9aaf50c96903-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "97379182-4588-446f-8a19-9aaf50c96903" (UID: "97379182-4588-446f-8a19-9aaf50c96903"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:37:07.318448 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.318419    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97379182-4588-446f-8a19-9aaf50c96903-console-serving-cert\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:07.318448 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.318444    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97379182-4588-446f-8a19-9aaf50c96903-console-oauth-config\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:07.318448 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.318454    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-852hb\" (UniqueName: \"kubernetes.io/projected/97379182-4588-446f-8a19-9aaf50c96903-kube-api-access-852hb\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:07.857543 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.857508    2565 generic.go:356] "Generic (PLEG): container finished" podID="97379182-4588-446f-8a19-9aaf50c96903" containerID="ee893adbe93ea6f05ac277c2b85cc5103476914b6ac40cd68e24ceaa0069d755" exitCode=0
Jul 31 20:37:07.857759 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.857553    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc5664685-mc9xx" event={"ID":"97379182-4588-446f-8a19-9aaf50c96903","Type":"ContainerDied","Data":"ee893adbe93ea6f05ac277c2b85cc5103476914b6ac40cd68e24ceaa0069d755"}
Jul 31 20:37:07.857759 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.857557    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc5664685-mc9xx"
Jul 31 20:37:07.857759 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.857595    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc5664685-mc9xx" event={"ID":"97379182-4588-446f-8a19-9aaf50c96903","Type":"ContainerDied","Data":"84ecb383bf80d2f6e5160579192d084a254e6321fa8892f25a55a06755602161"}
Jul 31 20:37:07.857759 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.857615    2565 scope.go:117] "RemoveContainer" containerID="ee893adbe93ea6f05ac277c2b85cc5103476914b6ac40cd68e24ceaa0069d755"
Jul 31 20:37:07.867115 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.867098    2565 scope.go:117] "RemoveContainer" containerID="ee893adbe93ea6f05ac277c2b85cc5103476914b6ac40cd68e24ceaa0069d755"
Jul 31 20:37:07.867359 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:37:07.867340    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee893adbe93ea6f05ac277c2b85cc5103476914b6ac40cd68e24ceaa0069d755\": container with ID starting with ee893adbe93ea6f05ac277c2b85cc5103476914b6ac40cd68e24ceaa0069d755 not found: ID does not exist" containerID="ee893adbe93ea6f05ac277c2b85cc5103476914b6ac40cd68e24ceaa0069d755"
Jul 31 20:37:07.867421 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.867367    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee893adbe93ea6f05ac277c2b85cc5103476914b6ac40cd68e24ceaa0069d755"} err="failed to get container status \"ee893adbe93ea6f05ac277c2b85cc5103476914b6ac40cd68e24ceaa0069d755\": rpc error: code = NotFound desc = could not find container \"ee893adbe93ea6f05ac277c2b85cc5103476914b6ac40cd68e24ceaa0069d755\": container with ID starting with ee893adbe93ea6f05ac277c2b85cc5103476914b6ac40cd68e24ceaa0069d755 not found: ID does not exist"
Jul 31 20:37:07.879064 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.879036    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc5664685-mc9xx"]
Jul 31 20:37:07.885149 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.885127    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dc5664685-mc9xx"]
Jul 31 20:37:07.915126 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:07.915095    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97379182-4588-446f-8a19-9aaf50c96903" path="/var/lib/kubelet/pods/97379182-4588-446f-8a19-9aaf50c96903/volumes"
Jul 31 20:37:30.191220 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:30.191134    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:30.288767 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:30.288685    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:32.881075 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:32.881042    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569"]
Jul 31 20:37:32.881454 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:32.881353    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97379182-4588-446f-8a19-9aaf50c96903" containerName="console"
Jul 31 20:37:32.881454 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:32.881364    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="97379182-4588-446f-8a19-9aaf50c96903" containerName="console"
Jul 31 20:37:32.881454 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:32.881414    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="97379182-4588-446f-8a19-9aaf50c96903" containerName="console"
Jul 31 20:37:32.887344 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:32.887324    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569"
Jul 31 20:37:32.890425 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:32.890201    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 20:37:32.890425 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:32.890318    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 20:37:32.891467 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:32.891445    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hdzv2\""
Jul 31 20:37:32.891832 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:32.891810    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569"]
Jul 31 20:37:32.947588 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:32.947554    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlh4s\" (UniqueName: \"kubernetes.io/projected/70d5123d-db50-4b72-9230-006e0520d726-kube-api-access-wlh4s\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569\" (UID: \"70d5123d-db50-4b72-9230-006e0520d726\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569"
Jul 31 20:37:32.947794 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:32.947613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70d5123d-db50-4b72-9230-006e0520d726-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569\" (UID: \"70d5123d-db50-4b72-9230-006e0520d726\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569"
Jul 31 20:37:32.947794 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:32.947656    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70d5123d-db50-4b72-9230-006e0520d726-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569\" (UID: \"70d5123d-db50-4b72-9230-006e0520d726\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569"
Jul 31 20:37:32.984089 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:32.984056    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77"]
Jul 31 20:37:32.987664 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:32.987640    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77"
Jul 31 20:37:32.995576 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:32.995549    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77"]
Jul 31 20:37:33.048401 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.048363    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cac94b7-16b1-41af-931e-2f42a4e4ac4f-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77\" (UID: \"4cac94b7-16b1-41af-931e-2f42a4e4ac4f\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77"
Jul 31 20:37:33.048401 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.048405    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh92t\" (UniqueName: \"kubernetes.io/projected/4cac94b7-16b1-41af-931e-2f42a4e4ac4f-kube-api-access-zh92t\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77\" (UID: \"4cac94b7-16b1-41af-931e-2f42a4e4ac4f\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77"
Jul 31 20:37:33.048618 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.048474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlh4s\" (UniqueName: \"kubernetes.io/projected/70d5123d-db50-4b72-9230-006e0520d726-kube-api-access-wlh4s\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569\" (UID: \"70d5123d-db50-4b72-9230-006e0520d726\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569"
Jul 31 20:37:33.048618 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.048513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70d5123d-db50-4b72-9230-006e0520d726-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569\" (UID: \"70d5123d-db50-4b72-9230-006e0520d726\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569"
Jul 31 20:37:33.048618 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.048544    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cac94b7-16b1-41af-931e-2f42a4e4ac4f-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77\" (UID: \"4cac94b7-16b1-41af-931e-2f42a4e4ac4f\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77"
Jul 31 20:37:33.048618 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.048579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70d5123d-db50-4b72-9230-006e0520d726-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569\" (UID: \"70d5123d-db50-4b72-9230-006e0520d726\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569"
Jul 31 20:37:33.048879 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.048863    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70d5123d-db50-4b72-9230-006e0520d726-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569\" (UID: \"70d5123d-db50-4b72-9230-006e0520d726\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569"
Jul 31 20:37:33.048918 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.048895    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70d5123d-db50-4b72-9230-006e0520d726-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569\" (UID: \"70d5123d-db50-4b72-9230-006e0520d726\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569"
Jul 31 20:37:33.056249 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.056224    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlh4s\" (UniqueName: \"kubernetes.io/projected/70d5123d-db50-4b72-9230-006e0520d726-kube-api-access-wlh4s\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569\" (UID: \"70d5123d-db50-4b72-9230-006e0520d726\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569"
Jul 31 20:37:33.084163 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.084132    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p"]
Jul 31 20:37:33.087834 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.087810    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p"
Jul 31 20:37:33.095335 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.095303    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p"]
Jul 31 20:37:33.149187 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.149106    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f87950ea-2bee-4f1c-84fa-217611420f37-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p\" (UID: \"f87950ea-2bee-4f1c-84fa-217611420f37\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p"
Jul 31 20:37:33.149187 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.149148    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f87950ea-2bee-4f1c-84fa-217611420f37-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p\" (UID: \"f87950ea-2bee-4f1c-84fa-217611420f37\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p"
Jul 31 20:37:33.149375 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.149191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cac94b7-16b1-41af-931e-2f42a4e4ac4f-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77\" (UID: \"4cac94b7-16b1-41af-931e-2f42a4e4ac4f\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77"
Jul 31 20:37:33.149375 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.149219    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f66v9\" (UniqueName: \"kubernetes.io/projected/f87950ea-2bee-4f1c-84fa-217611420f37-kube-api-access-f66v9\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p\" (UID: \"f87950ea-2bee-4f1c-84fa-217611420f37\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p"
Jul 31 20:37:33.149375 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.149255    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cac94b7-16b1-41af-931e-2f42a4e4ac4f-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77\" (UID: \"4cac94b7-16b1-41af-931e-2f42a4e4ac4f\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77"
Jul 31 20:37:33.149375 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.149277    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh92t\" (UniqueName: \"kubernetes.io/projected/4cac94b7-16b1-41af-931e-2f42a4e4ac4f-kube-api-access-zh92t\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77\" (UID: \"4cac94b7-16b1-41af-931e-2f42a4e4ac4f\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77"
Jul 31 20:37:33.149562 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.149537    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cac94b7-16b1-41af-931e-2f42a4e4ac4f-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77\" (UID: \"4cac94b7-16b1-41af-931e-2f42a4e4ac4f\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77"
Jul 31 20:37:33.149600 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.149568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cac94b7-16b1-41af-931e-2f42a4e4ac4f-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77\" (UID: \"4cac94b7-16b1-41af-931e-2f42a4e4ac4f\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77"
Jul 31 20:37:33.156592 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.156570    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh92t\" (UniqueName: \"kubernetes.io/projected/4cac94b7-16b1-41af-931e-2f42a4e4ac4f-kube-api-access-zh92t\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77\" (UID: \"4cac94b7-16b1-41af-931e-2f42a4e4ac4f\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77"
Jul 31 20:37:33.185955 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.185917    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7"]
Jul 31 20:37:33.189627 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.189605    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7"
Jul 31 20:37:33.199358 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.199329    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7"]
Jul 31 20:37:33.199705 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.199688    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569"
Jul 31 20:37:33.250529 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.250479    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea1b2c66-ae88-43e6-9abc-12b97b2467b7-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7\" (UID: \"ea1b2c66-ae88-43e6-9abc-12b97b2467b7\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7"
Jul 31 20:37:33.250758 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.250544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f66v9\" (UniqueName: \"kubernetes.io/projected/f87950ea-2bee-4f1c-84fa-217611420f37-kube-api-access-f66v9\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p\" (UID: \"f87950ea-2bee-4f1c-84fa-217611420f37\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p"
Jul 31 20:37:33.251243 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.250676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea1b2c66-ae88-43e6-9abc-12b97b2467b7-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7\" (UID: \"ea1b2c66-ae88-43e6-9abc-12b97b2467b7\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7"
Jul 31 20:37:33.251353 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.251316    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dw2p\" (UniqueName: \"kubernetes.io/projected/ea1b2c66-ae88-43e6-9abc-12b97b2467b7-kube-api-access-2dw2p\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7\" (UID: \"ea1b2c66-ae88-43e6-9abc-12b97b2467b7\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7"
Jul 31 20:37:33.251416 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.251358    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f87950ea-2bee-4f1c-84fa-217611420f37-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p\" (UID: \"f87950ea-2bee-4f1c-84fa-217611420f37\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p"
Jul 31 20:37:33.251474 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.251441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f87950ea-2bee-4f1c-84fa-217611420f37-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p\" (UID: \"f87950ea-2bee-4f1c-84fa-217611420f37\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p"
Jul 31 20:37:33.252041 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.251833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f87950ea-2bee-4f1c-84fa-217611420f37-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p\" (UID: \"f87950ea-2bee-4f1c-84fa-217611420f37\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p"
Jul 31 20:37:33.252041 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.251898    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f87950ea-2bee-4f1c-84fa-217611420f37-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p\" (UID: \"f87950ea-2bee-4f1c-84fa-217611420f37\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p"
Jul 31 20:37:33.259620 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.259598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f66v9\" (UniqueName: \"kubernetes.io/projected/f87950ea-2bee-4f1c-84fa-217611420f37-kube-api-access-f66v9\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p\" (UID: \"f87950ea-2bee-4f1c-84fa-217611420f37\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p"
Jul 31 20:37:33.297240 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.297203    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77"
Jul 31 20:37:33.338845 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.338796    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569"]
Jul 31 20:37:33.341216 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:37:33.341185    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d5123d_db50_4b72_9230_006e0520d726.slice/crio-fdb46a98633f17ea16e5cd5cad4b56150ad1d180fa2419b42c61702c0069f1f4 WatchSource:0}: Error finding container fdb46a98633f17ea16e5cd5cad4b56150ad1d180fa2419b42c61702c0069f1f4: Status 404 returned error can't find the container with id fdb46a98633f17ea16e5cd5cad4b56150ad1d180fa2419b42c61702c0069f1f4
Jul 31 20:37:33.352615 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.352589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea1b2c66-ae88-43e6-9abc-12b97b2467b7-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7\" (UID: \"ea1b2c66-ae88-43e6-9abc-12b97b2467b7\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7"
Jul 31 20:37:33.352716 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.352661    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea1b2c66-ae88-43e6-9abc-12b97b2467b7-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7\" (UID: \"ea1b2c66-ae88-43e6-9abc-12b97b2467b7\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7"
Jul 31 20:37:33.352784 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.352712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dw2p\" (UniqueName: \"kubernetes.io/projected/ea1b2c66-ae88-43e6-9abc-12b97b2467b7-kube-api-access-2dw2p\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7\" (UID: \"ea1b2c66-ae88-43e6-9abc-12b97b2467b7\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7"
Jul 31 20:37:33.353511 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.353483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea1b2c66-ae88-43e6-9abc-12b97b2467b7-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7\" (UID: \"ea1b2c66-ae88-43e6-9abc-12b97b2467b7\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7"
Jul 31 20:37:33.353779 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.353759    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea1b2c66-ae88-43e6-9abc-12b97b2467b7-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7\" (UID: \"ea1b2c66-ae88-43e6-9abc-12b97b2467b7\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7"
Jul 31 20:37:33.361843 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.361815    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dw2p\" (UniqueName: \"kubernetes.io/projected/ea1b2c66-ae88-43e6-9abc-12b97b2467b7-kube-api-access-2dw2p\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7\" (UID: \"ea1b2c66-ae88-43e6-9abc-12b97b2467b7\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7"
Jul 31 20:37:33.397893 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.397850    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p"
Jul 31 20:37:33.446828 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.445399    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77"]
Jul 31 20:37:33.448428 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:37:33.448398    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cac94b7_16b1_41af_931e_2f42a4e4ac4f.slice/crio-73c638ee1ef8c7a82b981ebd86dddd010d116680c883348db3a95ea6dde366dc WatchSource:0}: Error finding container 73c638ee1ef8c7a82b981ebd86dddd010d116680c883348db3a95ea6dde366dc: Status 404 returned error can't find the container with id 73c638ee1ef8c7a82b981ebd86dddd010d116680c883348db3a95ea6dde366dc
Jul 31 20:37:33.503140 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.503110    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7"
Jul 31 20:37:33.542355 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.542327    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p"]
Jul 31 20:37:33.544437 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:37:33.544410    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf87950ea_2bee_4f1c_84fa_217611420f37.slice/crio-3f48caebbc86ae4632943a46f4c720356c1611f2ac869c9039a82cfcec327059 WatchSource:0}: Error finding container 3f48caebbc86ae4632943a46f4c720356c1611f2ac869c9039a82cfcec327059: Status 404 returned error can't find the container with id 3f48caebbc86ae4632943a46f4c720356c1611f2ac869c9039a82cfcec327059
Jul 31 20:37:33.652834 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.652795    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7"]
Jul 31 20:37:33.655073 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:37:33.655046    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea1b2c66_ae88_43e6_9abc_12b97b2467b7.slice/crio-88c759a6cb68397577c7c92120202ecb2c95a2577365e68ff780b54ad8f4715c WatchSource:0}: Error finding container 88c759a6cb68397577c7c92120202ecb2c95a2577365e68ff780b54ad8f4715c: Status 404 returned error can't find the container with id 88c759a6cb68397577c7c92120202ecb2c95a2577365e68ff780b54ad8f4715c
Jul 31 20:37:33.980309 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.980263    2565 generic.go:356] "Generic (PLEG): container finished" podID="70d5123d-db50-4b72-9230-006e0520d726" containerID="998b57029f3633140c9cc589efbb08b79c5988a8a79be892e8541a2241c5d97c" exitCode=0
Jul 31 20:37:33.980728 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.980348    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569" event={"ID":"70d5123d-db50-4b72-9230-006e0520d726","Type":"ContainerDied","Data":"998b57029f3633140c9cc589efbb08b79c5988a8a79be892e8541a2241c5d97c"}
Jul 31 20:37:33.980728 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.980403    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569" event={"ID":"70d5123d-db50-4b72-9230-006e0520d726","Type":"ContainerStarted","Data":"fdb46a98633f17ea16e5cd5cad4b56150ad1d180fa2419b42c61702c0069f1f4"}
Jul 31 20:37:33.982061 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.982032    2565 generic.go:356] "Generic (PLEG): container finished" podID="ea1b2c66-ae88-43e6-9abc-12b97b2467b7" containerID="2a9080fe3af4c76b524cc66ceee2dbf2a4bae83d45b094ad46810cac7b6de369" exitCode=0
Jul 31 20:37:33.982167 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.982096    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7" event={"ID":"ea1b2c66-ae88-43e6-9abc-12b97b2467b7","Type":"ContainerDied","Data":"2a9080fe3af4c76b524cc66ceee2dbf2a4bae83d45b094ad46810cac7b6de369"}
Jul 31 20:37:33.982167 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.982143    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7" event={"ID":"ea1b2c66-ae88-43e6-9abc-12b97b2467b7","Type":"ContainerStarted","Data":"88c759a6cb68397577c7c92120202ecb2c95a2577365e68ff780b54ad8f4715c"}
Jul 31 20:37:33.983851 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.983832    2565 generic.go:356] "Generic (PLEG): container finished" podID="f87950ea-2bee-4f1c-84fa-217611420f37" containerID="3eb99dc95a17a9f03f7ce4900e29a26877d4ed2e4ac1a5a150a1d2c4407ccce2" exitCode=0
Jul 31 20:37:33.983950 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.983916    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p" event={"ID":"f87950ea-2bee-4f1c-84fa-217611420f37","Type":"ContainerDied","Data":"3eb99dc95a17a9f03f7ce4900e29a26877d4ed2e4ac1a5a150a1d2c4407ccce2"}
Jul 31 20:37:33.983998 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.983962    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p" event={"ID":"f87950ea-2bee-4f1c-84fa-217611420f37","Type":"ContainerStarted","Data":"3f48caebbc86ae4632943a46f4c720356c1611f2ac869c9039a82cfcec327059"}
Jul 31 20:37:33.985503 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.985488    2565 generic.go:356] "Generic (PLEG): container finished" podID="4cac94b7-16b1-41af-931e-2f42a4e4ac4f" containerID="ddfe6bb988216a3b054ee829c3879c85ecda69e03e345265296ddd8142c197c4" exitCode=0
Jul 31 20:37:33.985600 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.985512    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77" event={"ID":"4cac94b7-16b1-41af-931e-2f42a4e4ac4f","Type":"ContainerDied","Data":"ddfe6bb988216a3b054ee829c3879c85ecda69e03e345265296ddd8142c197c4"}
Jul 31 20:37:33.985600 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:33.985538    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77" event={"ID":"4cac94b7-16b1-41af-931e-2f42a4e4ac4f","Type":"ContainerStarted","Data":"73c638ee1ef8c7a82b981ebd86dddd010d116680c883348db3a95ea6dde366dc"}
Jul 31 20:37:34.439077 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:34.439046    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:34.493048 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:34.493016    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:34.993118 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:34.993092    2565 generic.go:356] "Generic (PLEG): container finished" podID="70d5123d-db50-4b72-9230-006e0520d726" containerID="7ba408ecba6b13916301b5e850cb92be4366f5081eff2c5e435947e686112c82" exitCode=0
Jul 31 20:37:34.993469 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:34.993175    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569" event={"ID":"70d5123d-db50-4b72-9230-006e0520d726","Type":"ContainerDied","Data":"7ba408ecba6b13916301b5e850cb92be4366f5081eff2c5e435947e686112c82"}
Jul 31 20:37:34.994951 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:34.994932    2565 generic.go:356] "Generic (PLEG): container finished" podID="4cac94b7-16b1-41af-931e-2f42a4e4ac4f" containerID="cd41ffa80e233b568e422faf0a8d837fea82a10e4fa956fb0b18c42c2b5fbce1" exitCode=0
Jul 31 20:37:34.995028 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:34.994974    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77" event={"ID":"4cac94b7-16b1-41af-931e-2f42a4e4ac4f","Type":"ContainerDied","Data":"cd41ffa80e233b568e422faf0a8d837fea82a10e4fa956fb0b18c42c2b5fbce1"}
Jul 31 20:37:36.002193 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:36.002152    2565 generic.go:356] "Generic (PLEG): container finished" podID="ea1b2c66-ae88-43e6-9abc-12b97b2467b7" containerID="67414d8facbd14c9bc43711f91852ed2c8f4a1495c320f9a9790b1ff81f6fac7" exitCode=0
Jul 31 20:37:36.002678 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:36.002245    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7" event={"ID":"ea1b2c66-ae88-43e6-9abc-12b97b2467b7","Type":"ContainerDied","Data":"67414d8facbd14c9bc43711f91852ed2c8f4a1495c320f9a9790b1ff81f6fac7"}
Jul 31 20:37:36.004064 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:36.004038    2565 generic.go:356] "Generic (PLEG): container finished" podID="f87950ea-2bee-4f1c-84fa-217611420f37" containerID="f2b45729b9e9595bfd232396ce85512df451c2ce158d9cb57631a2de5b58f348" exitCode=0
Jul 31 20:37:36.004179 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:36.004131    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p" event={"ID":"f87950ea-2bee-4f1c-84fa-217611420f37","Type":"ContainerDied","Data":"f2b45729b9e9595bfd232396ce85512df451c2ce158d9cb57631a2de5b58f348"}
Jul 31 20:37:36.006349 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:36.006326    2565 generic.go:356] "Generic (PLEG): container finished" podID="4cac94b7-16b1-41af-931e-2f42a4e4ac4f" containerID="b61cb9a1da9a1b94385ce47c8f0b4337e2cb37d1362ab33431d0de9599d5397b" exitCode=0
Jul 31 20:37:36.006442 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:36.006407    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77" event={"ID":"4cac94b7-16b1-41af-931e-2f42a4e4ac4f","Type":"ContainerDied","Data":"b61cb9a1da9a1b94385ce47c8f0b4337e2cb37d1362ab33431d0de9599d5397b"}
Jul 31 20:37:36.008485 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:36.008466    2565 generic.go:356] "Generic (PLEG): container finished" podID="70d5123d-db50-4b72-9230-006e0520d726" containerID="5417478426d8accb1450a0f91c945e0788c0fb8cce556086dc8be596174446f5" exitCode=0
Jul 31 20:37:36.008567 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:36.008539    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569" event={"ID":"70d5123d-db50-4b72-9230-006e0520d726","Type":"ContainerDied","Data":"5417478426d8accb1450a0f91c945e0788c0fb8cce556086dc8be596174446f5"}
Jul 31 20:37:37.015673 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.015638    2565 generic.go:356] "Generic (PLEG): container finished" podID="ea1b2c66-ae88-43e6-9abc-12b97b2467b7" containerID="f72da5848ecd2c7ba90210d1bfb0ab431a091461571c5f31b100af840f1846c3" exitCode=0
Jul 31 20:37:37.016116 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.015760    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7" event={"ID":"ea1b2c66-ae88-43e6-9abc-12b97b2467b7","Type":"ContainerDied","Data":"f72da5848ecd2c7ba90210d1bfb0ab431a091461571c5f31b100af840f1846c3"}
Jul 31 20:37:37.017782 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.017759    2565 generic.go:356] "Generic (PLEG): container finished" podID="f87950ea-2bee-4f1c-84fa-217611420f37" containerID="fe1d41daadf01cbdde9815fe6c21815776cfc0c2d6a3f6187e9640e2ba598af6" exitCode=0
Jul 31 20:37:37.017915 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.017893    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p" event={"ID":"f87950ea-2bee-4f1c-84fa-217611420f37","Type":"ContainerDied","Data":"fe1d41daadf01cbdde9815fe6c21815776cfc0c2d6a3f6187e9640e2ba598af6"}
Jul 31 20:37:37.152132 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.152108    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77"
Jul 31 20:37:37.186090 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.186065    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569"
Jul 31 20:37:37.286319 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.286225    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70d5123d-db50-4b72-9230-006e0520d726-util\") pod \"70d5123d-db50-4b72-9230-006e0520d726\" (UID: \"70d5123d-db50-4b72-9230-006e0520d726\") "
Jul 31 20:37:37.286319 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.286263    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zh92t\" (UniqueName: \"kubernetes.io/projected/4cac94b7-16b1-41af-931e-2f42a4e4ac4f-kube-api-access-zh92t\") pod \"4cac94b7-16b1-41af-931e-2f42a4e4ac4f\" (UID: \"4cac94b7-16b1-41af-931e-2f42a4e4ac4f\") "
Jul 31 20:37:37.286319 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.286296    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cac94b7-16b1-41af-931e-2f42a4e4ac4f-bundle\") pod \"4cac94b7-16b1-41af-931e-2f42a4e4ac4f\" (UID: \"4cac94b7-16b1-41af-931e-2f42a4e4ac4f\") "
Jul 31 20:37:37.286599 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.286327    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70d5123d-db50-4b72-9230-006e0520d726-bundle\") pod \"70d5123d-db50-4b72-9230-006e0520d726\" (UID: \"70d5123d-db50-4b72-9230-006e0520d726\") "
Jul 31 20:37:37.286599 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.286402    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlh4s\" (UniqueName: \"kubernetes.io/projected/70d5123d-db50-4b72-9230-006e0520d726-kube-api-access-wlh4s\") pod \"70d5123d-db50-4b72-9230-006e0520d726\" (UID: \"70d5123d-db50-4b72-9230-006e0520d726\") "
Jul 31 20:37:37.286599 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.286426    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cac94b7-16b1-41af-931e-2f42a4e4ac4f-util\") pod \"4cac94b7-16b1-41af-931e-2f42a4e4ac4f\" (UID: \"4cac94b7-16b1-41af-931e-2f42a4e4ac4f\") "
Jul 31 20:37:37.287069 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.287016    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d5123d-db50-4b72-9230-006e0520d726-bundle" (OuterVolumeSpecName: "bundle") pod "70d5123d-db50-4b72-9230-006e0520d726" (UID: "70d5123d-db50-4b72-9230-006e0520d726"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:37:37.287168 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.287094    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cac94b7-16b1-41af-931e-2f42a4e4ac4f-bundle" (OuterVolumeSpecName: "bundle") pod "4cac94b7-16b1-41af-931e-2f42a4e4ac4f" (UID: "4cac94b7-16b1-41af-931e-2f42a4e4ac4f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:37:37.289118 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.289091    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70d5123d-db50-4b72-9230-006e0520d726-kube-api-access-wlh4s" (OuterVolumeSpecName: "kube-api-access-wlh4s") pod "70d5123d-db50-4b72-9230-006e0520d726" (UID: "70d5123d-db50-4b72-9230-006e0520d726"). InnerVolumeSpecName "kube-api-access-wlh4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:37:37.289118 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.289111    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cac94b7-16b1-41af-931e-2f42a4e4ac4f-kube-api-access-zh92t" (OuterVolumeSpecName: "kube-api-access-zh92t") pod "4cac94b7-16b1-41af-931e-2f42a4e4ac4f" (UID: "4cac94b7-16b1-41af-931e-2f42a4e4ac4f"). InnerVolumeSpecName "kube-api-access-zh92t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:37:37.294717 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.294691    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cac94b7-16b1-41af-931e-2f42a4e4ac4f-util" (OuterVolumeSpecName: "util") pod "4cac94b7-16b1-41af-931e-2f42a4e4ac4f" (UID: "4cac94b7-16b1-41af-931e-2f42a4e4ac4f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:37:37.295196 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.295178    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d5123d-db50-4b72-9230-006e0520d726-util" (OuterVolumeSpecName: "util") pod "70d5123d-db50-4b72-9230-006e0520d726" (UID: "70d5123d-db50-4b72-9230-006e0520d726"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:37:37.387304 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.387250    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlh4s\" (UniqueName: \"kubernetes.io/projected/70d5123d-db50-4b72-9230-006e0520d726-kube-api-access-wlh4s\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:37.387304 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.387298    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cac94b7-16b1-41af-931e-2f42a4e4ac4f-util\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:37.387304 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.387310    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70d5123d-db50-4b72-9230-006e0520d726-util\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:37.387304 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.387318    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh92t\" (UniqueName: \"kubernetes.io/projected/4cac94b7-16b1-41af-931e-2f42a4e4ac4f-kube-api-access-zh92t\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:37.387571 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.387327    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cac94b7-16b1-41af-931e-2f42a4e4ac4f-bundle\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:37.387571 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:37.387336    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70d5123d-db50-4b72-9230-006e0520d726-bundle\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:38.025300 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.025278    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569"
Jul 31 20:37:38.025677 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.025305    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c62569" event={"ID":"70d5123d-db50-4b72-9230-006e0520d726","Type":"ContainerDied","Data":"fdb46a98633f17ea16e5cd5cad4b56150ad1d180fa2419b42c61702c0069f1f4"}
Jul 31 20:37:38.025677 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.025349    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdb46a98633f17ea16e5cd5cad4b56150ad1d180fa2419b42c61702c0069f1f4"
Jul 31 20:37:38.027522 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.027475    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77" event={"ID":"4cac94b7-16b1-41af-931e-2f42a4e4ac4f","Type":"ContainerDied","Data":"73c638ee1ef8c7a82b981ebd86dddd010d116680c883348db3a95ea6dde366dc"}
Jul 31 20:37:38.027522 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.027498    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gmd77"
Jul 31 20:37:38.027710 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.027524    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73c638ee1ef8c7a82b981ebd86dddd010d116680c883348db3a95ea6dde366dc"
Jul 31 20:37:38.193609 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.193586    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p"
Jul 31 20:37:38.195827 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.195807    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7"
Jul 31 20:37:38.298973 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.298942    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f66v9\" (UniqueName: \"kubernetes.io/projected/f87950ea-2bee-4f1c-84fa-217611420f37-kube-api-access-f66v9\") pod \"f87950ea-2bee-4f1c-84fa-217611420f37\" (UID: \"f87950ea-2bee-4f1c-84fa-217611420f37\") "
Jul 31 20:37:38.299159 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.299031    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f87950ea-2bee-4f1c-84fa-217611420f37-bundle\") pod \"f87950ea-2bee-4f1c-84fa-217611420f37\" (UID: \"f87950ea-2bee-4f1c-84fa-217611420f37\") "
Jul 31 20:37:38.299159 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.299052    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f87950ea-2bee-4f1c-84fa-217611420f37-util\") pod \"f87950ea-2bee-4f1c-84fa-217611420f37\" (UID: \"f87950ea-2bee-4f1c-84fa-217611420f37\") "
Jul 31 20:37:38.299159 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.299092    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea1b2c66-ae88-43e6-9abc-12b97b2467b7-bundle\") pod \"ea1b2c66-ae88-43e6-9abc-12b97b2467b7\" (UID: \"ea1b2c66-ae88-43e6-9abc-12b97b2467b7\") "
Jul 31 20:37:38.299159 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.299124    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea1b2c66-ae88-43e6-9abc-12b97b2467b7-util\") pod \"ea1b2c66-ae88-43e6-9abc-12b97b2467b7\" (UID: \"ea1b2c66-ae88-43e6-9abc-12b97b2467b7\") "
Jul 31 20:37:38.299159 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.299150    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dw2p\" (UniqueName: \"kubernetes.io/projected/ea1b2c66-ae88-43e6-9abc-12b97b2467b7-kube-api-access-2dw2p\") pod \"ea1b2c66-ae88-43e6-9abc-12b97b2467b7\" (UID: \"ea1b2c66-ae88-43e6-9abc-12b97b2467b7\") "
Jul 31 20:37:38.299604 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.299566    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f87950ea-2bee-4f1c-84fa-217611420f37-bundle" (OuterVolumeSpecName: "bundle") pod "f87950ea-2bee-4f1c-84fa-217611420f37" (UID: "f87950ea-2bee-4f1c-84fa-217611420f37"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:37:38.299604 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.299581    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea1b2c66-ae88-43e6-9abc-12b97b2467b7-bundle" (OuterVolumeSpecName: "bundle") pod "ea1b2c66-ae88-43e6-9abc-12b97b2467b7" (UID: "ea1b2c66-ae88-43e6-9abc-12b97b2467b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:37:38.301271 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.301247    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f87950ea-2bee-4f1c-84fa-217611420f37-kube-api-access-f66v9" (OuterVolumeSpecName: "kube-api-access-f66v9") pod "f87950ea-2bee-4f1c-84fa-217611420f37" (UID: "f87950ea-2bee-4f1c-84fa-217611420f37"). InnerVolumeSpecName "kube-api-access-f66v9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:37:38.301469 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.301454    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea1b2c66-ae88-43e6-9abc-12b97b2467b7-kube-api-access-2dw2p" (OuterVolumeSpecName: "kube-api-access-2dw2p") pod "ea1b2c66-ae88-43e6-9abc-12b97b2467b7" (UID: "ea1b2c66-ae88-43e6-9abc-12b97b2467b7"). InnerVolumeSpecName "kube-api-access-2dw2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:37:38.305207 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.305184    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f87950ea-2bee-4f1c-84fa-217611420f37-util" (OuterVolumeSpecName: "util") pod "f87950ea-2bee-4f1c-84fa-217611420f37" (UID: "f87950ea-2bee-4f1c-84fa-217611420f37"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:37:38.305372 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.305348    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea1b2c66-ae88-43e6-9abc-12b97b2467b7-util" (OuterVolumeSpecName: "util") pod "ea1b2c66-ae88-43e6-9abc-12b97b2467b7" (UID: "ea1b2c66-ae88-43e6-9abc-12b97b2467b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:37:38.400022 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.399995    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f87950ea-2bee-4f1c-84fa-217611420f37-bundle\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:38.400022 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.400018    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f87950ea-2bee-4f1c-84fa-217611420f37-util\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:38.400022 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.400027    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea1b2c66-ae88-43e6-9abc-12b97b2467b7-bundle\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:38.400238 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.400035    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea1b2c66-ae88-43e6-9abc-12b97b2467b7-util\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:38.400238 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.400043    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dw2p\" (UniqueName: \"kubernetes.io/projected/ea1b2c66-ae88-43e6-9abc-12b97b2467b7-kube-api-access-2dw2p\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:38.400238 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:38.400053    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f66v9\" (UniqueName: \"kubernetes.io/projected/f87950ea-2bee-4f1c-84fa-217611420f37-kube-api-access-f66v9\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:37:39.034679 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:39.034637    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7" event={"ID":"ea1b2c66-ae88-43e6-9abc-12b97b2467b7","Type":"ContainerDied","Data":"88c759a6cb68397577c7c92120202ecb2c95a2577365e68ff780b54ad8f4715c"}
Jul 31 20:37:39.035184 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:39.034695    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88c759a6cb68397577c7c92120202ecb2c95a2577365e68ff780b54ad8f4715c"
Jul 31 20:37:39.035184 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:39.034656    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04jdl7"
Jul 31 20:37:39.036594 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:39.036573    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p"
Jul 31 20:37:39.036713 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:39.036597    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzpb4p" event={"ID":"f87950ea-2bee-4f1c-84fa-217611420f37","Type":"ContainerDied","Data":"3f48caebbc86ae4632943a46f4c720356c1611f2ac869c9039a82cfcec327059"}
Jul 31 20:37:39.036713 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:39.036640    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f48caebbc86ae4632943a46f4c720356c1611f2ac869c9039a82cfcec327059"
Jul 31 20:37:41.912327 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:41.912294    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:44.721577 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:44.721542    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:46.510955 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:46.510922    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:46.759311 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:46.759282    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:46.923710 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:46.923617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:47.526933 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:47.526906    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:47.962764 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:47.962713    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:48.979375 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:48.979346    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:49.080202 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:49.080173    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:50.723318 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:50.723278    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:51.117060 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:51.116969    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:53.020666 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:53.020631    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:54.522114 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:54.522072    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:54.618908 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:54.618868    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:56.527281 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:56.527244    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:56.626254 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:56.626228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:58.062705 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:58.062665    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:37:58.410699 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:37:58.410615    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:02.275181 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:02.275141    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:02.371518 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:02.371482    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:02.434536 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:02.434500    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:11.127600 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:11.127561    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:11.220536 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:11.220492    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:13.706538 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:13.706505    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:13.807666 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:13.807619    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:16.705252 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:16.705220    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:16.805572 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:16.805533    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:20.006535 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:20.006497    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:20.106580 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:20.106547    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:21.460987 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:21.460956    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:21.563664 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:21.563614    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:21.660770 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:21.660715    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:22.519167 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:22.519132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:22.619488 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:22.619455    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:30.291979 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:30.291947    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:30.387875 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:30.387840    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:37.405410 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:37.405378    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:37.575639 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:37.575578    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:51.957937 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:51.957860    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:52.071433 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:52.071402    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:52.126106 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:52.126065    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:52.792219 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:52.792182    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:38:52.859245 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:38:52.859209    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:39:09.544800 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:09.544765    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:39:09.645146 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:09.645109    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:39:10.062131 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:10.062101    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:39:22.660798 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:22.660763    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:39:22.761027 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:22.760988    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:39:29.078335 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078301    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-644cf4ff79-6vx4j"]
Jul 31 20:39:29.078729 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078629    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cac94b7-16b1-41af-931e-2f42a4e4ac4f" containerName="pull"
Jul 31 20:39:29.078729 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078641    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cac94b7-16b1-41af-931e-2f42a4e4ac4f" containerName="pull"
Jul 31 20:39:29.078729 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078648    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea1b2c66-ae88-43e6-9abc-12b97b2467b7" containerName="extract"
Jul 31 20:39:29.078729 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078655    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea1b2c66-ae88-43e6-9abc-12b97b2467b7" containerName="extract"
Jul 31 20:39:29.078729 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078667    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f87950ea-2bee-4f1c-84fa-217611420f37" containerName="pull"
Jul 31 20:39:29.078729 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078673    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f87950ea-2bee-4f1c-84fa-217611420f37" containerName="pull"
Jul 31 20:39:29.078729 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078680    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cac94b7-16b1-41af-931e-2f42a4e4ac4f" containerName="util"
Jul 31 20:39:29.078729 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078687    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cac94b7-16b1-41af-931e-2f42a4e4ac4f" containerName="util"
Jul 31 20:39:29.078729 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078694    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70d5123d-db50-4b72-9230-006e0520d726" containerName="pull"
Jul 31 20:39:29.078729 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078699    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d5123d-db50-4b72-9230-006e0520d726" containerName="pull"
Jul 31 20:39:29.078729 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078706    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70d5123d-db50-4b72-9230-006e0520d726" containerName="util"
Jul 31 20:39:29.078729 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078711    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d5123d-db50-4b72-9230-006e0520d726" containerName="util"
Jul 31 20:39:29.078729 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078717    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70d5123d-db50-4b72-9230-006e0520d726" containerName="extract"
Jul 31 20:39:29.078729 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078722    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d5123d-db50-4b72-9230-006e0520d726" containerName="extract"
Jul 31 20:39:29.078729 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078729    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f87950ea-2bee-4f1c-84fa-217611420f37" containerName="util"
Jul 31 20:39:29.078729 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078752    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f87950ea-2bee-4f1c-84fa-217611420f37" containerName="util"
Jul 31 20:39:29.079293 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078761    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea1b2c66-ae88-43e6-9abc-12b97b2467b7" containerName="pull"
Jul 31 20:39:29.079293 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078767    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea1b2c66-ae88-43e6-9abc-12b97b2467b7" containerName="pull"
Jul 31 20:39:29.079293 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078775    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f87950ea-2bee-4f1c-84fa-217611420f37" containerName="extract"
Jul 31 20:39:29.079293 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078780    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f87950ea-2bee-4f1c-84fa-217611420f37" containerName="extract"
Jul 31 20:39:29.079293 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078789    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea1b2c66-ae88-43e6-9abc-12b97b2467b7" containerName="util"
Jul 31 20:39:29.079293 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078793    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea1b2c66-ae88-43e6-9abc-12b97b2467b7" containerName="util"
Jul 31 20:39:29.079293 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078798    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cac94b7-16b1-41af-931e-2f42a4e4ac4f" containerName="extract"
Jul 31 20:39:29.079293 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078803    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cac94b7-16b1-41af-931e-2f42a4e4ac4f" containerName="extract"
Jul 31 20:39:29.079293 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078865    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="70d5123d-db50-4b72-9230-006e0520d726" containerName="extract"
Jul 31 20:39:29.079293 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078874    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f87950ea-2bee-4f1c-84fa-217611420f37" containerName="extract"
Jul 31 20:39:29.079293 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078879    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea1b2c66-ae88-43e6-9abc-12b97b2467b7" containerName="extract"
Jul 31 20:39:29.079293 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.078885    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cac94b7-16b1-41af-931e-2f42a4e4ac4f" containerName="extract"
Jul 31 20:39:29.081974 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.081956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-644cf4ff79-6vx4j"
Jul 31 20:39:29.084613 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.084592    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 31 20:39:29.084831 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.084721    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8zj2s\""
Jul 31 20:39:29.085146 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.085129    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 31 20:39:29.086629 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.086607    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:39:29.094691 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.094666    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-644cf4ff79-6vx4j"]
Jul 31 20:39:29.138964 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.138933    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa6ef8ff-19dd-42d3-89f5-113b2734b680-webhook-cert\") pod \"maas-controller-644cf4ff79-6vx4j\" (UID: \"fa6ef8ff-19dd-42d3-89f5-113b2734b680\") " pod="opendatahub/maas-controller-644cf4ff79-6vx4j"
Jul 31 20:39:29.139158 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.139043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7rbw\" (UniqueName: \"kubernetes.io/projected/fa6ef8ff-19dd-42d3-89f5-113b2734b680-kube-api-access-m7rbw\") pod \"maas-controller-644cf4ff79-6vx4j\" (UID: \"fa6ef8ff-19dd-42d3-89f5-113b2734b680\") " pod="opendatahub/maas-controller-644cf4ff79-6vx4j"
Jul 31 20:39:29.180629 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.180591    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:39:29.240207 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.240167    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa6ef8ff-19dd-42d3-89f5-113b2734b680-webhook-cert\") pod \"maas-controller-644cf4ff79-6vx4j\" (UID: \"fa6ef8ff-19dd-42d3-89f5-113b2734b680\") " pod="opendatahub/maas-controller-644cf4ff79-6vx4j"
Jul 31 20:39:29.240419 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.240232    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7rbw\" (UniqueName: \"kubernetes.io/projected/fa6ef8ff-19dd-42d3-89f5-113b2734b680-kube-api-access-m7rbw\") pod \"maas-controller-644cf4ff79-6vx4j\" (UID: \"fa6ef8ff-19dd-42d3-89f5-113b2734b680\") " pod="opendatahub/maas-controller-644cf4ff79-6vx4j"
Jul 31 20:39:29.240419 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:39:29.240323    2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 31 20:39:29.240537 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:39:29.240437    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa6ef8ff-19dd-42d3-89f5-113b2734b680-webhook-cert podName:fa6ef8ff-19dd-42d3-89f5-113b2734b680 nodeName:}" failed. No retries permitted until 2026-07-31 20:39:29.740417381 +0000 UTC m=+578.345711722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/fa6ef8ff-19dd-42d3-89f5-113b2734b680-webhook-cert") pod "maas-controller-644cf4ff79-6vx4j" (UID: "fa6ef8ff-19dd-42d3-89f5-113b2734b680") : secret "maas-controller-webhook-cert" not found
Jul 31 20:39:29.251220 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.251188    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bcc9b8b78-cjk8f"]
Jul 31 20:39:29.251356 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.251335    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7rbw\" (UniqueName: \"kubernetes.io/projected/fa6ef8ff-19dd-42d3-89f5-113b2734b680-kube-api-access-m7rbw\") pod \"maas-controller-644cf4ff79-6vx4j\" (UID: \"fa6ef8ff-19dd-42d3-89f5-113b2734b680\") " pod="opendatahub/maas-controller-644cf4ff79-6vx4j"
Jul 31 20:39:29.254989 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.254972    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bcc9b8b78-cjk8f"
Jul 31 20:39:29.264259 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.264232    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bcc9b8b78-cjk8f"]
Jul 31 20:39:29.341633 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.341544    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4fdb556-ac72-4616-b62d-38df6ec00aff-webhook-cert\") pod \"maas-controller-7bcc9b8b78-cjk8f\" (UID: \"b4fdb556-ac72-4616-b62d-38df6ec00aff\") " pod="opendatahub/maas-controller-7bcc9b8b78-cjk8f"
Jul 31 20:39:29.341810 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.341706    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7nvh\" (UniqueName: \"kubernetes.io/projected/b4fdb556-ac72-4616-b62d-38df6ec00aff-kube-api-access-p7nvh\") pod \"maas-controller-7bcc9b8b78-cjk8f\" (UID: \"b4fdb556-ac72-4616-b62d-38df6ec00aff\") " pod="opendatahub/maas-controller-7bcc9b8b78-cjk8f"
Jul 31 20:39:29.427109 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.427073    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:39:29.442204 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.442169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7nvh\" (UniqueName: \"kubernetes.io/projected/b4fdb556-ac72-4616-b62d-38df6ec00aff-kube-api-access-p7nvh\") pod \"maas-controller-7bcc9b8b78-cjk8f\" (UID: \"b4fdb556-ac72-4616-b62d-38df6ec00aff\") " pod="opendatahub/maas-controller-7bcc9b8b78-cjk8f"
Jul 31 20:39:29.442324 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.442231    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4fdb556-ac72-4616-b62d-38df6ec00aff-webhook-cert\") pod \"maas-controller-7bcc9b8b78-cjk8f\" (UID: \"b4fdb556-ac72-4616-b62d-38df6ec00aff\") " pod="opendatahub/maas-controller-7bcc9b8b78-cjk8f"
Jul 31 20:39:29.444853 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.444829    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4fdb556-ac72-4616-b62d-38df6ec00aff-webhook-cert\") pod \"maas-controller-7bcc9b8b78-cjk8f\" (UID: \"b4fdb556-ac72-4616-b62d-38df6ec00aff\") " pod="opendatahub/maas-controller-7bcc9b8b78-cjk8f"
Jul 31 20:39:29.450314 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.450287    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7nvh\" (UniqueName: \"kubernetes.io/projected/b4fdb556-ac72-4616-b62d-38df6ec00aff-kube-api-access-p7nvh\") pod \"maas-controller-7bcc9b8b78-cjk8f\" (UID: \"b4fdb556-ac72-4616-b62d-38df6ec00aff\") " pod="opendatahub/maas-controller-7bcc9b8b78-cjk8f"
Jul 31 20:39:29.571071 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.571036    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bcc9b8b78-cjk8f"
Jul 31 20:39:29.705119 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.705089    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bcc9b8b78-cjk8f"]
Jul 31 20:39:29.706782 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:39:29.706727    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4fdb556_ac72_4616_b62d_38df6ec00aff.slice/crio-eae875c3c5a473559185e2764525c59333eb29c852cf2d0e1016abc2086a8e32 WatchSource:0}: Error finding container eae875c3c5a473559185e2764525c59333eb29c852cf2d0e1016abc2086a8e32: Status 404 returned error can't find the container with id eae875c3c5a473559185e2764525c59333eb29c852cf2d0e1016abc2086a8e32
Jul 31 20:39:29.745969 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.745923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa6ef8ff-19dd-42d3-89f5-113b2734b680-webhook-cert\") pod \"maas-controller-644cf4ff79-6vx4j\" (UID: \"fa6ef8ff-19dd-42d3-89f5-113b2734b680\") " pod="opendatahub/maas-controller-644cf4ff79-6vx4j"
Jul 31 20:39:29.748533 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.748512    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa6ef8ff-19dd-42d3-89f5-113b2734b680-webhook-cert\") pod \"maas-controller-644cf4ff79-6vx4j\" (UID: \"fa6ef8ff-19dd-42d3-89f5-113b2734b680\") " pod="opendatahub/maas-controller-644cf4ff79-6vx4j"
Jul 31 20:39:29.992952 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:29.992912    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-644cf4ff79-6vx4j"
Jul 31 20:39:30.126375 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:30.126345    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-644cf4ff79-6vx4j"]
Jul 31 20:39:30.127761 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:39:30.127718    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa6ef8ff_19dd_42d3_89f5_113b2734b680.slice/crio-9cdc7da8ac6f6c7acdc45ed414b1794bbf397d82cc6e972a9f93c0768fe680cc WatchSource:0}: Error finding container 9cdc7da8ac6f6c7acdc45ed414b1794bbf397d82cc6e972a9f93c0768fe680cc: Status 404 returned error can't find the container with id 9cdc7da8ac6f6c7acdc45ed414b1794bbf397d82cc6e972a9f93c0768fe680cc
Jul 31 20:39:30.592498 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:30.592459    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bcc9b8b78-cjk8f" event={"ID":"b4fdb556-ac72-4616-b62d-38df6ec00aff","Type":"ContainerStarted","Data":"eae875c3c5a473559185e2764525c59333eb29c852cf2d0e1016abc2086a8e32"}
Jul 31 20:39:30.595021 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:30.594987    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-644cf4ff79-6vx4j" event={"ID":"fa6ef8ff-19dd-42d3-89f5-113b2734b680","Type":"ContainerStarted","Data":"9cdc7da8ac6f6c7acdc45ed414b1794bbf397d82cc6e972a9f93c0768fe680cc"}
Jul 31 20:39:32.483255 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:32.483217    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:39:32.607721 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:32.607617    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bcc9b8b78-cjk8f" event={"ID":"b4fdb556-ac72-4616-b62d-38df6ec00aff","Type":"ContainerStarted","Data":"09e5e0c6fa23df33adeb3b94bb7f6f2f48e3908f3db96450036452f397877c71"}
Jul 31 20:39:32.607721 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:32.607680    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bcc9b8b78-cjk8f"
Jul 31 20:39:32.609137 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:32.609112    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-644cf4ff79-6vx4j" event={"ID":"fa6ef8ff-19dd-42d3-89f5-113b2734b680","Type":"ContainerStarted","Data":"0b01ef330a915ae535f1378423650d28c2fe181819c62661dc73522e3317c3ae"}
Jul 31 20:39:32.609261 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:32.609155    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-644cf4ff79-6vx4j"
Jul 31 20:39:32.644408 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:32.644355    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bcc9b8b78-cjk8f" podStartSLOduration=1.041704292 podStartE2EDuration="3.644340335s" totalImagesPullingTime="2.602636043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:39:32.641897951 +0000 UTC m=+581.247192336" watchObservedRunningTime="2026-07-31 20:39:32.644340335 +0000 UTC m=+581.249634695"
Jul 31 20:39:32.650454 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:32.650425    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:39:32.667489 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:32.667444    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-644cf4ff79-6vx4j" podStartSLOduration=1.47454805 podStartE2EDuration="3.667429876s" totalImagesPullingTime="2.192881826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:39:32.665353883 +0000 UTC m=+581.270648246" watchObservedRunningTime="2026-07-31 20:39:32.667429876 +0000 UTC m=+581.272724238"
Jul 31 20:39:43.616349 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:43.616312    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-644cf4ff79-6vx4j"
Jul 31 20:39:43.616938 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:43.616439    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bcc9b8b78-cjk8f"
Jul 31 20:39:43.678802 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:43.678764    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-644cf4ff79-6vx4j"]
Jul 31 20:39:43.679290 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:43.679231    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-644cf4ff79-6vx4j" podUID="fa6ef8ff-19dd-42d3-89f5-113b2734b680" containerName="manager" containerID="cri-o://0b01ef330a915ae535f1378423650d28c2fe181819c62661dc73522e3317c3ae" gracePeriod=30
Jul 31 20:39:43.922580 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:43.922554    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-644cf4ff79-6vx4j"
Jul 31 20:39:44.078582 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:44.078549    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7rbw\" (UniqueName: \"kubernetes.io/projected/fa6ef8ff-19dd-42d3-89f5-113b2734b680-kube-api-access-m7rbw\") pod \"fa6ef8ff-19dd-42d3-89f5-113b2734b680\" (UID: \"fa6ef8ff-19dd-42d3-89f5-113b2734b680\") "
Jul 31 20:39:44.078784 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:44.078645    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa6ef8ff-19dd-42d3-89f5-113b2734b680-webhook-cert\") pod \"fa6ef8ff-19dd-42d3-89f5-113b2734b680\" (UID: \"fa6ef8ff-19dd-42d3-89f5-113b2734b680\") "
Jul 31 20:39:44.081001 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:44.080962    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa6ef8ff-19dd-42d3-89f5-113b2734b680-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fa6ef8ff-19dd-42d3-89f5-113b2734b680" (UID: "fa6ef8ff-19dd-42d3-89f5-113b2734b680"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:39:44.081122 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:44.081059    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa6ef8ff-19dd-42d3-89f5-113b2734b680-kube-api-access-m7rbw" (OuterVolumeSpecName: "kube-api-access-m7rbw") pod "fa6ef8ff-19dd-42d3-89f5-113b2734b680" (UID: "fa6ef8ff-19dd-42d3-89f5-113b2734b680"). InnerVolumeSpecName "kube-api-access-m7rbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:39:44.179461 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:44.179432    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa6ef8ff-19dd-42d3-89f5-113b2734b680-webhook-cert\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:39:44.179461 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:44.179461    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7rbw\" (UniqueName: \"kubernetes.io/projected/fa6ef8ff-19dd-42d3-89f5-113b2734b680-kube-api-access-m7rbw\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:39:44.669698 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:44.669608    2565 generic.go:356] "Generic (PLEG): container finished" podID="fa6ef8ff-19dd-42d3-89f5-113b2734b680" containerID="0b01ef330a915ae535f1378423650d28c2fe181819c62661dc73522e3317c3ae" exitCode=0
Jul 31 20:39:44.669698 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:44.669662    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-644cf4ff79-6vx4j"
Jul 31 20:39:44.669698 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:44.669680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-644cf4ff79-6vx4j" event={"ID":"fa6ef8ff-19dd-42d3-89f5-113b2734b680","Type":"ContainerDied","Data":"0b01ef330a915ae535f1378423650d28c2fe181819c62661dc73522e3317c3ae"}
Jul 31 20:39:44.670287 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:44.669722    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-644cf4ff79-6vx4j" event={"ID":"fa6ef8ff-19dd-42d3-89f5-113b2734b680","Type":"ContainerDied","Data":"9cdc7da8ac6f6c7acdc45ed414b1794bbf397d82cc6e972a9f93c0768fe680cc"}
Jul 31 20:39:44.670287 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:44.669778    2565 scope.go:117] "RemoveContainer" containerID="0b01ef330a915ae535f1378423650d28c2fe181819c62661dc73522e3317c3ae"
Jul 31 20:39:44.678729 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:44.678700    2565 scope.go:117] "RemoveContainer" containerID="0b01ef330a915ae535f1378423650d28c2fe181819c62661dc73522e3317c3ae"
Jul 31 20:39:44.678973 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:39:44.678953    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b01ef330a915ae535f1378423650d28c2fe181819c62661dc73522e3317c3ae\": container with ID starting with 0b01ef330a915ae535f1378423650d28c2fe181819c62661dc73522e3317c3ae not found: ID does not exist" containerID="0b01ef330a915ae535f1378423650d28c2fe181819c62661dc73522e3317c3ae"
Jul 31 20:39:44.679029 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:44.678983    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b01ef330a915ae535f1378423650d28c2fe181819c62661dc73522e3317c3ae"} err="failed to get container status \"0b01ef330a915ae535f1378423650d28c2fe181819c62661dc73522e3317c3ae\": rpc error: code = NotFound desc = could not find container \"0b01ef330a915ae535f1378423650d28c2fe181819c62661dc73522e3317c3ae\": container with ID starting with 0b01ef330a915ae535f1378423650d28c2fe181819c62661dc73522e3317c3ae not found: ID does not exist"
Jul 31 20:39:44.690139 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:44.690118    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-644cf4ff79-6vx4j"]
Jul 31 20:39:44.692073 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:44.692055    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-644cf4ff79-6vx4j"]
Jul 31 20:39:45.915269 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:45.915239    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa6ef8ff-19dd-42d3-89f5-113b2734b680" path="/var/lib/kubelet/pods/fa6ef8ff-19dd-42d3-89f5-113b2734b680/volumes"
Jul 31 20:39:51.847485 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:51.847454    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 20:39:51.847963 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:51.847646    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 20:39:51.852626 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:51.852607    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 20:39:51.852779 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:39:51.852629    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 20:40:02.560862 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:02.560829    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:40:02.657882 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:02.657853    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:40:04.029038 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.029002    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:40:04.180083 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.180046    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:40:04.347859 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.347780    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h"]
Jul 31 20:40:04.348099 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.348087    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6ef8ff-19dd-42d3-89f5-113b2734b680" containerName="manager"
Jul 31 20:40:04.348142 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.348100    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6ef8ff-19dd-42d3-89f5-113b2734b680" containerName="manager"
Jul 31 20:40:04.348178 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.348168    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa6ef8ff-19dd-42d3-89f5-113b2734b680" containerName="manager"
Jul 31 20:40:04.350948 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.350932    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h"
Jul 31 20:40:04.353998 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.353973    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 31 20:40:04.354104 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.353973    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 20:40:04.354300 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.354280    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 31 20:40:04.354393 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.354285    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j44wr\""
Jul 31 20:40:04.363228 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.363208    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h"]
Jul 31 20:40:04.442815 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.442785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07ffe8d2-f071-4521-9dee-2a66f79f90d9-maas-api-tls\") pod \"maas-api-684dcf84d-hbz5h\" (UID: \"07ffe8d2-f071-4521-9dee-2a66f79f90d9\") " pod="odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h"
Jul 31 20:40:04.442992 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.442829    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07ffe8d2-f071-4521-9dee-2a66f79f90d9-openshift-service-ca\") pod \"maas-api-684dcf84d-hbz5h\" (UID: \"07ffe8d2-f071-4521-9dee-2a66f79f90d9\") " pod="odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h"
Jul 31 20:40:04.442992 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.442868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx5vx\" (UniqueName: \"kubernetes.io/projected/07ffe8d2-f071-4521-9dee-2a66f79f90d9-kube-api-access-kx5vx\") pod \"maas-api-684dcf84d-hbz5h\" (UID: \"07ffe8d2-f071-4521-9dee-2a66f79f90d9\") " pod="odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h"
Jul 31 20:40:04.544164 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.544131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07ffe8d2-f071-4521-9dee-2a66f79f90d9-openshift-service-ca\") pod \"maas-api-684dcf84d-hbz5h\" (UID: \"07ffe8d2-f071-4521-9dee-2a66f79f90d9\") " pod="odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h"
Jul 31 20:40:04.544347 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.544177    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx5vx\" (UniqueName: \"kubernetes.io/projected/07ffe8d2-f071-4521-9dee-2a66f79f90d9-kube-api-access-kx5vx\") pod \"maas-api-684dcf84d-hbz5h\" (UID: \"07ffe8d2-f071-4521-9dee-2a66f79f90d9\") " pod="odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h"
Jul 31 20:40:04.544347 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.544268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07ffe8d2-f071-4521-9dee-2a66f79f90d9-maas-api-tls\") pod \"maas-api-684dcf84d-hbz5h\" (UID: \"07ffe8d2-f071-4521-9dee-2a66f79f90d9\") " pod="odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h"
Jul 31 20:40:04.544942 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.544925    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07ffe8d2-f071-4521-9dee-2a66f79f90d9-openshift-service-ca\") pod \"maas-api-684dcf84d-hbz5h\" (UID: \"07ffe8d2-f071-4521-9dee-2a66f79f90d9\") " pod="odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h"
Jul 31 20:40:04.546827 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.546811    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07ffe8d2-f071-4521-9dee-2a66f79f90d9-maas-api-tls\") pod \"maas-api-684dcf84d-hbz5h\" (UID: \"07ffe8d2-f071-4521-9dee-2a66f79f90d9\") " pod="odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h"
Jul 31 20:40:04.552887 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.552864    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx5vx\" (UniqueName: \"kubernetes.io/projected/07ffe8d2-f071-4521-9dee-2a66f79f90d9-kube-api-access-kx5vx\") pod \"maas-api-684dcf84d-hbz5h\" (UID: \"07ffe8d2-f071-4521-9dee-2a66f79f90d9\") " pod="odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h"
Jul 31 20:40:04.618025 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.617942    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:40:04.661139 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.661108    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h"
Jul 31 20:40:04.717889 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.717852    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:40:04.718970 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.718944    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-gfts2"]
Jul 31 20:40:04.723231 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.723199    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gfts2"
Jul 31 20:40:04.725267 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.725244    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 31 20:40:04.725491 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.725468    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-btjg7\""
Jul 31 20:40:04.735337 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.735304    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-gfts2"]
Jul 31 20:40:04.746298 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.746269    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3f18a04-895e-4a99-8eef-ce01940c27a5-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-gfts2\" (UID: \"b3f18a04-895e-4a99-8eef-ce01940c27a5\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gfts2"
Jul 31 20:40:04.746427 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.746309    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdgz5\" (UniqueName: \"kubernetes.io/projected/b3f18a04-895e-4a99-8eef-ce01940c27a5-kube-api-access-tdgz5\") pod \"payload-pre-processing-687dbb6cf6-gfts2\" (UID: \"b3f18a04-895e-4a99-8eef-ce01940c27a5\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gfts2"
Jul 31 20:40:04.811706 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.811673    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h"]
Jul 31 20:40:04.814000 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:40:04.813971    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07ffe8d2_f071_4521_9dee_2a66f79f90d9.slice/crio-a1a29411321cdd103726715d8ad470810f4a89b7a656c2583a5a5c4c41896cfe WatchSource:0}: Error finding container a1a29411321cdd103726715d8ad470810f4a89b7a656c2583a5a5c4c41896cfe: Status 404 returned error can't find the container with id a1a29411321cdd103726715d8ad470810f4a89b7a656c2583a5a5c4c41896cfe
Jul 31 20:40:04.815401 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.815386    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 20:40:04.847620 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.847594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3f18a04-895e-4a99-8eef-ce01940c27a5-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-gfts2\" (UID: \"b3f18a04-895e-4a99-8eef-ce01940c27a5\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gfts2"
Jul 31 20:40:04.847767 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.847622    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdgz5\" (UniqueName: \"kubernetes.io/projected/b3f18a04-895e-4a99-8eef-ce01940c27a5-kube-api-access-tdgz5\") pod \"payload-pre-processing-687dbb6cf6-gfts2\" (UID: \"b3f18a04-895e-4a99-8eef-ce01940c27a5\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gfts2"
Jul 31 20:40:04.848345 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.848312    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3f18a04-895e-4a99-8eef-ce01940c27a5-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-gfts2\" (UID: \"b3f18a04-895e-4a99-8eef-ce01940c27a5\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gfts2"
Jul 31 20:40:04.861690 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:04.861662    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdgz5\" (UniqueName: \"kubernetes.io/projected/b3f18a04-895e-4a99-8eef-ce01940c27a5-kube-api-access-tdgz5\") pod \"payload-pre-processing-687dbb6cf6-gfts2\" (UID: \"b3f18a04-895e-4a99-8eef-ce01940c27a5\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gfts2"
Jul 31 20:40:05.040296 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:05.040263    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gfts2"
Jul 31 20:40:05.169144 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:05.169115    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-gfts2"]
Jul 31 20:40:05.171345 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:40:05.171318    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f18a04_895e_4a99_8eef_ce01940c27a5.slice/crio-7ed1f3c0c62fbc2ebaea5ed0cdb13f7e6785fd2cfa926bbacc10ff4f1f9c2142 WatchSource:0}: Error finding container 7ed1f3c0c62fbc2ebaea5ed0cdb13f7e6785fd2cfa926bbacc10ff4f1f9c2142: Status 404 returned error can't find the container with id 7ed1f3c0c62fbc2ebaea5ed0cdb13f7e6785fd2cfa926bbacc10ff4f1f9c2142
Jul 31 20:40:05.781835 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:05.781788    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h" event={"ID":"07ffe8d2-f071-4521-9dee-2a66f79f90d9","Type":"ContainerStarted","Data":"a1a29411321cdd103726715d8ad470810f4a89b7a656c2583a5a5c4c41896cfe"}
Jul 31 20:40:05.783369 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:05.783342    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gfts2" event={"ID":"b3f18a04-895e-4a99-8eef-ce01940c27a5","Type":"ContainerStarted","Data":"7ed1f3c0c62fbc2ebaea5ed0cdb13f7e6785fd2cfa926bbacc10ff4f1f9c2142"}
Jul 31 20:40:07.799436 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:07.799382    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h" event={"ID":"07ffe8d2-f071-4521-9dee-2a66f79f90d9","Type":"ContainerStarted","Data":"afe6fb9633b58534fe00b18a2cdeb8100aa17ffa38c9f6df342228b8c0e4b5a3"}
Jul 31 20:40:07.799925 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:07.799488    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h"
Jul 31 20:40:07.800936 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:07.800915    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gfts2" event={"ID":"b3f18a04-895e-4a99-8eef-ce01940c27a5","Type":"ContainerStarted","Data":"863eb1cb0dd218f024f8d1b3111f940511f158d8ff3c75a25e8845319fc64f3b"}
Jul 31 20:40:07.801036 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:07.800965    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gfts2"
Jul 31 20:40:07.816717 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:07.816670    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h" podStartSLOduration=1.6983518819999999 podStartE2EDuration="3.816654983s" totalImagesPullingTime="2.118303101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:40:07.81542198 +0000 UTC m=+616.420716354" watchObservedRunningTime="2026-07-31 20:40:07.816654983 +0000 UTC m=+616.421949370"
Jul 31 20:40:07.830773 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:07.830703    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gfts2" podStartSLOduration=2.024211523 podStartE2EDuration="3.830686033s" totalImagesPullingTime="1.80647451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:40:07.829116208 +0000 UTC m=+616.434410570" watchObservedRunningTime="2026-07-31 20:40:07.830686033 +0000 UTC m=+616.435980419"
Jul 31 20:40:13.811492 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:13.811420    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-684dcf84d-hbz5h"
Jul 31 20:40:14.831517 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:14.831487    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:40:15.920984 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:15.920949    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:40:18.808422 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:18.808383    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gfts2"
Jul 31 20:40:27.247493 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:27.247456    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:40:47.209767 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:40:47.209715    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:41:04.583514 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.583480    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"]
Jul 31 20:41:04.586871 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.586850    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.589582 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.589564    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 31 20:41:04.589840 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.589823    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-h6pmz\""
Jul 31 20:41:04.589919 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.589847    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 31 20:41:04.589919 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.589849    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 31 20:41:04.595604 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.595586    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"]
Jul 31 20:41:04.687933 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.687901    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/880ec7a4-d8a9-4b01-abcc-fa173bb30250-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hdsg7\" (UID: \"880ec7a4-d8a9-4b01-abcc-fa173bb30250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.688134 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.687974    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/880ec7a4-d8a9-4b01-abcc-fa173bb30250-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hdsg7\" (UID: \"880ec7a4-d8a9-4b01-abcc-fa173bb30250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.688134 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.688003    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/880ec7a4-d8a9-4b01-abcc-fa173bb30250-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hdsg7\" (UID: \"880ec7a4-d8a9-4b01-abcc-fa173bb30250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.688134 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.688036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv9mg\" (UniqueName: \"kubernetes.io/projected/880ec7a4-d8a9-4b01-abcc-fa173bb30250-kube-api-access-qv9mg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hdsg7\" (UID: \"880ec7a4-d8a9-4b01-abcc-fa173bb30250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.688134 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.688063    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/880ec7a4-d8a9-4b01-abcc-fa173bb30250-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hdsg7\" (UID: \"880ec7a4-d8a9-4b01-abcc-fa173bb30250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.688134 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.688105    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/880ec7a4-d8a9-4b01-abcc-fa173bb30250-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hdsg7\" (UID: \"880ec7a4-d8a9-4b01-abcc-fa173bb30250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.693039 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.693015    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:41:04.789147 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.789104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/880ec7a4-d8a9-4b01-abcc-fa173bb30250-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hdsg7\" (UID: \"880ec7a4-d8a9-4b01-abcc-fa173bb30250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.789330 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.789154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/880ec7a4-d8a9-4b01-abcc-fa173bb30250-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hdsg7\" (UID: \"880ec7a4-d8a9-4b01-abcc-fa173bb30250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.789330 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.789201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv9mg\" (UniqueName: \"kubernetes.io/projected/880ec7a4-d8a9-4b01-abcc-fa173bb30250-kube-api-access-qv9mg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hdsg7\" (UID: \"880ec7a4-d8a9-4b01-abcc-fa173bb30250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.789330 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.789232    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/880ec7a4-d8a9-4b01-abcc-fa173bb30250-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hdsg7\" (UID: \"880ec7a4-d8a9-4b01-abcc-fa173bb30250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.789330 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.789260    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/880ec7a4-d8a9-4b01-abcc-fa173bb30250-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hdsg7\" (UID: \"880ec7a4-d8a9-4b01-abcc-fa173bb30250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.789330 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.789326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/880ec7a4-d8a9-4b01-abcc-fa173bb30250-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hdsg7\" (UID: \"880ec7a4-d8a9-4b01-abcc-fa173bb30250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.789687 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.789662    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/880ec7a4-d8a9-4b01-abcc-fa173bb30250-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hdsg7\" (UID: \"880ec7a4-d8a9-4b01-abcc-fa173bb30250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.789824 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.789673    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/880ec7a4-d8a9-4b01-abcc-fa173bb30250-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hdsg7\" (UID: \"880ec7a4-d8a9-4b01-abcc-fa173bb30250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.789824 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.789720    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/880ec7a4-d8a9-4b01-abcc-fa173bb30250-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hdsg7\" (UID: \"880ec7a4-d8a9-4b01-abcc-fa173bb30250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.792089 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.792051    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/880ec7a4-d8a9-4b01-abcc-fa173bb30250-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hdsg7\" (UID: \"880ec7a4-d8a9-4b01-abcc-fa173bb30250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.792294 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.792272    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/880ec7a4-d8a9-4b01-abcc-fa173bb30250-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hdsg7\" (UID: \"880ec7a4-d8a9-4b01-abcc-fa173bb30250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.797885 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.797859    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv9mg\" (UniqueName: \"kubernetes.io/projected/880ec7a4-d8a9-4b01-abcc-fa173bb30250-kube-api-access-qv9mg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hdsg7\" (UID: \"880ec7a4-d8a9-4b01-abcc-fa173bb30250\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:04.898007 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:04.897917    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:05.046791 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:05.044590    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"]
Jul 31 20:41:05.088912 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:05.088869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7" event={"ID":"880ec7a4-d8a9-4b01-abcc-fa173bb30250","Type":"ContainerStarted","Data":"65375829ec550a940db74ce91eef837255199062291333e2d511a5aaf50d25de"}
Jul 31 20:41:06.095935 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:06.095896    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7" event={"ID":"880ec7a4-d8a9-4b01-abcc-fa173bb30250","Type":"ContainerStarted","Data":"608b41999f23251eaffd7e84c170b3928c6301a7bae23fc7d7ee8295375bb8a9"}
Jul 31 20:41:06.113824 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:06.113765    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7" podStartSLOduration=1.1642037 podStartE2EDuration="2.113746201s" totalImagesPullingTime="949.542501ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:41:06.11099531 +0000 UTC m=+674.716289673" watchObservedRunningTime="2026-07-31 20:41:06.113746201 +0000 UTC m=+674.719040558"
Jul 31 20:41:14.898573 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:14.898535    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:14.899137 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:14.898600    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:14.911275 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:14.911252    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:15.155541 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:15.155458    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hdsg7"
Jul 31 20:41:17.831878 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:17.831848    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:41:33.831275 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:33.831237    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:41:33.887422 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:33.887379    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:41:35.607267 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:35.607234    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:41:41.788520 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.788487    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"]
Jul 31 20:41:41.793024 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.793003    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:41.795251 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.795208    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 31 20:41:41.797309 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.797285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/322213fd-b4ef-4382-9194-eaa47143d604-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbsk7\" (UID: \"322213fd-b4ef-4382-9194-eaa47143d604\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:41.797396 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.797328    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/322213fd-b4ef-4382-9194-eaa47143d604-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbsk7\" (UID: \"322213fd-b4ef-4382-9194-eaa47143d604\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:41.797396 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.797344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/322213fd-b4ef-4382-9194-eaa47143d604-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbsk7\" (UID: \"322213fd-b4ef-4382-9194-eaa47143d604\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:41.797396 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.797391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd8kn\" (UniqueName: \"kubernetes.io/projected/322213fd-b4ef-4382-9194-eaa47143d604-kube-api-access-rd8kn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbsk7\" (UID: \"322213fd-b4ef-4382-9194-eaa47143d604\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:41.797553 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.797406    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/322213fd-b4ef-4382-9194-eaa47143d604-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbsk7\" (UID: \"322213fd-b4ef-4382-9194-eaa47143d604\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:41.797553 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.797494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/322213fd-b4ef-4382-9194-eaa47143d604-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbsk7\" (UID: \"322213fd-b4ef-4382-9194-eaa47143d604\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:41.803516 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.803494    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"]
Jul 31 20:41:41.838034 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.837994    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:41:41.898252 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.898220    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd8kn\" (UniqueName: \"kubernetes.io/projected/322213fd-b4ef-4382-9194-eaa47143d604-kube-api-access-rd8kn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbsk7\" (UID: \"322213fd-b4ef-4382-9194-eaa47143d604\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:41.898414 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.898259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/322213fd-b4ef-4382-9194-eaa47143d604-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbsk7\" (UID: \"322213fd-b4ef-4382-9194-eaa47143d604\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:41.898414 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.898304    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/322213fd-b4ef-4382-9194-eaa47143d604-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbsk7\" (UID: \"322213fd-b4ef-4382-9194-eaa47143d604\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:41.898414 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.898338    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/322213fd-b4ef-4382-9194-eaa47143d604-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbsk7\" (UID: \"322213fd-b4ef-4382-9194-eaa47143d604\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:41.898414 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.898372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/322213fd-b4ef-4382-9194-eaa47143d604-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbsk7\" (UID: \"322213fd-b4ef-4382-9194-eaa47143d604\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:41.898414 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.898388    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/322213fd-b4ef-4382-9194-eaa47143d604-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbsk7\" (UID: \"322213fd-b4ef-4382-9194-eaa47143d604\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:41.898801 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.898778    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/322213fd-b4ef-4382-9194-eaa47143d604-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbsk7\" (UID: \"322213fd-b4ef-4382-9194-eaa47143d604\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:41.898912 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.898801    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/322213fd-b4ef-4382-9194-eaa47143d604-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbsk7\" (UID: \"322213fd-b4ef-4382-9194-eaa47143d604\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:41.898912 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.898878    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/322213fd-b4ef-4382-9194-eaa47143d604-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbsk7\" (UID: \"322213fd-b4ef-4382-9194-eaa47143d604\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:41.900877 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.900857    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/322213fd-b4ef-4382-9194-eaa47143d604-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbsk7\" (UID: \"322213fd-b4ef-4382-9194-eaa47143d604\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:41.901151 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.901133    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/322213fd-b4ef-4382-9194-eaa47143d604-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbsk7\" (UID: \"322213fd-b4ef-4382-9194-eaa47143d604\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:41.905462 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:41.905437    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd8kn\" (UniqueName: \"kubernetes.io/projected/322213fd-b4ef-4382-9194-eaa47143d604-kube-api-access-rd8kn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dbsk7\" (UID: \"322213fd-b4ef-4382-9194-eaa47143d604\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:42.104591 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:42.104501    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:42.243590 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:42.243566    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"]
Jul 31 20:41:42.245196 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:41:42.245160    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod322213fd_b4ef_4382_9194_eaa47143d604.slice/crio-2fe48b87f65814dd355e520bb3311ee6b598ba71662c679f493409e06aa249b0 WatchSource:0}: Error finding container 2fe48b87f65814dd355e520bb3311ee6b598ba71662c679f493409e06aa249b0: Status 404 returned error can't find the container with id 2fe48b87f65814dd355e520bb3311ee6b598ba71662c679f493409e06aa249b0
Jul 31 20:41:42.288039 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:42.288012    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7" event={"ID":"322213fd-b4ef-4382-9194-eaa47143d604","Type":"ContainerStarted","Data":"2fe48b87f65814dd355e520bb3311ee6b598ba71662c679f493409e06aa249b0"}
Jul 31 20:41:43.294680 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:43.294590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7" event={"ID":"322213fd-b4ef-4382-9194-eaa47143d604","Type":"ContainerStarted","Data":"0def37335474cd266d7067b534b16f8a7f24ac9061e8f3418970d89d59f42768"}
Jul 31 20:41:43.314070 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:43.314023    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7" podStartSLOduration=2.153845145 podStartE2EDuration="2.314008837s" totalImagesPullingTime="160.163692ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:41:43.311370841 +0000 UTC m=+711.916665207" watchObservedRunningTime="2026-07-31 20:41:43.314008837 +0000 UTC m=+711.919303214"
Jul 31 20:41:47.418909 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:47.418872    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:41:48.706947 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:48.706917    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:41:52.105586 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:52.105546    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:52.106114 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:52.105617    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:52.118416 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:52.118387    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:52.352057 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:52.352022    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dbsk7"
Jul 31 20:41:54.748885 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:41:54.748856    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:42:30.374917 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:42:30.374871    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:42:30.476468 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:42:30.476378    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:42:36.886339 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:42:36.886301    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:42:36.988695 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:42:36.988658    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:42:49.293059 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:42:49.293027    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:42:49.359185 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:42:49.359151    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:42:50.429268 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:42:50.429232    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:42:50.567871 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:42:50.567838    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:42:54.191345 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:42:54.191310    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:42:54.292146 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:42:54.292073    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:43:18.312840 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:18.312761    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:43:36.844544 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:36.844506    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bcc9b8b78-cjk8f"]
Jul 31 20:43:36.844997 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:36.844759    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7bcc9b8b78-cjk8f" podUID="b4fdb556-ac72-4616-b62d-38df6ec00aff" containerName="manager" containerID="cri-o://09e5e0c6fa23df33adeb3b94bb7f6f2f48e3908f3db96450036452f397877c71" gracePeriod=30
Jul 31 20:43:37.096817 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:37.096756    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bcc9b8b78-cjk8f"
Jul 31 20:43:37.224826 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:37.224793    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4fdb556-ac72-4616-b62d-38df6ec00aff-webhook-cert\") pod \"b4fdb556-ac72-4616-b62d-38df6ec00aff\" (UID: \"b4fdb556-ac72-4616-b62d-38df6ec00aff\") "
Jul 31 20:43:37.224994 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:37.224917    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7nvh\" (UniqueName: \"kubernetes.io/projected/b4fdb556-ac72-4616-b62d-38df6ec00aff-kube-api-access-p7nvh\") pod \"b4fdb556-ac72-4616-b62d-38df6ec00aff\" (UID: \"b4fdb556-ac72-4616-b62d-38df6ec00aff\") "
Jul 31 20:43:37.226965 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:37.226933    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4fdb556-ac72-4616-b62d-38df6ec00aff-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b4fdb556-ac72-4616-b62d-38df6ec00aff" (UID: "b4fdb556-ac72-4616-b62d-38df6ec00aff"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:43:37.227062 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:37.226981    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4fdb556-ac72-4616-b62d-38df6ec00aff-kube-api-access-p7nvh" (OuterVolumeSpecName: "kube-api-access-p7nvh") pod "b4fdb556-ac72-4616-b62d-38df6ec00aff" (UID: "b4fdb556-ac72-4616-b62d-38df6ec00aff"). InnerVolumeSpecName "kube-api-access-p7nvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:43:37.325802 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:37.325730    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7nvh\" (UniqueName: \"kubernetes.io/projected/b4fdb556-ac72-4616-b62d-38df6ec00aff-kube-api-access-p7nvh\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:43:37.325802 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:37.325796    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4fdb556-ac72-4616-b62d-38df6ec00aff-webhook-cert\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:43:37.884284 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:37.884247    2565 generic.go:356] "Generic (PLEG): container finished" podID="b4fdb556-ac72-4616-b62d-38df6ec00aff" containerID="09e5e0c6fa23df33adeb3b94bb7f6f2f48e3908f3db96450036452f397877c71" exitCode=0
Jul 31 20:43:37.884728 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:37.884290    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bcc9b8b78-cjk8f"
Jul 31 20:43:37.884728 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:37.884333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bcc9b8b78-cjk8f" event={"ID":"b4fdb556-ac72-4616-b62d-38df6ec00aff","Type":"ContainerDied","Data":"09e5e0c6fa23df33adeb3b94bb7f6f2f48e3908f3db96450036452f397877c71"}
Jul 31 20:43:37.884728 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:37.884378    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bcc9b8b78-cjk8f" event={"ID":"b4fdb556-ac72-4616-b62d-38df6ec00aff","Type":"ContainerDied","Data":"eae875c3c5a473559185e2764525c59333eb29c852cf2d0e1016abc2086a8e32"}
Jul 31 20:43:37.884728 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:37.884402    2565 scope.go:117] "RemoveContainer" containerID="09e5e0c6fa23df33adeb3b94bb7f6f2f48e3908f3db96450036452f397877c71"
Jul 31 20:43:37.893967 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:37.893948    2565 scope.go:117] "RemoveContainer" containerID="09e5e0c6fa23df33adeb3b94bb7f6f2f48e3908f3db96450036452f397877c71"
Jul 31 20:43:37.894208 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:43:37.894191    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09e5e0c6fa23df33adeb3b94bb7f6f2f48e3908f3db96450036452f397877c71\": container with ID starting with 09e5e0c6fa23df33adeb3b94bb7f6f2f48e3908f3db96450036452f397877c71 not found: ID does not exist" containerID="09e5e0c6fa23df33adeb3b94bb7f6f2f48e3908f3db96450036452f397877c71"
Jul 31 20:43:37.894254 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:37.894216    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09e5e0c6fa23df33adeb3b94bb7f6f2f48e3908f3db96450036452f397877c71"} err="failed to get container status \"09e5e0c6fa23df33adeb3b94bb7f6f2f48e3908f3db96450036452f397877c71\": rpc error: code = NotFound desc = could not find container \"09e5e0c6fa23df33adeb3b94bb7f6f2f48e3908f3db96450036452f397877c71\": container with ID starting with 09e5e0c6fa23df33adeb3b94bb7f6f2f48e3908f3db96450036452f397877c71 not found: ID does not exist"
Jul 31 20:43:37.905059 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:37.905034    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bcc9b8b78-cjk8f"]
Jul 31 20:43:37.909317 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:37.909287    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bcc9b8b78-cjk8f"]
Jul 31 20:43:37.917516 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:43:37.917490    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4fdb556-ac72-4616-b62d-38df6ec00aff" path="/var/lib/kubelet/pods/b4fdb556-ac72-4616-b62d-38df6ec00aff/volumes"
Jul 31 20:44:38.722259 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:38.722223    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bcc9b8b78-28qt7"]
Jul 31 20:44:38.722708 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:38.722568    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4fdb556-ac72-4616-b62d-38df6ec00aff" containerName="manager"
Jul 31 20:44:38.722708 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:38.722579    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4fdb556-ac72-4616-b62d-38df6ec00aff" containerName="manager"
Jul 31 20:44:38.722708 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:38.722638    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4fdb556-ac72-4616-b62d-38df6ec00aff" containerName="manager"
Jul 31 20:44:38.725627 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:38.725611    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bcc9b8b78-28qt7"
Jul 31 20:44:38.728019 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:38.727994    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 31 20:44:38.728019 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:38.728012    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 31 20:44:38.728212 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:38.727997    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8zj2s\""
Jul 31 20:44:38.738389 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:38.738355    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bcc9b8b78-28qt7"]
Jul 31 20:44:38.876243 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:38.876204    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a46e0aac-5be7-4df0-b561-36120ed3844b-webhook-cert\") pod \"maas-controller-7bcc9b8b78-28qt7\" (UID: \"a46e0aac-5be7-4df0-b561-36120ed3844b\") " pod="opendatahub/maas-controller-7bcc9b8b78-28qt7"
Jul 31 20:44:38.876443 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:38.876334    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjsvs\" (UniqueName: \"kubernetes.io/projected/a46e0aac-5be7-4df0-b561-36120ed3844b-kube-api-access-jjsvs\") pod \"maas-controller-7bcc9b8b78-28qt7\" (UID: \"a46e0aac-5be7-4df0-b561-36120ed3844b\") " pod="opendatahub/maas-controller-7bcc9b8b78-28qt7"
Jul 31 20:44:38.977053 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:38.976961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a46e0aac-5be7-4df0-b561-36120ed3844b-webhook-cert\") pod \"maas-controller-7bcc9b8b78-28qt7\" (UID: \"a46e0aac-5be7-4df0-b561-36120ed3844b\") " pod="opendatahub/maas-controller-7bcc9b8b78-28qt7"
Jul 31 20:44:38.977213 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:38.977058    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjsvs\" (UniqueName: \"kubernetes.io/projected/a46e0aac-5be7-4df0-b561-36120ed3844b-kube-api-access-jjsvs\") pod \"maas-controller-7bcc9b8b78-28qt7\" (UID: \"a46e0aac-5be7-4df0-b561-36120ed3844b\") " pod="opendatahub/maas-controller-7bcc9b8b78-28qt7"
Jul 31 20:44:38.979544 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:38.979524    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a46e0aac-5be7-4df0-b561-36120ed3844b-webhook-cert\") pod \"maas-controller-7bcc9b8b78-28qt7\" (UID: \"a46e0aac-5be7-4df0-b561-36120ed3844b\") " pod="opendatahub/maas-controller-7bcc9b8b78-28qt7"
Jul 31 20:44:38.985416 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:38.985391    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjsvs\" (UniqueName: \"kubernetes.io/projected/a46e0aac-5be7-4df0-b561-36120ed3844b-kube-api-access-jjsvs\") pod \"maas-controller-7bcc9b8b78-28qt7\" (UID: \"a46e0aac-5be7-4df0-b561-36120ed3844b\") " pod="opendatahub/maas-controller-7bcc9b8b78-28qt7"
Jul 31 20:44:39.057645 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:39.057616    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bcc9b8b78-28qt7"
Jul 31 20:44:39.402442 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:39.402413    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bcc9b8b78-28qt7"]
Jul 31 20:44:39.404019 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:44:39.403991    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46e0aac_5be7_4df0_b561_36120ed3844b.slice/crio-f92d19942e5bab3b6c6f83df9d29eb6ade167a09eb2994c7757ea9c29e9105c1 WatchSource:0}: Error finding container f92d19942e5bab3b6c6f83df9d29eb6ade167a09eb2994c7757ea9c29e9105c1: Status 404 returned error can't find the container with id f92d19942e5bab3b6c6f83df9d29eb6ade167a09eb2994c7757ea9c29e9105c1
Jul 31 20:44:40.196663 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:40.196631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bcc9b8b78-28qt7" event={"ID":"a46e0aac-5be7-4df0-b561-36120ed3844b","Type":"ContainerStarted","Data":"005d68a229a317bcf2479de6d397d04162ec7e7b39e3f65716404e6542bc7821"}
Jul 31 20:44:40.197058 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:40.196681    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bcc9b8b78-28qt7" event={"ID":"a46e0aac-5be7-4df0-b561-36120ed3844b","Type":"ContainerStarted","Data":"f92d19942e5bab3b6c6f83df9d29eb6ade167a09eb2994c7757ea9c29e9105c1"}
Jul 31 20:44:40.197058 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:40.196727    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bcc9b8b78-28qt7"
Jul 31 20:44:40.213988 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:40.213935    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bcc9b8b78-28qt7" podStartSLOduration=1.73292608 podStartE2EDuration="2.213919189s" totalImagesPullingTime="480.993109ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:44:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:44:40.212318268 +0000 UTC m=+888.817612628" watchObservedRunningTime="2026-07-31 20:44:40.213919189 +0000 UTC m=+888.819213552"
Jul 31 20:44:51.203640 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:51.203564    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bcc9b8b78-28qt7"
Jul 31 20:44:51.881998 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:51.881962    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 20:44:51.884843 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:51.884824    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 20:44:51.886478 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:51.886457    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 20:44:51.889626 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:51.889610    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 20:44:55.793710 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:55.793669    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:44:55.857514 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:55.857476    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bcc9b8b78-28qt7"]
Jul 31 20:44:55.857830 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:55.857802    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7bcc9b8b78-28qt7" podUID="a46e0aac-5be7-4df0-b561-36120ed3844b" containerName="manager" containerID="cri-o://005d68a229a317bcf2479de6d397d04162ec7e7b39e3f65716404e6542bc7821" gracePeriod=30
Jul 31 20:44:56.210233 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:56.210204    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bcc9b8b78-28qt7"
Jul 31 20:44:56.225014 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:56.224985    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a46e0aac-5be7-4df0-b561-36120ed3844b-webhook-cert\") pod \"a46e0aac-5be7-4df0-b561-36120ed3844b\" (UID: \"a46e0aac-5be7-4df0-b561-36120ed3844b\") "
Jul 31 20:44:56.225101 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:56.225031    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjsvs\" (UniqueName: \"kubernetes.io/projected/a46e0aac-5be7-4df0-b561-36120ed3844b-kube-api-access-jjsvs\") pod \"a46e0aac-5be7-4df0-b561-36120ed3844b\" (UID: \"a46e0aac-5be7-4df0-b561-36120ed3844b\") "
Jul 31 20:44:56.227817 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:56.227781    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a46e0aac-5be7-4df0-b561-36120ed3844b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a46e0aac-5be7-4df0-b561-36120ed3844b" (UID: "a46e0aac-5be7-4df0-b561-36120ed3844b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:44:56.227956 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:56.227899    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46e0aac-5be7-4df0-b561-36120ed3844b-kube-api-access-jjsvs" (OuterVolumeSpecName: "kube-api-access-jjsvs") pod "a46e0aac-5be7-4df0-b561-36120ed3844b" (UID: "a46e0aac-5be7-4df0-b561-36120ed3844b"). InnerVolumeSpecName "kube-api-access-jjsvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:44:56.279166 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:56.279137    2565 generic.go:356] "Generic (PLEG): container finished" podID="a46e0aac-5be7-4df0-b561-36120ed3844b" containerID="005d68a229a317bcf2479de6d397d04162ec7e7b39e3f65716404e6542bc7821" exitCode=0
Jul 31 20:44:56.279334 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:56.279184    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bcc9b8b78-28qt7"
Jul 31 20:44:56.279334 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:56.279202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bcc9b8b78-28qt7" event={"ID":"a46e0aac-5be7-4df0-b561-36120ed3844b","Type":"ContainerDied","Data":"005d68a229a317bcf2479de6d397d04162ec7e7b39e3f65716404e6542bc7821"}
Jul 31 20:44:56.279334 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:56.279246    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bcc9b8b78-28qt7" event={"ID":"a46e0aac-5be7-4df0-b561-36120ed3844b","Type":"ContainerDied","Data":"f92d19942e5bab3b6c6f83df9d29eb6ade167a09eb2994c7757ea9c29e9105c1"}
Jul 31 20:44:56.279334 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:56.279266    2565 scope.go:117] "RemoveContainer" containerID="005d68a229a317bcf2479de6d397d04162ec7e7b39e3f65716404e6542bc7821"
Jul 31 20:44:56.288646 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:56.288624    2565 scope.go:117] "RemoveContainer" containerID="005d68a229a317bcf2479de6d397d04162ec7e7b39e3f65716404e6542bc7821"
Jul 31 20:44:56.288940 ip-10-0-128-218 kubenswrapper[2565]: E0731 20:44:56.288921    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"005d68a229a317bcf2479de6d397d04162ec7e7b39e3f65716404e6542bc7821\": container with ID starting with 005d68a229a317bcf2479de6d397d04162ec7e7b39e3f65716404e6542bc7821 not found: ID does not exist" containerID="005d68a229a317bcf2479de6d397d04162ec7e7b39e3f65716404e6542bc7821"
Jul 31 20:44:56.289008 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:56.288950    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"005d68a229a317bcf2479de6d397d04162ec7e7b39e3f65716404e6542bc7821"} err="failed to get container status \"005d68a229a317bcf2479de6d397d04162ec7e7b39e3f65716404e6542bc7821\": rpc error: code = NotFound desc = could not find container \"005d68a229a317bcf2479de6d397d04162ec7e7b39e3f65716404e6542bc7821\": container with ID starting with 005d68a229a317bcf2479de6d397d04162ec7e7b39e3f65716404e6542bc7821 not found: ID does not exist"
Jul 31 20:44:56.298392 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:56.298369    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bcc9b8b78-28qt7"]
Jul 31 20:44:56.301938 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:56.301912    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bcc9b8b78-28qt7"]
Jul 31 20:44:56.326130 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:56.326061    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a46e0aac-5be7-4df0-b561-36120ed3844b-webhook-cert\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:44:56.326130 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:56.326087    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjsvs\" (UniqueName: \"kubernetes.io/projected/a46e0aac-5be7-4df0-b561-36120ed3844b-kube-api-access-jjsvs\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 20:44:56.981848 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:56.981811    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:44:57.090381 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:57.090344    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bcc9b8b78-jb86f"]
Jul 31 20:44:57.090724 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:57.090708    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a46e0aac-5be7-4df0-b561-36120ed3844b" containerName="manager"
Jul 31 20:44:57.090800 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:57.090726    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a46e0aac-5be7-4df0-b561-36120ed3844b" containerName="manager"
Jul 31 20:44:57.090834 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:57.090816    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a46e0aac-5be7-4df0-b561-36120ed3844b" containerName="manager"
Jul 31 20:44:57.094995 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:57.094976    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bcc9b8b78-jb86f"
Jul 31 20:44:57.097487 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:57.097464    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 31 20:44:57.097605 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:57.097467    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 31 20:44:57.097605 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:57.097522    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8zj2s\""
Jul 31 20:44:57.104669 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:57.104647    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bcc9b8b78-jb86f"]
Jul 31 20:44:57.132383 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:57.132354    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7949\" (UniqueName: \"kubernetes.io/projected/b72075ef-3822-4a63-83bc-058d4c7104a9-kube-api-access-g7949\") pod \"maas-controller-7bcc9b8b78-jb86f\" (UID: \"b72075ef-3822-4a63-83bc-058d4c7104a9\") " pod="opendatahub/maas-controller-7bcc9b8b78-jb86f"
Jul 31 20:44:57.132537 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:57.132450    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b72075ef-3822-4a63-83bc-058d4c7104a9-webhook-cert\") pod \"maas-controller-7bcc9b8b78-jb86f\" (UID: \"b72075ef-3822-4a63-83bc-058d4c7104a9\") " pod="opendatahub/maas-controller-7bcc9b8b78-jb86f"
Jul 31 20:44:57.233791 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:57.233668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7949\" (UniqueName: \"kubernetes.io/projected/b72075ef-3822-4a63-83bc-058d4c7104a9-kube-api-access-g7949\") pod \"maas-controller-7bcc9b8b78-jb86f\" (UID: \"b72075ef-3822-4a63-83bc-058d4c7104a9\") " pod="opendatahub/maas-controller-7bcc9b8b78-jb86f"
Jul 31 20:44:57.233791 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:57.233723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b72075ef-3822-4a63-83bc-058d4c7104a9-webhook-cert\") pod \"maas-controller-7bcc9b8b78-jb86f\" (UID: \"b72075ef-3822-4a63-83bc-058d4c7104a9\") " pod="opendatahub/maas-controller-7bcc9b8b78-jb86f"
Jul 31 20:44:57.236331 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:57.236304    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b72075ef-3822-4a63-83bc-058d4c7104a9-webhook-cert\") pod \"maas-controller-7bcc9b8b78-jb86f\" (UID: \"b72075ef-3822-4a63-83bc-058d4c7104a9\") " pod="opendatahub/maas-controller-7bcc9b8b78-jb86f"
Jul 31 20:44:57.243396 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:57.243374    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7949\" (UniqueName: \"kubernetes.io/projected/b72075ef-3822-4a63-83bc-058d4c7104a9-kube-api-access-g7949\") pod \"maas-controller-7bcc9b8b78-jb86f\" (UID: \"b72075ef-3822-4a63-83bc-058d4c7104a9\") " pod="opendatahub/maas-controller-7bcc9b8b78-jb86f"
Jul 31 20:44:57.407261 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:57.407227    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bcc9b8b78-jb86f"
Jul 31 20:44:57.750647 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:57.750623    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bcc9b8b78-jb86f"]
Jul 31 20:44:57.752746 ip-10-0-128-218 kubenswrapper[2565]: W0731 20:44:57.752693    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb72075ef_3822_4a63_83bc_058d4c7104a9.slice/crio-f1bf0b94dfadf7a8c490228e67122537b3487523f71c33a85972cc622c4d21f7 WatchSource:0}: Error finding container f1bf0b94dfadf7a8c490228e67122537b3487523f71c33a85972cc622c4d21f7: Status 404 returned error can't find the container with id f1bf0b94dfadf7a8c490228e67122537b3487523f71c33a85972cc622c4d21f7
Jul 31 20:44:57.915088 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:57.915049    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a46e0aac-5be7-4df0-b561-36120ed3844b" path="/var/lib/kubelet/pods/a46e0aac-5be7-4df0-b561-36120ed3844b/volumes"
Jul 31 20:44:58.292174 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:58.292138    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bcc9b8b78-jb86f" event={"ID":"b72075ef-3822-4a63-83bc-058d4c7104a9","Type":"ContainerStarted","Data":"a644a4df7de945335200f7ffe9c58020d21e0560ec55b8d0d8f66d7584e4df63"}
Jul 31 20:44:58.292594 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:58.292231    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bcc9b8b78-jb86f"
Jul 31 20:44:58.292594 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:58.292250    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bcc9b8b78-jb86f" event={"ID":"b72075ef-3822-4a63-83bc-058d4c7104a9","Type":"ContainerStarted","Data":"f1bf0b94dfadf7a8c490228e67122537b3487523f71c33a85972cc622c4d21f7"}
Jul 31 20:44:58.309540 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:44:58.309483    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bcc9b8b78-jb86f" podStartSLOduration=0.88823076 podStartE2EDuration="1.309462461s" totalImagesPullingTime="421.231701ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:44:58.30757293 +0000 UTC m=+906.912867293" watchObservedRunningTime="2026-07-31 20:44:58.309462461 +0000 UTC m=+906.914756825"
Jul 31 20:45:09.299886 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:45:09.299851    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bcc9b8b78-jb86f"
Jul 31 20:45:59.870495 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:45:59.870451    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:46:01.010301 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:46:01.010268    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:46:05.830441 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:46:05.830399    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:46:05.933211 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:46:05.933174    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:46:06.030603 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:46:06.030563    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:46:06.186910 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:46:06.186874    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:46:11.969883 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:46:11.969848    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:46:12.067805 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:46:12.067764    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:48:02.840538 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:48:02.840456    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:48:02.924860 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:48:02.924824    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:49:06.712933 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:49:06.712894    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:49:51.914152 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:49:51.914118    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 20:49:51.919036 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:49:51.919015    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 20:49:51.919666 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:49:51.919644    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 20:49:51.924255 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:49:51.924231    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 20:50:53.242795 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:50:53.242655    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:52:02.158126 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:52:02.158089    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:52:03.387628 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:52:03.387589    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:54:07.028173 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:54:07.028086    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:54:51.945770 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:54:51.945723    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 20:54:51.950423 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:54:51.950397    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 20:54:51.952966 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:54:51.952946    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 20:54:51.957346 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:54:51.957329    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 20:55:24.516720 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:55:24.516622    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:55:41.420192 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:55:41.420139    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:56:00.392473 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:56:00.392439    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:56:02.009506 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:56:02.009466    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:59:27.485370 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:59:27.485328    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:59:28.780986 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:59:28.780955    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:59:51.981594 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:59:51.981565    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 20:59:51.986808 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:59:51.986780    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 20:59:51.989656 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:59:51.989632    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 20:59:51.994175 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:59:51.994158    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 20:59:53.852059 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:59:53.852026    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:59:56.998248 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:59:56.998210    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:59:57.095093 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:59:57.095058    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 20:59:57.428387 ip-10-0-128-218 kubenswrapper[2565]: I0731 20:59:57.428293    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:03.005379 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:03.005344    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:03.308593 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:03.308503    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:03.368786 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:03.368724    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:03.682348 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:03.682320    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:03.782750 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:03.782703    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:05.536554 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:05.536519    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:05.636525 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:05.636493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:06.630365 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:06.630331    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"]
Jul 31 21:00:06.633836 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:06.633815    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"
Jul 31 21:00:06.635949 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:06.635925    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c5bdfd41-serving-cert\""
Jul 31 21:00:06.645379 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:06.645358    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"]
Jul 31 21:00:06.668035 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:06.668004    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:06.732793 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:06.732666    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75923243-2301-4afc-a727-7791e1bd6f9e-maas-api-tls\") pod \"maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst\" (UID: \"75923243-2301-4afc-a727-7791e1bd6f9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"
Jul 31 21:00:06.733051 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:06.732808    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ml7w\" (UniqueName: \"kubernetes.io/projected/75923243-2301-4afc-a727-7791e1bd6f9e-kube-api-access-7ml7w\") pod \"maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst\" (UID: \"75923243-2301-4afc-a727-7791e1bd6f9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"
Jul 31 21:00:06.733051 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:06.732848    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75923243-2301-4afc-a727-7791e1bd6f9e-openshift-service-ca\") pod \"maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst\" (UID: \"75923243-2301-4afc-a727-7791e1bd6f9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"
Jul 31 21:00:06.834212 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:06.834170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75923243-2301-4afc-a727-7791e1bd6f9e-openshift-service-ca\") pod \"maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst\" (UID: \"75923243-2301-4afc-a727-7791e1bd6f9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"
Jul 31 21:00:06.834412 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:06.834284    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75923243-2301-4afc-a727-7791e1bd6f9e-maas-api-tls\") pod \"maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst\" (UID: \"75923243-2301-4afc-a727-7791e1bd6f9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"
Jul 31 21:00:06.834412 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:06.834348    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ml7w\" (UniqueName: \"kubernetes.io/projected/75923243-2301-4afc-a727-7791e1bd6f9e-kube-api-access-7ml7w\") pod \"maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst\" (UID: \"75923243-2301-4afc-a727-7791e1bd6f9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"
Jul 31 21:00:06.834514 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:00:06.834442    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-serving-cert: secret "maas-api-e2e-ait-c5bdfd41-serving-cert" not found
Jul 31 21:00:06.834554 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:00:06.834528    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75923243-2301-4afc-a727-7791e1bd6f9e-maas-api-tls podName:75923243-2301-4afc-a727-7791e1bd6f9e nodeName:}" failed. No retries permitted until 2026-07-31 21:00:07.334509516 +0000 UTC m=+1815.939803858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/75923243-2301-4afc-a727-7791e1bd6f9e-maas-api-tls") pod "maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst" (UID: "75923243-2301-4afc-a727-7791e1bd6f9e") : secret "maas-api-e2e-ait-c5bdfd41-serving-cert" not found
Jul 31 21:00:06.834840 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:06.834821    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75923243-2301-4afc-a727-7791e1bd6f9e-openshift-service-ca\") pod \"maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst\" (UID: \"75923243-2301-4afc-a727-7791e1bd6f9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"
Jul 31 21:00:06.842619 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:06.842598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ml7w\" (UniqueName: \"kubernetes.io/projected/75923243-2301-4afc-a727-7791e1bd6f9e-kube-api-access-7ml7w\") pod \"maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst\" (UID: \"75923243-2301-4afc-a727-7791e1bd6f9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"
Jul 31 21:00:07.149998 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.149963    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:07.241151 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.241117    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:07.289070 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.289031    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7"]
Jul 31 21:00:07.294520 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.294494    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7"
Jul 31 21:00:07.297169 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.297141    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-c5bdfd41-dockercfg-t4mlx\""
Jul 31 21:00:07.297325 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.297284    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-c5bdfd41\""
Jul 31 21:00:07.299915 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.299878    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7"]
Jul 31 21:00:07.322027 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.321978    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:07.338212 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.338174    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx5l8\" (UniqueName: \"kubernetes.io/projected/639cf4d3-cb08-4670-8ff5-42223c132161-kube-api-access-kx5l8\") pod \"payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7\" (UID: \"639cf4d3-cb08-4670-8ff5-42223c132161\") " pod="openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7"
Jul 31 21:00:07.338485 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.338460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/639cf4d3-cb08-4670-8ff5-42223c132161-plugins-config-volume\") pod \"payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7\" (UID: \"639cf4d3-cb08-4670-8ff5-42223c132161\") " pod="openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7"
Jul 31 21:00:07.338719 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.338700    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75923243-2301-4afc-a727-7791e1bd6f9e-maas-api-tls\") pod \"maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst\" (UID: \"75923243-2301-4afc-a727-7791e1bd6f9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"
Jul 31 21:00:07.342116 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.342057    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75923243-2301-4afc-a727-7791e1bd6f9e-maas-api-tls\") pod \"maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst\" (UID: \"75923243-2301-4afc-a727-7791e1bd6f9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"
Jul 31 21:00:07.439874 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.439847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/639cf4d3-cb08-4670-8ff5-42223c132161-plugins-config-volume\") pod \"payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7\" (UID: \"639cf4d3-cb08-4670-8ff5-42223c132161\") " pod="openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7"
Jul 31 21:00:07.440028 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.439956    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx5l8\" (UniqueName: \"kubernetes.io/projected/639cf4d3-cb08-4670-8ff5-42223c132161-kube-api-access-kx5l8\") pod \"payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7\" (UID: \"639cf4d3-cb08-4670-8ff5-42223c132161\") " pod="openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7"
Jul 31 21:00:07.440572 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.440551    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/639cf4d3-cb08-4670-8ff5-42223c132161-plugins-config-volume\") pod \"payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7\" (UID: \"639cf4d3-cb08-4670-8ff5-42223c132161\") " pod="openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7"
Jul 31 21:00:07.447645 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.447612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx5l8\" (UniqueName: \"kubernetes.io/projected/639cf4d3-cb08-4670-8ff5-42223c132161-kube-api-access-kx5l8\") pod \"payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7\" (UID: \"639cf4d3-cb08-4670-8ff5-42223c132161\") " pod="openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7"
Jul 31 21:00:07.545834 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.545793    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"
Jul 31 21:00:07.607374 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.606961    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7"
Jul 31 21:00:07.695042 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.695008    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"]
Jul 31 21:00:07.696614 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:00:07.696587    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75923243_2301_4afc_a727_7791e1bd6f9e.slice/crio-b21294ba037576ecb2e5a33ae341fc1261573270e06e15e1ce83d4ea232515b0 WatchSource:0}: Error finding container b21294ba037576ecb2e5a33ae341fc1261573270e06e15e1ce83d4ea232515b0: Status 404 returned error can't find the container with id b21294ba037576ecb2e5a33ae341fc1261573270e06e15e1ce83d4ea232515b0
Jul 31 21:00:07.698042 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.698025    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 21:00:07.754775 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.754725    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7"]
Jul 31 21:00:07.759033 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:00:07.758999    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod639cf4d3_cb08_4670_8ff5_42223c132161.slice/crio-d6bb5f19572684e10efb0676f5cd87030df2053690cb0e549c8d68f4d9f778b8 WatchSource:0}: Error finding container d6bb5f19572684e10efb0676f5cd87030df2053690cb0e549c8d68f4d9f778b8: Status 404 returned error can't find the container with id d6bb5f19572684e10efb0676f5cd87030df2053690cb0e549c8d68f4d9f778b8
Jul 31 21:00:07.968979 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.968888    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst" event={"ID":"75923243-2301-4afc-a727-7791e1bd6f9e","Type":"ContainerStarted","Data":"b21294ba037576ecb2e5a33ae341fc1261573270e06e15e1ce83d4ea232515b0"}
Jul 31 21:00:07.970422 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.970393    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7" event={"ID":"639cf4d3-cb08-4670-8ff5-42223c132161","Type":"ContainerStarted","Data":"812aca5abb7179082a2bbf7fdf8ec3768f57ce3f0f0169a04293646e5db2d655"}
Jul 31 21:00:07.970558 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.970442    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7" event={"ID":"639cf4d3-cb08-4670-8ff5-42223c132161","Type":"ContainerStarted","Data":"d6bb5f19572684e10efb0676f5cd87030df2053690cb0e549c8d68f4d9f778b8"}
Jul 31 21:00:07.970558 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.970538    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7"
Jul 31 21:00:07.986048 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:07.985995    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7" podStartSLOduration=0.985979013 podStartE2EDuration="985.979013ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:00:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:00:07.983726303 +0000 UTC m=+1816.589020665" watchObservedRunningTime="2026-07-31 21:00:07.985979013 +0000 UTC m=+1816.591273376"
Jul 31 21:00:08.978010 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:08.977972    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst" event={"ID":"75923243-2301-4afc-a727-7791e1bd6f9e","Type":"ContainerStarted","Data":"7756ded97ce05e3ddbcb26a7779f1e502eee4fd90f17c7f71bdbde321faa4df9"}
Jul 31 21:00:08.978468 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:08.978129    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"
Jul 31 21:00:08.993724 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:08.993670    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst" podStartSLOduration=2.524664687 podStartE2EDuration="2.993654645s" totalImagesPullingTime="468.989958ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:00:08.992934276 +0000 UTC m=+1817.598228652" watchObservedRunningTime="2026-07-31 21:00:08.993654645 +0000 UTC m=+1817.598949008"
Jul 31 21:00:14.989019 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:14.988989    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"
Jul 31 21:00:18.980240 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:18.980210    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7"
Jul 31 21:00:37.105696 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.105661    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"]
Jul 31 21:00:37.106370 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.105903    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst" podUID="75923243-2301-4afc-a727-7791e1bd6f9e" containerName="maas-api" containerID="cri-o://7756ded97ce05e3ddbcb26a7779f1e502eee4fd90f17c7f71bdbde321faa4df9" gracePeriod=30
Jul 31 21:00:37.131921 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.131895    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:37.208472 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.208431    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7"]
Jul 31 21:00:37.208756 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.208709    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7" podUID="639cf4d3-cb08-4670-8ff5-42223c132161" containerName="payload-processing" containerID="cri-o://812aca5abb7179082a2bbf7fdf8ec3768f57ce3f0f0169a04293646e5db2d655" gracePeriod=30
Jul 31 21:00:37.299797 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.299729    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:37.369125 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.368961    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:37.380290 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.380263    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"
Jul 31 21:00:37.488675 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.488649    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7"
Jul 31 21:00:37.515806 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.515779    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75923243-2301-4afc-a727-7791e1bd6f9e-maas-api-tls\") pod \"75923243-2301-4afc-a727-7791e1bd6f9e\" (UID: \"75923243-2301-4afc-a727-7791e1bd6f9e\") "
Jul 31 21:00:37.515986 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.515813    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75923243-2301-4afc-a727-7791e1bd6f9e-openshift-service-ca\") pod \"75923243-2301-4afc-a727-7791e1bd6f9e\" (UID: \"75923243-2301-4afc-a727-7791e1bd6f9e\") "
Jul 31 21:00:37.515986 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.515938    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ml7w\" (UniqueName: \"kubernetes.io/projected/75923243-2301-4afc-a727-7791e1bd6f9e-kube-api-access-7ml7w\") pod \"75923243-2301-4afc-a727-7791e1bd6f9e\" (UID: \"75923243-2301-4afc-a727-7791e1bd6f9e\") "
Jul 31 21:00:37.516205 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.516177    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75923243-2301-4afc-a727-7791e1bd6f9e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "75923243-2301-4afc-a727-7791e1bd6f9e" (UID: "75923243-2301-4afc-a727-7791e1bd6f9e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:00:37.518363 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.518335    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75923243-2301-4afc-a727-7791e1bd6f9e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "75923243-2301-4afc-a727-7791e1bd6f9e" (UID: "75923243-2301-4afc-a727-7791e1bd6f9e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:00:37.518490 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.518335    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75923243-2301-4afc-a727-7791e1bd6f9e-kube-api-access-7ml7w" (OuterVolumeSpecName: "kube-api-access-7ml7w") pod "75923243-2301-4afc-a727-7791e1bd6f9e" (UID: "75923243-2301-4afc-a727-7791e1bd6f9e"). InnerVolumeSpecName "kube-api-access-7ml7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:00:37.527303 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.527273    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:37.617565 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.617479    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kx5l8\" (UniqueName: \"kubernetes.io/projected/639cf4d3-cb08-4670-8ff5-42223c132161-kube-api-access-kx5l8\") pod \"639cf4d3-cb08-4670-8ff5-42223c132161\" (UID: \"639cf4d3-cb08-4670-8ff5-42223c132161\") "
Jul 31 21:00:37.617716 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.617593    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/639cf4d3-cb08-4670-8ff5-42223c132161-plugins-config-volume\") pod \"639cf4d3-cb08-4670-8ff5-42223c132161\" (UID: \"639cf4d3-cb08-4670-8ff5-42223c132161\") "
Jul 31 21:00:37.617886 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.617867    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ml7w\" (UniqueName: \"kubernetes.io/projected/75923243-2301-4afc-a727-7791e1bd6f9e-kube-api-access-7ml7w\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:00:37.617929 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.617893    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75923243-2301-4afc-a727-7791e1bd6f9e-maas-api-tls\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:00:37.617929 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.617910    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75923243-2301-4afc-a727-7791e1bd6f9e-openshift-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:00:37.618028 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.618012    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/639cf4d3-cb08-4670-8ff5-42223c132161-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "639cf4d3-cb08-4670-8ff5-42223c132161" (UID: "639cf4d3-cb08-4670-8ff5-42223c132161"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:00:37.619908 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.619882    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/639cf4d3-cb08-4670-8ff5-42223c132161-kube-api-access-kx5l8" (OuterVolumeSpecName: "kube-api-access-kx5l8") pod "639cf4d3-cb08-4670-8ff5-42223c132161" (UID: "639cf4d3-cb08-4670-8ff5-42223c132161"). InnerVolumeSpecName "kube-api-access-kx5l8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:00:37.719018 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.718981    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kx5l8\" (UniqueName: \"kubernetes.io/projected/639cf4d3-cb08-4670-8ff5-42223c132161-kube-api-access-kx5l8\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:00:37.719018 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.719012    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/639cf4d3-cb08-4670-8ff5-42223c132161-plugins-config-volume\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:00:37.757380 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:37.757345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:38.020659 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.020625    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:38.118266 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.118236    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:38.142657 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.142627    2565 generic.go:356] "Generic (PLEG): container finished" podID="75923243-2301-4afc-a727-7791e1bd6f9e" containerID="7756ded97ce05e3ddbcb26a7779f1e502eee4fd90f17c7f71bdbde321faa4df9" exitCode=0
Jul 31 21:00:38.142831 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.142706    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"
Jul 31 21:00:38.142831 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.142708    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst" event={"ID":"75923243-2301-4afc-a727-7791e1bd6f9e","Type":"ContainerDied","Data":"7756ded97ce05e3ddbcb26a7779f1e502eee4fd90f17c7f71bdbde321faa4df9"}
Jul 31 21:00:38.142831 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.142788    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst" event={"ID":"75923243-2301-4afc-a727-7791e1bd6f9e","Type":"ContainerDied","Data":"b21294ba037576ecb2e5a33ae341fc1261573270e06e15e1ce83d4ea232515b0"}
Jul 31 21:00:38.142831 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.142816    2565 scope.go:117] "RemoveContainer" containerID="7756ded97ce05e3ddbcb26a7779f1e502eee4fd90f17c7f71bdbde321faa4df9"
Jul 31 21:00:38.144277 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.144252    2565 generic.go:356] "Generic (PLEG): container finished" podID="639cf4d3-cb08-4670-8ff5-42223c132161" containerID="812aca5abb7179082a2bbf7fdf8ec3768f57ce3f0f0169a04293646e5db2d655" exitCode=0
Jul 31 21:00:38.144400 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.144283    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7" event={"ID":"639cf4d3-cb08-4670-8ff5-42223c132161","Type":"ContainerDied","Data":"812aca5abb7179082a2bbf7fdf8ec3768f57ce3f0f0169a04293646e5db2d655"}
Jul 31 21:00:38.144400 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.144312    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7" event={"ID":"639cf4d3-cb08-4670-8ff5-42223c132161","Type":"ContainerDied","Data":"d6bb5f19572684e10efb0676f5cd87030df2053690cb0e549c8d68f4d9f778b8"}
Jul 31 21:00:38.144400 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.144313    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7"
Jul 31 21:00:38.151716 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.151706    2565 scope.go:117] "RemoveContainer" containerID="7756ded97ce05e3ddbcb26a7779f1e502eee4fd90f17c7f71bdbde321faa4df9"
Jul 31 21:00:38.152017 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:00:38.151998    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7756ded97ce05e3ddbcb26a7779f1e502eee4fd90f17c7f71bdbde321faa4df9\": container with ID starting with 7756ded97ce05e3ddbcb26a7779f1e502eee4fd90f17c7f71bdbde321faa4df9 not found: ID does not exist" containerID="7756ded97ce05e3ddbcb26a7779f1e502eee4fd90f17c7f71bdbde321faa4df9"
Jul 31 21:00:38.152098 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.152023    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7756ded97ce05e3ddbcb26a7779f1e502eee4fd90f17c7f71bdbde321faa4df9"} err="failed to get container status \"7756ded97ce05e3ddbcb26a7779f1e502eee4fd90f17c7f71bdbde321faa4df9\": rpc error: code = NotFound desc = could not find container \"7756ded97ce05e3ddbcb26a7779f1e502eee4fd90f17c7f71bdbde321faa4df9\": container with ID starting with 7756ded97ce05e3ddbcb26a7779f1e502eee4fd90f17c7f71bdbde321faa4df9 not found: ID does not exist"
Jul 31 21:00:38.152098 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.152039    2565 scope.go:117] "RemoveContainer" containerID="812aca5abb7179082a2bbf7fdf8ec3768f57ce3f0f0169a04293646e5db2d655"
Jul 31 21:00:38.160384 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.160361    2565 scope.go:117] "RemoveContainer" containerID="812aca5abb7179082a2bbf7fdf8ec3768f57ce3f0f0169a04293646e5db2d655"
Jul 31 21:00:38.160628 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:00:38.160610    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"812aca5abb7179082a2bbf7fdf8ec3768f57ce3f0f0169a04293646e5db2d655\": container with ID starting with 812aca5abb7179082a2bbf7fdf8ec3768f57ce3f0f0169a04293646e5db2d655 not found: ID does not exist" containerID="812aca5abb7179082a2bbf7fdf8ec3768f57ce3f0f0169a04293646e5db2d655"
Jul 31 21:00:38.160678 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.160635    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"812aca5abb7179082a2bbf7fdf8ec3768f57ce3f0f0169a04293646e5db2d655"} err="failed to get container status \"812aca5abb7179082a2bbf7fdf8ec3768f57ce3f0f0169a04293646e5db2d655\": rpc error: code = NotFound desc = could not find container \"812aca5abb7179082a2bbf7fdf8ec3768f57ce3f0f0169a04293646e5db2d655\": container with ID starting with 812aca5abb7179082a2bbf7fdf8ec3768f57ce3f0f0169a04293646e5db2d655 not found: ID does not exist"
Jul 31 21:00:38.160728 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.160711    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"]
Jul 31 21:00:38.165269 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.165249    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c5bdfd41-6f95f69c56-nqqst"]
Jul 31 21:00:38.173933 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.173912    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7"]
Jul 31 21:00:38.180810 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.180789    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c5bdfd41-6fd89f9c86-dnhq7"]
Jul 31 21:00:38.225325 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.225297    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:38.519239 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.519154    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"]
Jul 31 21:00:38.519534 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.519519    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="639cf4d3-cb08-4670-8ff5-42223c132161" containerName="payload-processing"
Jul 31 21:00:38.519582 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.519537    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="639cf4d3-cb08-4670-8ff5-42223c132161" containerName="payload-processing"
Jul 31 21:00:38.519582 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.519552    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75923243-2301-4afc-a727-7791e1bd6f9e" containerName="maas-api"
Jul 31 21:00:38.519582 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.519557    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="75923243-2301-4afc-a727-7791e1bd6f9e" containerName="maas-api"
Jul 31 21:00:38.519699 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.519613    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="639cf4d3-cb08-4670-8ff5-42223c132161" containerName="payload-processing"
Jul 31 21:00:38.519699 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.519623    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="75923243-2301-4afc-a727-7791e1bd6f9e" containerName="maas-api"
Jul 31 21:00:38.524231 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.524210    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.526532 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.526510    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-337fe245-gw-openshift-default-dockercfg-9xzlr\""
Jul 31 21:00:38.534819 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.534790    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"]
Jul 31 21:00:38.624978 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.624948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-workload-certs\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.624978 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.624980    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-token\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.625207 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.625006    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-credential-socket\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.625207 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.625065    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-workload-socket\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.625207 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.625120    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0be422f-cf77-44d9-b47b-963fdacd75c0-istiod-ca-cert\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.625207 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.625151    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-podinfo\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.625207 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.625179    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-data\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.625391 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.625251    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ptxk\" (UniqueName: \"kubernetes.io/projected/a0be422f-cf77-44d9-b47b-963fdacd75c0-kube-api-access-6ptxk\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.625391 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.625288    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-envoy\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.726337 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.726299    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ptxk\" (UniqueName: \"kubernetes.io/projected/a0be422f-cf77-44d9-b47b-963fdacd75c0-kube-api-access-6ptxk\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.726524 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.726351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-envoy\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.726524 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.726376    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-workload-certs\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.726524 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.726391    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-token\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.726524 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.726412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-credential-socket\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.726524 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.726435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-workload-socket\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.726865 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.726594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0be422f-cf77-44d9-b47b-963fdacd75c0-istiod-ca-cert\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.726865 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.726652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-podinfo\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.726865 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.726700    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-data\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.727027 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.726869    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-credential-socket\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.727027 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.726892    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-workload-certs\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.727027 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.726906    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-workload-socket\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.727200 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.727076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-data\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.727328 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.727307    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0be422f-cf77-44d9-b47b-963fdacd75c0-istiod-ca-cert\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.728852 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.728834    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-envoy\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.729148 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.729129    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-podinfo\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.734620 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.734597    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-token\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.734818 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.734800    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ptxk\" (UniqueName: \"kubernetes.io/projected/a0be422f-cf77-44d9-b47b-963fdacd75c0-kube-api-access-6ptxk\") pod \"e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") " pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.835391 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.835310    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:38.975143 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.975114    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"]
Jul 31 21:00:38.976883 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:00:38.976857    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0be422f_cf77_44d9_b47b_963fdacd75c0.slice/crio-86018ce72d416cf2f3beb0ebf0993366c20c8c23122cfabae0b33a7e541ce60b WatchSource:0}: Error finding container 86018ce72d416cf2f3beb0ebf0993366c20c8c23122cfabae0b33a7e541ce60b: Status 404 returned error can't find the container with id 86018ce72d416cf2f3beb0ebf0993366c20c8c23122cfabae0b33a7e541ce60b
Jul 31 21:00:38.978913 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.978880    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:00:38.979003 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.978946    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:00:38.979003 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:38.978974    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:00:39.153749 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:39.153631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg" event={"ID":"a0be422f-cf77-44d9-b47b-963fdacd75c0","Type":"ContainerStarted","Data":"6e0502f1df307228473ac9b60922ed1c62a30118080a50fa7334401559786b74"}
Jul 31 21:00:39.153749 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:39.153694    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg" event={"ID":"a0be422f-cf77-44d9-b47b-963fdacd75c0","Type":"ContainerStarted","Data":"86018ce72d416cf2f3beb0ebf0993366c20c8c23122cfabae0b33a7e541ce60b"}
Jul 31 21:00:39.160046 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:39.160017    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:39.174357 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:39.174306    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg" podStartSLOduration=1.1742881330000001 podStartE2EDuration="1.174288133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:00:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:00:39.172592707 +0000 UTC m=+1847.777887070" watchObservedRunningTime="2026-07-31 21:00:39.174288133 +0000 UTC m=+1847.779582495"
Jul 31 21:00:39.263144 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:39.263109    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:39.835843 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:39.835807    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:39.916045 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:39.916013    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="639cf4d3-cb08-4670-8ff5-42223c132161" path="/var/lib/kubelet/pods/639cf4d3-cb08-4670-8ff5-42223c132161/volumes"
Jul 31 21:00:39.916419 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:39.916403    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75923243-2301-4afc-a727-7791e1bd6f9e" path="/var/lib/kubelet/pods/75923243-2301-4afc-a727-7791e1bd6f9e/volumes"
Jul 31 21:00:40.650159 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:40.650126    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:40.720815 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:40.720780    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"]
Jul 31 21:00:40.725568 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:40.725545    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"
Jul 31 21:00:40.727514 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:40.727487    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-337fe245-serving-cert\""
Jul 31 21:00:40.732985 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:40.732949    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"]
Jul 31 21:00:40.841555 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:40.841527    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:40.846270 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:40.846249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77glg\" (UniqueName: \"kubernetes.io/projected/780df72e-3cfd-43b9-863b-aa596be50892-kube-api-access-77glg\") pod \"maas-api-e2e-migrate-337fe245-746bcc4657-rlv28\" (UID: \"780df72e-3cfd-43b9-863b-aa596be50892\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"
Jul 31 21:00:40.846361 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:40.846302    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/780df72e-3cfd-43b9-863b-aa596be50892-openshift-service-ca\") pod \"maas-api-e2e-migrate-337fe245-746bcc4657-rlv28\" (UID: \"780df72e-3cfd-43b9-863b-aa596be50892\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"
Jul 31 21:00:40.846361 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:40.846323    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/780df72e-3cfd-43b9-863b-aa596be50892-maas-api-tls\") pod \"maas-api-e2e-migrate-337fe245-746bcc4657-rlv28\" (UID: \"780df72e-3cfd-43b9-863b-aa596be50892\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"
Jul 31 21:00:40.946928 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:40.946893    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77glg\" (UniqueName: \"kubernetes.io/projected/780df72e-3cfd-43b9-863b-aa596be50892-kube-api-access-77glg\") pod \"maas-api-e2e-migrate-337fe245-746bcc4657-rlv28\" (UID: \"780df72e-3cfd-43b9-863b-aa596be50892\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"
Jul 31 21:00:40.947115 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:40.946961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/780df72e-3cfd-43b9-863b-aa596be50892-openshift-service-ca\") pod \"maas-api-e2e-migrate-337fe245-746bcc4657-rlv28\" (UID: \"780df72e-3cfd-43b9-863b-aa596be50892\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"
Jul 31 21:00:40.947115 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:40.946994    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/780df72e-3cfd-43b9-863b-aa596be50892-maas-api-tls\") pod \"maas-api-e2e-migrate-337fe245-746bcc4657-rlv28\" (UID: \"780df72e-3cfd-43b9-863b-aa596be50892\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"
Jul 31 21:00:40.947613 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:40.947590    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/780df72e-3cfd-43b9-863b-aa596be50892-openshift-service-ca\") pod \"maas-api-e2e-migrate-337fe245-746bcc4657-rlv28\" (UID: \"780df72e-3cfd-43b9-863b-aa596be50892\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"
Jul 31 21:00:40.949550 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:40.949527    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/780df72e-3cfd-43b9-863b-aa596be50892-maas-api-tls\") pod \"maas-api-e2e-migrate-337fe245-746bcc4657-rlv28\" (UID: \"780df72e-3cfd-43b9-863b-aa596be50892\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"
Jul 31 21:00:40.955120 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:40.955095    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77glg\" (UniqueName: \"kubernetes.io/projected/780df72e-3cfd-43b9-863b-aa596be50892-kube-api-access-77glg\") pod \"maas-api-e2e-migrate-337fe245-746bcc4657-rlv28\" (UID: \"780df72e-3cfd-43b9-863b-aa596be50892\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"
Jul 31 21:00:41.038772 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:41.038714    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"
Jul 31 21:00:41.166464 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:41.166439    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:41.167563 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:41.167540    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:41.176569 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:41.176546    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"]
Jul 31 21:00:41.178728 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:00:41.178706    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod780df72e_3cfd_43b9_863b_aa596be50892.slice/crio-c8329574b23d8e9c86f3454d63479e73bb0fb6e56566055ee7673cc5bb850cf9 WatchSource:0}: Error finding container c8329574b23d8e9c86f3454d63479e73bb0fb6e56566055ee7673cc5bb850cf9: Status 404 returned error can't find the container with id c8329574b23d8e9c86f3454d63479e73bb0fb6e56566055ee7673cc5bb850cf9
Jul 31 21:00:41.398965 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:41.398884    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:41.466177 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:41.466134    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:00:42.172676 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:42.172638    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28" event={"ID":"780df72e-3cfd-43b9-863b-aa596be50892","Type":"ContainerStarted","Data":"0da4d0c671b83ef6a0a99f6b85642f7e6c2d4e21a99d49e8176d151395203afe"}
Jul 31 21:00:42.173107 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:42.172703    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28" event={"ID":"780df72e-3cfd-43b9-863b-aa596be50892","Type":"ContainerStarted","Data":"c8329574b23d8e9c86f3454d63479e73bb0fb6e56566055ee7673cc5bb850cf9"}
Jul 31 21:00:42.173107 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:42.172944    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"
Jul 31 21:00:42.188488 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:42.188438    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28" podStartSLOduration=1.812377209 podStartE2EDuration="2.188421812s" totalImagesPullingTime="376.044603ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:00:42.187294109 +0000 UTC m=+1850.792588473" watchObservedRunningTime="2026-07-31 21:00:42.188421812 +0000 UTC m=+1850.793716175"
Jul 31 21:00:48.183155 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:48.183122    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"
Jul 31 21:00:54.243333 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:54.243296    2565 generic.go:356] "Generic (PLEG): container finished" podID="a0be422f-cf77-44d9-b47b-963fdacd75c0" containerID="6e0502f1df307228473ac9b60922ed1c62a30118080a50fa7334401559786b74" exitCode=0
Jul 31 21:00:54.243770 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:54.243371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg" event={"ID":"a0be422f-cf77-44d9-b47b-963fdacd75c0","Type":"ContainerDied","Data":"6e0502f1df307228473ac9b60922ed1c62a30118080a50fa7334401559786b74"}
Jul 31 21:00:54.243816 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:54.243798    2565 scope.go:117] "RemoveContainer" containerID="6e0502f1df307228473ac9b60922ed1c62a30118080a50fa7334401559786b74"
Jul 31 21:00:54.244893 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:54.244864    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:00:54.244969 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:54.244951    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:00:54.245009 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:54.244999    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:00:55.255569 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:55.255521    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg" event={"ID":"a0be422f-cf77-44d9-b47b-963fdacd75c0","Type":"ContainerStarted","Data":"af244b235de47206e14b575dd957f330225e8a4d9703789f76abafac3148fed9"}
Jul 31 21:00:55.836429 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:55.836389    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:55.837444 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:55.837419    2565 patch_prober.go:28] interesting pod/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 31 21:00:55.837560 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:55.837470    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg" podUID="a0be422f-cf77-44d9-b47b-963fdacd75c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 31 21:00:56.166825 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:56.166701    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:00:56.836192 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:56.836160    2565 patch_prober.go:28] interesting pod/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 31 21:00:56.836593 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:56.836215    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg" podUID="a0be422f-cf77-44d9-b47b-963fdacd75c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 31 21:00:57.836432 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:57.836392    2565 patch_prober.go:28] interesting pod/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 31 21:00:57.836855 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:57.836452    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg" podUID="a0be422f-cf77-44d9-b47b-963fdacd75c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 31 21:00:58.836341 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:58.836309    2565 patch_prober.go:28] interesting pod/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 31 21:00:58.836509 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:58.836361    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg" podUID="a0be422f-cf77-44d9-b47b-963fdacd75c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 31 21:00:59.836114 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:59.836079    2565 patch_prober.go:28] interesting pod/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 31 21:00:59.836308 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:00:59.836144    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg" podUID="a0be422f-cf77-44d9-b47b-963fdacd75c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 31 21:01:00.839972 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:00.839935    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:01:00.841158 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:00.841134    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:01:12.072754 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.072707    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"]
Jul 31 21:01:12.073271 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.072972    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28" podUID="780df72e-3cfd-43b9-863b-aa596be50892" containerName="maas-api" containerID="cri-o://0da4d0c671b83ef6a0a99f6b85642f7e6c2d4e21a99d49e8176d151395203afe" gracePeriod=30
Jul 31 21:01:12.099955 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.099912    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:12.196703 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.196625    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:12.259439 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.259399    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:12.321497 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.321466    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"
Jul 31 21:01:12.348795 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.348452    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:12.352088 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.351792    2565 generic.go:356] "Generic (PLEG): container finished" podID="780df72e-3cfd-43b9-863b-aa596be50892" containerID="0da4d0c671b83ef6a0a99f6b85642f7e6c2d4e21a99d49e8176d151395203afe" exitCode=0
Jul 31 21:01:12.352088 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.351855    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"
Jul 31 21:01:12.352088 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.351869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28" event={"ID":"780df72e-3cfd-43b9-863b-aa596be50892","Type":"ContainerDied","Data":"0da4d0c671b83ef6a0a99f6b85642f7e6c2d4e21a99d49e8176d151395203afe"}
Jul 31 21:01:12.352088 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.351928    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28" event={"ID":"780df72e-3cfd-43b9-863b-aa596be50892","Type":"ContainerDied","Data":"c8329574b23d8e9c86f3454d63479e73bb0fb6e56566055ee7673cc5bb850cf9"}
Jul 31 21:01:12.352088 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.351960    2565 scope.go:117] "RemoveContainer" containerID="0da4d0c671b83ef6a0a99f6b85642f7e6c2d4e21a99d49e8176d151395203afe"
Jul 31 21:01:12.364045 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.364022    2565 scope.go:117] "RemoveContainer" containerID="0da4d0c671b83ef6a0a99f6b85642f7e6c2d4e21a99d49e8176d151395203afe"
Jul 31 21:01:12.364404 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:01:12.364385    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0da4d0c671b83ef6a0a99f6b85642f7e6c2d4e21a99d49e8176d151395203afe\": container with ID starting with 0da4d0c671b83ef6a0a99f6b85642f7e6c2d4e21a99d49e8176d151395203afe not found: ID does not exist" containerID="0da4d0c671b83ef6a0a99f6b85642f7e6c2d4e21a99d49e8176d151395203afe"
Jul 31 21:01:12.364485 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.364417    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0da4d0c671b83ef6a0a99f6b85642f7e6c2d4e21a99d49e8176d151395203afe"} err="failed to get container status \"0da4d0c671b83ef6a0a99f6b85642f7e6c2d4e21a99d49e8176d151395203afe\": rpc error: code = NotFound desc = could not find container \"0da4d0c671b83ef6a0a99f6b85642f7e6c2d4e21a99d49e8176d151395203afe\": container with ID starting with 0da4d0c671b83ef6a0a99f6b85642f7e6c2d4e21a99d49e8176d151395203afe not found: ID does not exist"
Jul 31 21:01:12.426748 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.426707    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/780df72e-3cfd-43b9-863b-aa596be50892-maas-api-tls\") pod \"780df72e-3cfd-43b9-863b-aa596be50892\" (UID: \"780df72e-3cfd-43b9-863b-aa596be50892\") "
Jul 31 21:01:12.426942 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.426790    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77glg\" (UniqueName: \"kubernetes.io/projected/780df72e-3cfd-43b9-863b-aa596be50892-kube-api-access-77glg\") pod \"780df72e-3cfd-43b9-863b-aa596be50892\" (UID: \"780df72e-3cfd-43b9-863b-aa596be50892\") "
Jul 31 21:01:12.426942 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.426839    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/780df72e-3cfd-43b9-863b-aa596be50892-openshift-service-ca\") pod \"780df72e-3cfd-43b9-863b-aa596be50892\" (UID: \"780df72e-3cfd-43b9-863b-aa596be50892\") "
Jul 31 21:01:12.427313 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.427285    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/780df72e-3cfd-43b9-863b-aa596be50892-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "780df72e-3cfd-43b9-863b-aa596be50892" (UID: "780df72e-3cfd-43b9-863b-aa596be50892"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:01:12.429058 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.429033    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/780df72e-3cfd-43b9-863b-aa596be50892-kube-api-access-77glg" (OuterVolumeSpecName: "kube-api-access-77glg") pod "780df72e-3cfd-43b9-863b-aa596be50892" (UID: "780df72e-3cfd-43b9-863b-aa596be50892"). InnerVolumeSpecName "kube-api-access-77glg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:01:12.429165 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.429135    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/780df72e-3cfd-43b9-863b-aa596be50892-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "780df72e-3cfd-43b9-863b-aa596be50892" (UID: "780df72e-3cfd-43b9-863b-aa596be50892"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:01:12.525444 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.525409    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"]
Jul 31 21:01:12.525645 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.525624    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg" podUID="a0be422f-cf77-44d9-b47b-963fdacd75c0" containerName="istio-proxy" containerID="cri-o://af244b235de47206e14b575dd957f330225e8a4d9703789f76abafac3148fed9" gracePeriod=30
Jul 31 21:01:12.528278 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.528237    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/780df72e-3cfd-43b9-863b-aa596be50892-maas-api-tls\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:01:12.528278 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.528278    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77glg\" (UniqueName: \"kubernetes.io/projected/780df72e-3cfd-43b9-863b-aa596be50892-kube-api-access-77glg\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:01:12.528473 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.528294    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/780df72e-3cfd-43b9-863b-aa596be50892-openshift-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:01:12.544147 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.544096    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:12.682705 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.682669    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"]
Jul 31 21:01:12.694982 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.694949    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-337fe245-746bcc4657-rlv28"]
Jul 31 21:01:12.820663 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:12.820583    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:13.898020 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:13.897978    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:13.915425 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:13.915396    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="780df72e-3cfd-43b9-863b-aa596be50892" path="/var/lib/kubelet/pods/780df72e-3cfd-43b9-863b-aa596be50892/volumes"
Jul 31 21:01:13.965199 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:13.965163    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:15.842836 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:15.842794    2565 patch_prober.go:28] interesting pod/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 21:01:15.843241 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:15.842857    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg" podUID="a0be422f-cf77-44d9-b47b-963fdacd75c0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 21:01:15.937223 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:15.937179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:16.042064 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:16.042031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:17.023807 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.023772    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"]
Jul 31 21:01:17.024345 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.024324    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="780df72e-3cfd-43b9-863b-aa596be50892" containerName="maas-api"
Jul 31 21:01:17.024420 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.024349    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="780df72e-3cfd-43b9-863b-aa596be50892" containerName="maas-api"
Jul 31 21:01:17.024485 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.024472    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="780df72e-3cfd-43b9-863b-aa596be50892" containerName="maas-api"
Jul 31 21:01:17.027384 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.027362    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"
Jul 31 21:01:17.029919 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.029898    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-80cfef96-serving-cert\""
Jul 31 21:01:17.041213 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.041189    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"]
Jul 31 21:01:17.067858 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.067823    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-openshift-service-ca\") pod \"maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7\" (UID: \"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"
Jul 31 21:01:17.068000 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.067878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-maas-api-tls\") pod \"maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7\" (UID: \"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"
Jul 31 21:01:17.068000 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.067903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6d2b\" (UniqueName: \"kubernetes.io/projected/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-kube-api-access-n6d2b\") pod \"maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7\" (UID: \"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"
Jul 31 21:01:17.073349 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.073324    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:17.169286 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.169246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-openshift-service-ca\") pod \"maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7\" (UID: \"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"
Jul 31 21:01:17.169470 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.169294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-maas-api-tls\") pod \"maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7\" (UID: \"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"
Jul 31 21:01:17.169470 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.169317    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6d2b\" (UniqueName: \"kubernetes.io/projected/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-kube-api-access-n6d2b\") pod \"maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7\" (UID: \"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"
Jul 31 21:01:17.169470 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:01:17.169422    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-serving-cert: secret "maas-api-e2e-ait-80cfef96-serving-cert" not found
Jul 31 21:01:17.169595 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:01:17.169492    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-maas-api-tls podName:9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3 nodeName:}" failed. No retries permitted until 2026-07-31 21:01:17.669474181 +0000 UTC m=+1886.274768539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-maas-api-tls") pod "maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7" (UID: "9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3") : secret "maas-api-e2e-ait-80cfef96-serving-cert" not found
Jul 31 21:01:17.169983 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.169965    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-openshift-service-ca\") pod \"maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7\" (UID: \"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"
Jul 31 21:01:17.183387 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.183362    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6d2b\" (UniqueName: \"kubernetes.io/projected/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-kube-api-access-n6d2b\") pod \"maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7\" (UID: \"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"
Jul 31 21:01:17.232375 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.232345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:17.550376 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.550350    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:17.644367 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.644335    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:17.673974 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.673943    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-maas-api-tls\") pod \"maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7\" (UID: \"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"
Jul 31 21:01:17.676886 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.676858    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-maas-api-tls\") pod \"maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7\" (UID: \"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"
Jul 31 21:01:17.792699 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.792643    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:01:17.875024 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.874992    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-token\") pod \"a0be422f-cf77-44d9-b47b-963fdacd75c0\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") "
Jul 31 21:01:17.875024 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.875028    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-podinfo\") pod \"a0be422f-cf77-44d9-b47b-963fdacd75c0\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") "
Jul 31 21:01:17.875283 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.875055    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0be422f-cf77-44d9-b47b-963fdacd75c0-istiod-ca-cert\") pod \"a0be422f-cf77-44d9-b47b-963fdacd75c0\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") "
Jul 31 21:01:17.875283 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.875087    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-workload-socket\") pod \"a0be422f-cf77-44d9-b47b-963fdacd75c0\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") "
Jul 31 21:01:17.875283 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.875117    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-credential-socket\") pod \"a0be422f-cf77-44d9-b47b-963fdacd75c0\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") "
Jul 31 21:01:17.875283 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.875199    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-workload-certs\") pod \"a0be422f-cf77-44d9-b47b-963fdacd75c0\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") "
Jul 31 21:01:17.875283 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.875242    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-data\") pod \"a0be422f-cf77-44d9-b47b-963fdacd75c0\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") "
Jul 31 21:01:17.875599 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.875425    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a0be422f-cf77-44d9-b47b-963fdacd75c0" (UID: "a0be422f-cf77-44d9-b47b-963fdacd75c0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:01:17.875599 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.875523    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a0be422f-cf77-44d9-b47b-963fdacd75c0" (UID: "a0be422f-cf77-44d9-b47b-963fdacd75c0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:01:17.875599 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.875537    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0be422f-cf77-44d9-b47b-963fdacd75c0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a0be422f-cf77-44d9-b47b-963fdacd75c0" (UID: "a0be422f-cf77-44d9-b47b-963fdacd75c0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:01:17.875599 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.875558    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-data" (OuterVolumeSpecName: "istio-data") pod "a0be422f-cf77-44d9-b47b-963fdacd75c0" (UID: "a0be422f-cf77-44d9-b47b-963fdacd75c0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:01:17.875599 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.875272    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ptxk\" (UniqueName: \"kubernetes.io/projected/a0be422f-cf77-44d9-b47b-963fdacd75c0-kube-api-access-6ptxk\") pod \"a0be422f-cf77-44d9-b47b-963fdacd75c0\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") "
Jul 31 21:01:17.876041 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.875685    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-envoy\") pod \"a0be422f-cf77-44d9-b47b-963fdacd75c0\" (UID: \"a0be422f-cf77-44d9-b47b-963fdacd75c0\") "
Jul 31 21:01:17.876041 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.875978    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a0be422f-cf77-44d9-b47b-963fdacd75c0" (UID: "a0be422f-cf77-44d9-b47b-963fdacd75c0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:01:17.876152 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.876084    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-workload-certs\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:01:17.876152 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.876103    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-data\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:01:17.876152 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.876115    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0be422f-cf77-44d9-b47b-963fdacd75c0-istiod-ca-cert\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:01:17.876152 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.876127    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-workload-socket\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:01:17.876152 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.876139    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-credential-socket\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:01:17.877542 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.877517    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a0be422f-cf77-44d9-b47b-963fdacd75c0" (UID: "a0be422f-cf77-44d9-b47b-963fdacd75c0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 21:01:17.877542 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.877523    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-token" (OuterVolumeSpecName: "istio-token") pod "a0be422f-cf77-44d9-b47b-963fdacd75c0" (UID: "a0be422f-cf77-44d9-b47b-963fdacd75c0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:01:17.877887 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.877862    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0be422f-cf77-44d9-b47b-963fdacd75c0-kube-api-access-6ptxk" (OuterVolumeSpecName: "kube-api-access-6ptxk") pod "a0be422f-cf77-44d9-b47b-963fdacd75c0" (UID: "a0be422f-cf77-44d9-b47b-963fdacd75c0"). InnerVolumeSpecName "kube-api-access-6ptxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:01:17.878288 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.878271    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a0be422f-cf77-44d9-b47b-963fdacd75c0" (UID: "a0be422f-cf77-44d9-b47b-963fdacd75c0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:01:17.937794 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.937753    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"
Jul 31 21:01:17.977679 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.977588    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-token\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:01:17.977679 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.977624    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-podinfo\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:01:17.977679 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.977638    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ptxk\" (UniqueName: \"kubernetes.io/projected/a0be422f-cf77-44d9-b47b-963fdacd75c0-kube-api-access-6ptxk\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:01:17.977679 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:17.977653    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0be422f-cf77-44d9-b47b-963fdacd75c0-istio-envoy\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:01:18.074394 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:18.074359    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"]
Jul 31 21:01:18.075512 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:01:18.075484    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b0a2fbb_4358_4bd9_8244_6eaa7d31faf3.slice/crio-605adb6fdb70ffd47297a9f2d3f09064382ac092b7e482cd1a2bf293bd2aabf4 WatchSource:0}: Error finding container 605adb6fdb70ffd47297a9f2d3f09064382ac092b7e482cd1a2bf293bd2aabf4: Status 404 returned error can't find the container with id 605adb6fdb70ffd47297a9f2d3f09064382ac092b7e482cd1a2bf293bd2aabf4
Jul 31 21:01:18.388675 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:18.388585    2565 generic.go:356] "Generic (PLEG): container finished" podID="a0be422f-cf77-44d9-b47b-963fdacd75c0" containerID="af244b235de47206e14b575dd957f330225e8a4d9703789f76abafac3148fed9" exitCode=0
Jul 31 21:01:18.388675 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:18.388641    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"
Jul 31 21:01:18.388675 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:18.388666    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg" event={"ID":"a0be422f-cf77-44d9-b47b-963fdacd75c0","Type":"ContainerDied","Data":"af244b235de47206e14b575dd957f330225e8a4d9703789f76abafac3148fed9"}
Jul 31 21:01:18.389002 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:18.388719    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg" event={"ID":"a0be422f-cf77-44d9-b47b-963fdacd75c0","Type":"ContainerDied","Data":"86018ce72d416cf2f3beb0ebf0993366c20c8c23122cfabae0b33a7e541ce60b"}
Jul 31 21:01:18.389002 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:18.388769    2565 scope.go:117] "RemoveContainer" containerID="af244b235de47206e14b575dd957f330225e8a4d9703789f76abafac3148fed9"
Jul 31 21:01:18.389974 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:18.389945    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7" event={"ID":"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3","Type":"ContainerStarted","Data":"605adb6fdb70ffd47297a9f2d3f09064382ac092b7e482cd1a2bf293bd2aabf4"}
Jul 31 21:01:18.398154 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:18.398130    2565 scope.go:117] "RemoveContainer" containerID="6e0502f1df307228473ac9b60922ed1c62a30118080a50fa7334401559786b74"
Jul 31 21:01:18.404457 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:18.404431    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"]
Jul 31 21:01:18.407804 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:18.407784    2565 scope.go:117] "RemoveContainer" containerID="af244b235de47206e14b575dd957f330225e8a4d9703789f76abafac3148fed9"
Jul 31 21:01:18.408113 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:01:18.408090    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af244b235de47206e14b575dd957f330225e8a4d9703789f76abafac3148fed9\": container with ID starting with af244b235de47206e14b575dd957f330225e8a4d9703789f76abafac3148fed9 not found: ID does not exist" containerID="af244b235de47206e14b575dd957f330225e8a4d9703789f76abafac3148fed9"
Jul 31 21:01:18.408239 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:18.408126    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af244b235de47206e14b575dd957f330225e8a4d9703789f76abafac3148fed9"} err="failed to get container status \"af244b235de47206e14b575dd957f330225e8a4d9703789f76abafac3148fed9\": rpc error: code = NotFound desc = could not find container \"af244b235de47206e14b575dd957f330225e8a4d9703789f76abafac3148fed9\": container with ID starting with af244b235de47206e14b575dd957f330225e8a4d9703789f76abafac3148fed9 not found: ID does not exist"
Jul 31 21:01:18.408239 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:18.408145    2565 scope.go:117] "RemoveContainer" containerID="6e0502f1df307228473ac9b60922ed1c62a30118080a50fa7334401559786b74"
Jul 31 21:01:18.408447 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:01:18.408429    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e0502f1df307228473ac9b60922ed1c62a30118080a50fa7334401559786b74\": container with ID starting with 6e0502f1df307228473ac9b60922ed1c62a30118080a50fa7334401559786b74 not found: ID does not exist" containerID="6e0502f1df307228473ac9b60922ed1c62a30118080a50fa7334401559786b74"
Jul 31 21:01:18.408491 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:18.408453    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e0502f1df307228473ac9b60922ed1c62a30118080a50fa7334401559786b74"} err="failed to get container status \"6e0502f1df307228473ac9b60922ed1c62a30118080a50fa7334401559786b74\": rpc error: code = NotFound desc = could not find container \"6e0502f1df307228473ac9b60922ed1c62a30118080a50fa7334401559786b74\": container with ID starting with 6e0502f1df307228473ac9b60922ed1c62a30118080a50fa7334401559786b74 not found: ID does not exist"
Jul 31 21:01:18.409352 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:18.409330    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-337fe245-gw-openshift-default-84965857cb-8jnzg"]
Jul 31 21:01:19.397712 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:19.397677    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7" event={"ID":"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3","Type":"ContainerStarted","Data":"1c25faa7a6b91401aa4cb7fbe4ec65a4a02ddf51cb8bba0ec3155d87b511047a"}
Jul 31 21:01:19.398128 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:19.397870    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"
Jul 31 21:01:19.413900 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:19.413848    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7" podStartSLOduration=1.885009674 podStartE2EDuration="2.413832554s" totalImagesPullingTime="528.82288ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:01:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:01:19.410791211 +0000 UTC m=+1888.016085572" watchObservedRunningTime="2026-07-31 21:01:19.413832554 +0000 UTC m=+1888.019126916"
Jul 31 21:01:19.915035 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:19.915002    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0be422f-cf77-44d9-b47b-963fdacd75c0" path="/var/lib/kubelet/pods/a0be422f-cf77-44d9-b47b-963fdacd75c0/volumes"
Jul 31 21:01:25.408864 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:25.408834    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"
Jul 31 21:01:41.795220 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:41.795180    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80cfef96-qgsf4"]
Jul 31 21:01:41.795624 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:41.795558    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0be422f-cf77-44d9-b47b-963fdacd75c0" containerName="istio-proxy"
Jul 31 21:01:41.795624 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:41.795571    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0be422f-cf77-44d9-b47b-963fdacd75c0" containerName="istio-proxy"
Jul 31 21:01:41.795624 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:41.795579    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0be422f-cf77-44d9-b47b-963fdacd75c0" containerName="istio-proxy"
Jul 31 21:01:41.795624 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:41.795585    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0be422f-cf77-44d9-b47b-963fdacd75c0" containerName="istio-proxy"
Jul 31 21:01:41.795776 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:41.795644    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0be422f-cf77-44d9-b47b-963fdacd75c0" containerName="istio-proxy"
Jul 31 21:01:41.795776 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:41.795652    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0be422f-cf77-44d9-b47b-963fdacd75c0" containerName="istio-proxy"
Jul 31 21:01:41.798776 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:41.798756    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80cfef96-qgsf4"
Jul 31 21:01:41.800663 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:41.800636    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 21:01:41.805268 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:41.805239    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80cfef96-qgsf4"]
Jul 31 21:01:41.886921 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:41.886883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ea2eef-c221-43d6-8b18-497efb8d55ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-80cfef96-qgsf4\" (UID: \"b4ea2eef-c221-43d6-8b18-497efb8d55ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80cfef96-qgsf4"
Jul 31 21:01:41.987607 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:41.987571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ea2eef-c221-43d6-8b18-497efb8d55ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-80cfef96-qgsf4\" (UID: \"b4ea2eef-c221-43d6-8b18-497efb8d55ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80cfef96-qgsf4"
Jul 31 21:01:41.988300 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:41.988273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ea2eef-c221-43d6-8b18-497efb8d55ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-80cfef96-qgsf4\" (UID: \"b4ea2eef-c221-43d6-8b18-497efb8d55ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80cfef96-qgsf4"
Jul 31 21:01:42.111759 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:42.111663    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80cfef96-qgsf4"
Jul 31 21:01:42.248775 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:42.248747    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80cfef96-qgsf4"]
Jul 31 21:01:42.250955 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:01:42.250918    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4ea2eef_c221_43d6_8b18_497efb8d55ec.slice/crio-143aa92615d87fb5e766b5b74c15ebdd69cbe633389970078270bbf5486d5c3c WatchSource:0}: Error finding container 143aa92615d87fb5e766b5b74c15ebdd69cbe633389970078270bbf5486d5c3c: Status 404 returned error can't find the container with id 143aa92615d87fb5e766b5b74c15ebdd69cbe633389970078270bbf5486d5c3c
Jul 31 21:01:42.520713 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:42.520676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80cfef96-qgsf4" event={"ID":"b4ea2eef-c221-43d6-8b18-497efb8d55ec","Type":"ContainerStarted","Data":"143aa92615d87fb5e766b5b74c15ebdd69cbe633389970078270bbf5486d5c3c"}
Jul 31 21:01:45.541586 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:45.541545    2565 generic.go:356] "Generic (PLEG): container finished" podID="b4ea2eef-c221-43d6-8b18-497efb8d55ec" containerID="cb2000b1b3057ece6f5ed8b11c13b71b7886eef6dc81f100126e42f97b3208d5" exitCode=0
Jul 31 21:01:45.542006 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:45.541616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80cfef96-qgsf4" event={"ID":"b4ea2eef-c221-43d6-8b18-497efb8d55ec","Type":"ContainerDied","Data":"cb2000b1b3057ece6f5ed8b11c13b71b7886eef6dc81f100126e42f97b3208d5"}
Jul 31 21:01:46.684016 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:46.683991    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80cfef96-qgsf4"
Jul 31 21:01:46.833520 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:46.833402    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ea2eef-c221-43d6-8b18-497efb8d55ec-maas-api-service-ca\") pod \"b4ea2eef-c221-43d6-8b18-497efb8d55ec\" (UID: \"b4ea2eef-c221-43d6-8b18-497efb8d55ec\") "
Jul 31 21:01:46.833870 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:46.833842    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4ea2eef-c221-43d6-8b18-497efb8d55ec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b4ea2eef-c221-43d6-8b18-497efb8d55ec" (UID: "b4ea2eef-c221-43d6-8b18-497efb8d55ec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:01:46.934492 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:46.934442    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4ea2eef-c221-43d6-8b18-497efb8d55ec-maas-api-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:01:47.553706 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:47.553673    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80cfef96-qgsf4"
Jul 31 21:01:47.553907 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:47.553712    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80cfef96-qgsf4" event={"ID":"b4ea2eef-c221-43d6-8b18-497efb8d55ec","Type":"ContainerDied","Data":"143aa92615d87fb5e766b5b74c15ebdd69cbe633389970078270bbf5486d5c3c"}
Jul 31 21:01:47.553907 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:47.553776    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="143aa92615d87fb5e766b5b74c15ebdd69cbe633389970078270bbf5486d5c3c"
Jul 31 21:01:57.576168 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:57.576134    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"]
Jul 31 21:01:57.576907 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:57.576369    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7" podUID="9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3" containerName="maas-api" containerID="cri-o://1c25faa7a6b91401aa4cb7fbe4ec65a4a02ddf51cb8bba0ec3155d87b511047a" gracePeriod=30
Jul 31 21:01:57.602663 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:57.602633    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:57.627216 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:01:57.627178    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b0a2fbb_4358_4bd9_8244_6eaa7d31faf3.slice/crio-conmon-1c25faa7a6b91401aa4cb7fbe4ec65a4a02ddf51cb8bba0ec3155d87b511047a.scope\": RecentStats: unable to find data in memory cache]"
Jul 31 21:01:57.667474 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:57.667444    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:57.727015 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:57.726981    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:57.763014 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:57.762929    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80cfef96-qgsf4"]
Jul 31 21:01:57.765918 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:57.765873    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-80cfef96-qgsf4"]
Jul 31 21:01:57.784531 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:57.784470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:57.832260 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:57.832193    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"
Jul 31 21:01:57.914845 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:57.914812    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4ea2eef-c221-43d6-8b18-497efb8d55ec" path="/var/lib/kubelet/pods/b4ea2eef-c221-43d6-8b18-497efb8d55ec/volumes"
Jul 31 21:01:57.924980 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:57.924953    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6d2b\" (UniqueName: \"kubernetes.io/projected/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-kube-api-access-n6d2b\") pod \"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3\" (UID: \"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3\") "
Jul 31 21:01:57.925140 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:57.925064    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-maas-api-tls\") pod \"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3\" (UID: \"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3\") "
Jul 31 21:01:57.925140 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:57.925134    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-openshift-service-ca\") pod \"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3\" (UID: \"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3\") "
Jul 31 21:01:57.925601 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:57.925572    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3" (UID: "9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:01:57.927347 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:57.927317    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3" (UID: "9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:01:57.927520 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:57.927503    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-kube-api-access-n6d2b" (OuterVolumeSpecName: "kube-api-access-n6d2b") pod "9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3" (UID: "9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3"). InnerVolumeSpecName "kube-api-access-n6d2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:01:58.026625 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:58.026587    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-openshift-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:01:58.026625 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:58.026618    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6d2b\" (UniqueName: \"kubernetes.io/projected/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-kube-api-access-n6d2b\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:01:58.026625 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:58.026630    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3-maas-api-tls\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:01:58.612487 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:58.612451    2565 generic.go:356] "Generic (PLEG): container finished" podID="9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3" containerID="1c25faa7a6b91401aa4cb7fbe4ec65a4a02ddf51cb8bba0ec3155d87b511047a" exitCode=0
Jul 31 21:01:58.612973 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:58.612497    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"
Jul 31 21:01:58.612973 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:58.612542    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7" event={"ID":"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3","Type":"ContainerDied","Data":"1c25faa7a6b91401aa4cb7fbe4ec65a4a02ddf51cb8bba0ec3155d87b511047a"}
Jul 31 21:01:58.612973 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:58.612597    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7" event={"ID":"9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3","Type":"ContainerDied","Data":"605adb6fdb70ffd47297a9f2d3f09064382ac092b7e482cd1a2bf293bd2aabf4"}
Jul 31 21:01:58.612973 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:58.612619    2565 scope.go:117] "RemoveContainer" containerID="1c25faa7a6b91401aa4cb7fbe4ec65a4a02ddf51cb8bba0ec3155d87b511047a"
Jul 31 21:01:58.622069 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:58.622054    2565 scope.go:117] "RemoveContainer" containerID="1c25faa7a6b91401aa4cb7fbe4ec65a4a02ddf51cb8bba0ec3155d87b511047a"
Jul 31 21:01:58.622350 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:01:58.622332    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c25faa7a6b91401aa4cb7fbe4ec65a4a02ddf51cb8bba0ec3155d87b511047a\": container with ID starting with 1c25faa7a6b91401aa4cb7fbe4ec65a4a02ddf51cb8bba0ec3155d87b511047a not found: ID does not exist" containerID="1c25faa7a6b91401aa4cb7fbe4ec65a4a02ddf51cb8bba0ec3155d87b511047a"
Jul 31 21:01:58.622394 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:58.622359    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c25faa7a6b91401aa4cb7fbe4ec65a4a02ddf51cb8bba0ec3155d87b511047a"} err="failed to get container status \"1c25faa7a6b91401aa4cb7fbe4ec65a4a02ddf51cb8bba0ec3155d87b511047a\": rpc error: code = NotFound desc = could not find container \"1c25faa7a6b91401aa4cb7fbe4ec65a4a02ddf51cb8bba0ec3155d87b511047a\": container with ID starting with 1c25faa7a6b91401aa4cb7fbe4ec65a4a02ddf51cb8bba0ec3155d87b511047a not found: ID does not exist"
Jul 31 21:01:58.633393 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:58.633368    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"]
Jul 31 21:01:58.635331 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:58.635312    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-80cfef96-5cbdd4669d-vh2x7"]
Jul 31 21:01:58.966171 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:58.966123    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:59.184280 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.184240    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:59.438080 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.438027    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:59.694272 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.694174    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"]
Jul 31 21:01:59.694723 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.694675    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3" containerName="maas-api"
Jul 31 21:01:59.694723 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.694695    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3" containerName="maas-api"
Jul 31 21:01:59.694879 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.694775    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ea2eef-c221-43d6-8b18-497efb8d55ec" containerName="revoke-keys"
Jul 31 21:01:59.694879 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.694785    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ea2eef-c221-43d6-8b18-497efb8d55ec" containerName="revoke-keys"
Jul 31 21:01:59.694973 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.694902    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3" containerName="maas-api"
Jul 31 21:01:59.694973 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.694920    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4ea2eef-c221-43d6-8b18-497efb8d55ec" containerName="revoke-keys"
Jul 31 21:01:59.699410 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.699387    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.701402 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.701383    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-393f5f2a-openshift-default-dockercfg-8vhj5\""
Jul 31 21:01:59.710148 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.710124    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"]
Jul 31 21:01:59.739188 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.739151    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-workload-certs\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.739188 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.739192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istiod-ca-cert\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.739414 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.739215    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-token\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.739414 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.739342    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-podinfo\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.739414 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.739399    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-credential-socket\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.739516 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.739427    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-envoy\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.739516 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.739476    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwhcs\" (UniqueName: \"kubernetes.io/projected/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-kube-api-access-xwhcs\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.739580 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.739537    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-workload-socket\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.739580 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.739560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-data\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.840333 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.840285    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-workload-socket\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.840333 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.840331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-data\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.840553 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.840459    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-workload-certs\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.840553 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.840501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istiod-ca-cert\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.840553 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.840537    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-token\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.840664 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.840587    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-podinfo\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.840757 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.840698    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-data\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.840821 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.840775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-credential-socket\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.840878 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.840821    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-envoy\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.840878 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.840785    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-workload-socket\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.840878 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.840831    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-workload-certs\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.841044 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.840896    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwhcs\" (UniqueName: \"kubernetes.io/projected/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-kube-api-access-xwhcs\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.841044 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.840999    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-credential-socket\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.841276 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.841257    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istiod-ca-cert\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.843225 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.843204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-envoy\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.843297 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.843231    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-podinfo\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.848285 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.848252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-token\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.848285 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.848279    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwhcs\" (UniqueName: \"kubernetes.io/projected/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-kube-api-access-xwhcs\") pod \"e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") " pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:01:59.878667 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.878637    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:01:59.915521 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.915491    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3" path="/var/lib/kubelet/pods/9b0a2fbb-4358-4bd9-8244-6eaa7d31faf3/volumes"
Jul 31 21:01:59.980302 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:01:59.980213    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:00.011466 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:00.011426    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:02:00.176847 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:00.176814    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"]
Jul 31 21:02:00.180415 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:02:00.180388    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac5e12e5_51f1_4cc0_a88e_59e06e1acc46.slice/crio-433565e687046cd11fcf7d7712232f8adc3a0129ef6fdefc59dda8bb0d6d1a49 WatchSource:0}: Error finding container 433565e687046cd11fcf7d7712232f8adc3a0129ef6fdefc59dda8bb0d6d1a49: Status 404 returned error can't find the container with id 433565e687046cd11fcf7d7712232f8adc3a0129ef6fdefc59dda8bb0d6d1a49
Jul 31 21:02:00.182535 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:00.182504    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:02:00.182614 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:00.182574    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:02:00.182614 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:00.182603    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:02:00.627537 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:00.627447    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8" event={"ID":"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46","Type":"ContainerStarted","Data":"910bbe7a9b94ce3cf76ecbb81266bfdcab638c1b53cb74e782f263156809b639"}
Jul 31 21:02:00.627537 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:00.627513    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8" event={"ID":"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46","Type":"ContainerStarted","Data":"433565e687046cd11fcf7d7712232f8adc3a0129ef6fdefc59dda8bb0d6d1a49"}
Jul 31 21:02:00.649119 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:00.649059    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8" podStartSLOduration=1.6490380839999998 podStartE2EDuration="1.649038084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:01:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:02:00.644879934 +0000 UTC m=+1929.250174298" watchObservedRunningTime="2026-07-31 21:02:00.649038084 +0000 UTC m=+1929.254332451"
Jul 31 21:02:01.011579 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:01.011539    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:02:01.017890 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:01.017865    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:02:01.632860 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:01.632833    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:02:01.633933 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:01.633914    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:02:01.983297 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:01.983261    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:02.079563 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:02.079533    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:02.208142 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:02.208101    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:03.073034 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:03.072996    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"]
Jul 31 21:02:03.077186 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:03.077159    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"
Jul 31 21:02:03.079312 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:03.079288    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-393f5f2a-serving-cert\""
Jul 31 21:02:03.088950 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:03.088924    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"]
Jul 31 21:02:03.111821 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:03.111789    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:03.169179 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:03.169144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzc9j\" (UniqueName: \"kubernetes.io/projected/0bb6e352-ab99-47ce-b158-5dfde2652364-kube-api-access-kzc9j\") pod \"maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw\" (UID: \"0bb6e352-ab99-47ce-b158-5dfde2652364\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"
Jul 31 21:02:03.169335 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:03.169200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bb6e352-ab99-47ce-b158-5dfde2652364-openshift-service-ca\") pod \"maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw\" (UID: \"0bb6e352-ab99-47ce-b158-5dfde2652364\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"
Jul 31 21:02:03.169378 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:03.169337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bb6e352-ab99-47ce-b158-5dfde2652364-maas-api-tls\") pod \"maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw\" (UID: \"0bb6e352-ab99-47ce-b158-5dfde2652364\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"
Jul 31 21:02:03.269818 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:03.269788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bb6e352-ab99-47ce-b158-5dfde2652364-maas-api-tls\") pod \"maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw\" (UID: \"0bb6e352-ab99-47ce-b158-5dfde2652364\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"
Jul 31 21:02:03.269995 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:03.269830    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzc9j\" (UniqueName: \"kubernetes.io/projected/0bb6e352-ab99-47ce-b158-5dfde2652364-kube-api-access-kzc9j\") pod \"maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw\" (UID: \"0bb6e352-ab99-47ce-b158-5dfde2652364\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"
Jul 31 21:02:03.269995 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:03.269863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bb6e352-ab99-47ce-b158-5dfde2652364-openshift-service-ca\") pod \"maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw\" (UID: \"0bb6e352-ab99-47ce-b158-5dfde2652364\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"
Jul 31 21:02:03.269995 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:02:03.269936    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-serving-cert: secret "maas-api-e2e-derive-393f5f2a-serving-cert" not found
Jul 31 21:02:03.270128 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:02:03.270006    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bb6e352-ab99-47ce-b158-5dfde2652364-maas-api-tls podName:0bb6e352-ab99-47ce-b158-5dfde2652364 nodeName:}" failed. No retries permitted until 2026-07-31 21:02:03.769988254 +0000 UTC m=+1932.375282595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0bb6e352-ab99-47ce-b158-5dfde2652364-maas-api-tls") pod "maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw" (UID: "0bb6e352-ab99-47ce-b158-5dfde2652364") : secret "maas-api-e2e-derive-393f5f2a-serving-cert" not found
Jul 31 21:02:03.270421 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:03.270405    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bb6e352-ab99-47ce-b158-5dfde2652364-openshift-service-ca\") pod \"maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw\" (UID: \"0bb6e352-ab99-47ce-b158-5dfde2652364\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"
Jul 31 21:02:03.278325 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:03.278296    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzc9j\" (UniqueName: \"kubernetes.io/projected/0bb6e352-ab99-47ce-b158-5dfde2652364-kube-api-access-kzc9j\") pod \"maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw\" (UID: \"0bb6e352-ab99-47ce-b158-5dfde2652364\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"
Jul 31 21:02:03.592085 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:03.592049    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:03.694073 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:03.694038    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:03.776029 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:03.775992    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bb6e352-ab99-47ce-b158-5dfde2652364-maas-api-tls\") pod \"maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw\" (UID: \"0bb6e352-ab99-47ce-b158-5dfde2652364\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"
Jul 31 21:02:03.776202 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:02:03.776176    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-serving-cert: secret "maas-api-e2e-derive-393f5f2a-serving-cert" not found
Jul 31 21:02:03.776306 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:02:03.776292    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bb6e352-ab99-47ce-b158-5dfde2652364-maas-api-tls podName:0bb6e352-ab99-47ce-b158-5dfde2652364 nodeName:}" failed. No retries permitted until 2026-07-31 21:02:04.776258548 +0000 UTC m=+1933.381552910 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0bb6e352-ab99-47ce-b158-5dfde2652364-maas-api-tls") pod "maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw" (UID: "0bb6e352-ab99-47ce-b158-5dfde2652364") : secret "maas-api-e2e-derive-393f5f2a-serving-cert" not found
Jul 31 21:02:03.858388 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:03.858302    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:04.785710 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:04.785679    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bb6e352-ab99-47ce-b158-5dfde2652364-maas-api-tls\") pod \"maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw\" (UID: \"0bb6e352-ab99-47ce-b158-5dfde2652364\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"
Jul 31 21:02:04.788446 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:04.788411    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bb6e352-ab99-47ce-b158-5dfde2652364-maas-api-tls\") pod \"maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw\" (UID: \"0bb6e352-ab99-47ce-b158-5dfde2652364\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"
Jul 31 21:02:04.890106 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:04.890064    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"
Jul 31 21:02:05.030107 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:05.030080    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"]
Jul 31 21:02:05.032905 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:02:05.032880    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb6e352_ab99_47ce_b158_5dfde2652364.slice/crio-c4353cbee083ea35f95ffc25097ad5b7930fa640dd59bfa2409ffc74bb7daadf WatchSource:0}: Error finding container c4353cbee083ea35f95ffc25097ad5b7930fa640dd59bfa2409ffc74bb7daadf: Status 404 returned error can't find the container with id c4353cbee083ea35f95ffc25097ad5b7930fa640dd59bfa2409ffc74bb7daadf
Jul 31 21:02:05.656264 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:05.656230    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw" event={"ID":"0bb6e352-ab99-47ce-b158-5dfde2652364","Type":"ContainerStarted","Data":"0448e39729b00be3ec79e37d29c7d6783ff699bf737452e9f6b362a8fcc465ee"}
Jul 31 21:02:05.656474 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:05.656298    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"
Jul 31 21:02:05.656474 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:05.656316    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw" event={"ID":"0bb6e352-ab99-47ce-b158-5dfde2652364","Type":"ContainerStarted","Data":"c4353cbee083ea35f95ffc25097ad5b7930fa640dd59bfa2409ffc74bb7daadf"}
Jul 31 21:02:05.671485 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:05.671426    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw" podStartSLOduration=2.261390479 podStartE2EDuration="2.671406953s" totalImagesPullingTime="410.016474ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:02:05.670046729 +0000 UTC m=+1934.275341090" watchObservedRunningTime="2026-07-31 21:02:05.671406953 +0000 UTC m=+1934.276701318"
Jul 31 21:02:09.374280 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:09.374227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:09.619355 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:09.619321    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:11.673341 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:11.673312    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"
Jul 31 21:02:15.720170 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:15.720137    2565 generic.go:356] "Generic (PLEG): container finished" podID="ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" containerID="910bbe7a9b94ce3cf76ecbb81266bfdcab638c1b53cb74e782f263156809b639" exitCode=0
Jul 31 21:02:15.720648 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:15.720212    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8" event={"ID":"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46","Type":"ContainerDied","Data":"910bbe7a9b94ce3cf76ecbb81266bfdcab638c1b53cb74e782f263156809b639"}
Jul 31 21:02:15.720648 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:15.720633    2565 scope.go:117] "RemoveContainer" containerID="910bbe7a9b94ce3cf76ecbb81266bfdcab638c1b53cb74e782f263156809b639"
Jul 31 21:02:15.721663 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:15.721636    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:02:15.721723 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:15.721707    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:02:15.721777 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:15.721756    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:02:16.633470 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:16.633439    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:02:16.727788 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:16.727727    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8" event={"ID":"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46","Type":"ContainerStarted","Data":"43730d681dc9eaf641af6de331ac585767b782ca07730581e3f1f213b575807e"}
Jul 31 21:02:17.012597 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:17.012564    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:02:17.013685 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:17.013662    2565 patch_prober.go:28] interesting pod/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 31 21:02:17.013773 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:17.013713    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8" podUID="ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 31 21:02:18.011877 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:18.011835    2565 patch_prober.go:28] interesting pod/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 31 21:02:18.012315 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:18.011912    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8" podUID="ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 31 21:02:19.012619 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:19.012578    2565 patch_prober.go:28] interesting pod/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 31 21:02:19.013113 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:19.012644    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8" podUID="ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 31 21:02:20.011811 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:20.011775    2565 patch_prober.go:28] interesting pod/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 31 21:02:20.011997 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:20.011835    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8" podUID="ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 31 21:02:21.012802 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:21.012765    2565 patch_prober.go:28] interesting pod/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 31 21:02:21.013225 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:21.012826    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8" podUID="ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 31 21:02:22.016013 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:22.015983    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:02:22.016460 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:22.016258    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:02:22.016993 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:22.016977    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:02:33.556527 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.556483    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"]
Jul 31 21:02:33.557108 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.556796    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw" podUID="0bb6e352-ab99-47ce-b158-5dfde2652364" containerName="maas-api" containerID="cri-o://0448e39729b00be3ec79e37d29c7d6783ff699bf737452e9f6b362a8fcc465ee" gracePeriod=30
Jul 31 21:02:33.582327 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.582293    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:33.697301 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.697271    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:33.761854 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.761073    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:33.819024 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.818950    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"
Jul 31 21:02:33.821572 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.821535    2565 generic.go:356] "Generic (PLEG): container finished" podID="0bb6e352-ab99-47ce-b158-5dfde2652364" containerID="0448e39729b00be3ec79e37d29c7d6783ff699bf737452e9f6b362a8fcc465ee" exitCode=0
Jul 31 21:02:33.821712 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.821594    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"
Jul 31 21:02:33.821712 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.821669    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw" event={"ID":"0bb6e352-ab99-47ce-b158-5dfde2652364","Type":"ContainerDied","Data":"0448e39729b00be3ec79e37d29c7d6783ff699bf737452e9f6b362a8fcc465ee"}
Jul 31 21:02:33.821924 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.821746    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw" event={"ID":"0bb6e352-ab99-47ce-b158-5dfde2652364","Type":"ContainerDied","Data":"c4353cbee083ea35f95ffc25097ad5b7930fa640dd59bfa2409ffc74bb7daadf"}
Jul 31 21:02:33.821924 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.821767    2565 scope.go:117] "RemoveContainer" containerID="0448e39729b00be3ec79e37d29c7d6783ff699bf737452e9f6b362a8fcc465ee"
Jul 31 21:02:33.831482 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.831457    2565 scope.go:117] "RemoveContainer" containerID="0448e39729b00be3ec79e37d29c7d6783ff699bf737452e9f6b362a8fcc465ee"
Jul 31 21:02:33.831806 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:02:33.831783    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0448e39729b00be3ec79e37d29c7d6783ff699bf737452e9f6b362a8fcc465ee\": container with ID starting with 0448e39729b00be3ec79e37d29c7d6783ff699bf737452e9f6b362a8fcc465ee not found: ID does not exist" containerID="0448e39729b00be3ec79e37d29c7d6783ff699bf737452e9f6b362a8fcc465ee"
Jul 31 21:02:33.831877 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.831820    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0448e39729b00be3ec79e37d29c7d6783ff699bf737452e9f6b362a8fcc465ee"} err="failed to get container status \"0448e39729b00be3ec79e37d29c7d6783ff699bf737452e9f6b362a8fcc465ee\": rpc error: code = NotFound desc = could not find container \"0448e39729b00be3ec79e37d29c7d6783ff699bf737452e9f6b362a8fcc465ee\": container with ID starting with 0448e39729b00be3ec79e37d29c7d6783ff699bf737452e9f6b362a8fcc465ee not found: ID does not exist"
Jul 31 21:02:33.867532 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.867498    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bb6e352-ab99-47ce-b158-5dfde2652364-openshift-service-ca\") pod \"0bb6e352-ab99-47ce-b158-5dfde2652364\" (UID: \"0bb6e352-ab99-47ce-b158-5dfde2652364\") "
Jul 31 21:02:33.867714 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.867587    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bb6e352-ab99-47ce-b158-5dfde2652364-maas-api-tls\") pod \"0bb6e352-ab99-47ce-b158-5dfde2652364\" (UID: \"0bb6e352-ab99-47ce-b158-5dfde2652364\") "
Jul 31 21:02:33.867714 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.867665    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzc9j\" (UniqueName: \"kubernetes.io/projected/0bb6e352-ab99-47ce-b158-5dfde2652364-kube-api-access-kzc9j\") pod \"0bb6e352-ab99-47ce-b158-5dfde2652364\" (UID: \"0bb6e352-ab99-47ce-b158-5dfde2652364\") "
Jul 31 21:02:33.868359 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.868324    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bb6e352-ab99-47ce-b158-5dfde2652364-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0bb6e352-ab99-47ce-b158-5dfde2652364" (UID: "0bb6e352-ab99-47ce-b158-5dfde2652364"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:02:33.871586 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.871540    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bb6e352-ab99-47ce-b158-5dfde2652364-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0bb6e352-ab99-47ce-b158-5dfde2652364" (UID: "0bb6e352-ab99-47ce-b158-5dfde2652364"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:02:33.879003 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.878962    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bb6e352-ab99-47ce-b158-5dfde2652364-kube-api-access-kzc9j" (OuterVolumeSpecName: "kube-api-access-kzc9j") pod "0bb6e352-ab99-47ce-b158-5dfde2652364" (UID: "0bb6e352-ab99-47ce-b158-5dfde2652364"). InnerVolumeSpecName "kube-api-access-kzc9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:02:33.894207 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.887183    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"]
Jul 31 21:02:33.894207 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.887429    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8" podUID="ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" containerName="istio-proxy" containerID="cri-o://43730d681dc9eaf641af6de331ac585767b782ca07730581e3f1f213b575807e" gracePeriod=30
Jul 31 21:02:33.904561 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.904534    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:33.968430 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.968406    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bb6e352-ab99-47ce-b158-5dfde2652364-openshift-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:02:33.968430 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.968428    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bb6e352-ab99-47ce-b158-5dfde2652364-maas-api-tls\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:02:33.968430 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:33.968438    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzc9j\" (UniqueName: \"kubernetes.io/projected/0bb6e352-ab99-47ce-b158-5dfde2652364-kube-api-access-kzc9j\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:02:34.138829 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:34.138490    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:34.139643 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:34.139619    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"]
Jul 31 21:02:34.141849 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:34.141825    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-393f5f2a-5bbcc44b4c-7xkgw"]
Jul 31 21:02:34.627075 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:34.627045    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:34.745975 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:34.745943    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:34.893869 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:34.893796    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:35.915153 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:35.915125    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bb6e352-ab99-47ce-b158-5dfde2652364" path="/var/lib/kubelet/pods/0bb6e352-ab99-47ce-b158-5dfde2652364/volumes"
Jul 31 21:02:37.018338 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:37.018300    2565 patch_prober.go:28] interesting pod/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 21:02:37.018705 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:37.018363    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8" podUID="ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 21:02:39.143448 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.143419    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:02:39.214806 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.214770    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-workload-certs\") pod \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") "
Jul 31 21:02:39.214806 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.214821    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istiod-ca-cert\") pod \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") "
Jul 31 21:02:39.215086 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.214836    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-envoy\") pod \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") "
Jul 31 21:02:39.215086 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.214859    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-credential-socket\") pod \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") "
Jul 31 21:02:39.215086 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.214888    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-data\") pod \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") "
Jul 31 21:02:39.215086 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.214969    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-token\") pod \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") "
Jul 31 21:02:39.215086 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.214997    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-podinfo\") pod \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") "
Jul 31 21:02:39.215086 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.215023    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwhcs\" (UniqueName: \"kubernetes.io/projected/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-kube-api-access-xwhcs\") pod \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") "
Jul 31 21:02:39.215086 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.215047    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-workload-socket\") pod \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\" (UID: \"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46\") "
Jul 31 21:02:39.215433 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.215117    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" (UID: "ac5e12e5-51f1-4cc0-a88e-59e06e1acc46"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:02:39.215433 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.215198    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" (UID: "ac5e12e5-51f1-4cc0-a88e-59e06e1acc46"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:02:39.215433 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.215336    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" (UID: "ac5e12e5-51f1-4cc0-a88e-59e06e1acc46"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:02:39.215433 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.215385    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" (UID: "ac5e12e5-51f1-4cc0-a88e-59e06e1acc46"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:02:39.215433 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.215395    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-workload-certs\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:02:39.215433 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.215415    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-credential-socket\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:02:39.215719 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.215492    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" (UID: "ac5e12e5-51f1-4cc0-a88e-59e06e1acc46"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:02:39.217417 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.217384    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" (UID: "ac5e12e5-51f1-4cc0-a88e-59e06e1acc46"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 21:02:39.217536 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.217428    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-kube-api-access-xwhcs" (OuterVolumeSpecName: "kube-api-access-xwhcs") pod "ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" (UID: "ac5e12e5-51f1-4cc0-a88e-59e06e1acc46"). InnerVolumeSpecName "kube-api-access-xwhcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:02:39.217848 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.217822    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" (UID: "ac5e12e5-51f1-4cc0-a88e-59e06e1acc46"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:02:39.217848 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.217833    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" (UID: "ac5e12e5-51f1-4cc0-a88e-59e06e1acc46"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:02:39.316645 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.316609    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwhcs\" (UniqueName: \"kubernetes.io/projected/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-kube-api-access-xwhcs\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:02:39.316645 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.316638    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-workload-socket\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:02:39.316645 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.316647    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istiod-ca-cert\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:02:39.316645 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.316656    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-envoy\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:02:39.316951 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.316664    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-data\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:02:39.316951 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.316672    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-token\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:02:39.316951 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.316679    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46-istio-podinfo\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:02:39.857811 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.857776    2565 generic.go:356] "Generic (PLEG): container finished" podID="ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" containerID="43730d681dc9eaf641af6de331ac585767b782ca07730581e3f1f213b575807e" exitCode=0
Jul 31 21:02:39.857986 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.857821    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"
Jul 31 21:02:39.857986 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.857860    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8" event={"ID":"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46","Type":"ContainerDied","Data":"43730d681dc9eaf641af6de331ac585767b782ca07730581e3f1f213b575807e"}
Jul 31 21:02:39.857986 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.857912    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8" event={"ID":"ac5e12e5-51f1-4cc0-a88e-59e06e1acc46","Type":"ContainerDied","Data":"433565e687046cd11fcf7d7712232f8adc3a0129ef6fdefc59dda8bb0d6d1a49"}
Jul 31 21:02:39.857986 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.857933    2565 scope.go:117] "RemoveContainer" containerID="43730d681dc9eaf641af6de331ac585767b782ca07730581e3f1f213b575807e"
Jul 31 21:02:39.867480 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.867461    2565 scope.go:117] "RemoveContainer" containerID="910bbe7a9b94ce3cf76ecbb81266bfdcab638c1b53cb74e782f263156809b639"
Jul 31 21:02:39.875674 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.875657    2565 scope.go:117] "RemoveContainer" containerID="43730d681dc9eaf641af6de331ac585767b782ca07730581e3f1f213b575807e"
Jul 31 21:02:39.875932 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:02:39.875913    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43730d681dc9eaf641af6de331ac585767b782ca07730581e3f1f213b575807e\": container with ID starting with 43730d681dc9eaf641af6de331ac585767b782ca07730581e3f1f213b575807e not found: ID does not exist" containerID="43730d681dc9eaf641af6de331ac585767b782ca07730581e3f1f213b575807e"
Jul 31 21:02:39.875983 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.875944    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43730d681dc9eaf641af6de331ac585767b782ca07730581e3f1f213b575807e"} err="failed to get container status \"43730d681dc9eaf641af6de331ac585767b782ca07730581e3f1f213b575807e\": rpc error: code = NotFound desc = could not find container \"43730d681dc9eaf641af6de331ac585767b782ca07730581e3f1f213b575807e\": container with ID starting with 43730d681dc9eaf641af6de331ac585767b782ca07730581e3f1f213b575807e not found: ID does not exist"
Jul 31 21:02:39.875983 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.875966    2565 scope.go:117] "RemoveContainer" containerID="910bbe7a9b94ce3cf76ecbb81266bfdcab638c1b53cb74e782f263156809b639"
Jul 31 21:02:39.876182 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:02:39.876166    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"910bbe7a9b94ce3cf76ecbb81266bfdcab638c1b53cb74e782f263156809b639\": container with ID starting with 910bbe7a9b94ce3cf76ecbb81266bfdcab638c1b53cb74e782f263156809b639 not found: ID does not exist" containerID="910bbe7a9b94ce3cf76ecbb81266bfdcab638c1b53cb74e782f263156809b639"
Jul 31 21:02:39.876226 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.876187    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"910bbe7a9b94ce3cf76ecbb81266bfdcab638c1b53cb74e782f263156809b639"} err="failed to get container status \"910bbe7a9b94ce3cf76ecbb81266bfdcab638c1b53cb74e782f263156809b639\": rpc error: code = NotFound desc = could not find container \"910bbe7a9b94ce3cf76ecbb81266bfdcab638c1b53cb74e782f263156809b639\": container with ID starting with 910bbe7a9b94ce3cf76ecbb81266bfdcab638c1b53cb74e782f263156809b639 not found: ID does not exist"
Jul 31 21:02:39.880947 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.880927    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"]
Jul 31 21:02:39.886859 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.886836    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-393f5f2a-openshift-default-7d57544868-kzkw8"]
Jul 31 21:02:39.915134 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:39.915108    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" path="/var/lib/kubelet/pods/ac5e12e5-51f1-4cc0-a88e-59e06e1acc46/volumes"
Jul 31 21:02:46.491888 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:46.491809    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:52.810298 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:52.810257    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:52.911842 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:52.911806    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:53.011325 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:53.011289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:02:53.438447 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:02:53.438399    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:03:19.412346 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:03:19.412290    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:03:25.446358 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:03:25.446305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:03:25.516212 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:03:25.516157    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:03:25.648933 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:03:25.648900    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:03:41.590871 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:03:41.590837    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:03:47.366109 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:03:47.366071    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:03:47.480527 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:03:47.480488    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:03:47.570565 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:03:47.570531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:03:58.090092 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:03:58.090031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:09.151047 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:09.151006    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:15.096370 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:15.096290    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:15.158264 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:15.158232    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:15.246606 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:15.246567    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:15.341414 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:15.341379    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:15.439852 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:15.439819    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:16.054311 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:16.054280    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:16.145191 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:16.145157    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:16.246842 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:16.246806    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:17.784403 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:17.784367    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:23.658263 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:23.658227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:23.722909 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:23.722874    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:24.346455 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:24.346416    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:30.464443 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:30.464391    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:31.664257 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:31.664214    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:33.940533 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:33.940479    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:34.037015 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:34.036981    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:35.045262 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.045230    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"]
Jul 31 21:04:35.045775 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.045717    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bb6e352-ab99-47ce-b158-5dfde2652364" containerName="maas-api"
Jul 31 21:04:35.045886 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.045870    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bb6e352-ab99-47ce-b158-5dfde2652364" containerName="maas-api"
Jul 31 21:04:35.045948 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.045912    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" containerName="istio-proxy"
Jul 31 21:04:35.045948 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.045923    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" containerName="istio-proxy"
Jul 31 21:04:35.046058 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.046045    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bb6e352-ab99-47ce-b158-5dfde2652364" containerName="maas-api"
Jul 31 21:04:35.046111 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.046064    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" containerName="istio-proxy"
Jul 31 21:04:35.046111 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.046078    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" containerName="istio-proxy"
Jul 31 21:04:35.049260 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.049240    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"
Jul 31 21:04:35.051370 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.051351    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-30ff49ee-serving-cert\""
Jul 31 21:04:35.058190 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.058165    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"]
Jul 31 21:04:35.080221 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.080182    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:35.148469 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.148433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv4s4\" (UniqueName: \"kubernetes.io/projected/7dd73413-f3df-4d9e-8de6-a07344a33085-kube-api-access-lv4s4\") pod \"maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8\" (UID: \"7dd73413-f3df-4d9e-8de6-a07344a33085\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"
Jul 31 21:04:35.148684 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.148601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dd73413-f3df-4d9e-8de6-a07344a33085-maas-api-tls\") pod \"maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8\" (UID: \"7dd73413-f3df-4d9e-8de6-a07344a33085\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"
Jul 31 21:04:35.148684 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.148635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dd73413-f3df-4d9e-8de6-a07344a33085-openshift-service-ca\") pod \"maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8\" (UID: \"7dd73413-f3df-4d9e-8de6-a07344a33085\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"
Jul 31 21:04:35.180587 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.180552    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:35.250168 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.250131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dd73413-f3df-4d9e-8de6-a07344a33085-maas-api-tls\") pod \"maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8\" (UID: \"7dd73413-f3df-4d9e-8de6-a07344a33085\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"
Jul 31 21:04:35.250377 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.250170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dd73413-f3df-4d9e-8de6-a07344a33085-openshift-service-ca\") pod \"maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8\" (UID: \"7dd73413-f3df-4d9e-8de6-a07344a33085\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"
Jul 31 21:04:35.250377 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.250306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv4s4\" (UniqueName: \"kubernetes.io/projected/7dd73413-f3df-4d9e-8de6-a07344a33085-kube-api-access-lv4s4\") pod \"maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8\" (UID: \"7dd73413-f3df-4d9e-8de6-a07344a33085\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"
Jul 31 21:04:35.250864 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.250841    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dd73413-f3df-4d9e-8de6-a07344a33085-openshift-service-ca\") pod \"maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8\" (UID: \"7dd73413-f3df-4d9e-8de6-a07344a33085\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"
Jul 31 21:04:35.252842 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.252819    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dd73413-f3df-4d9e-8de6-a07344a33085-maas-api-tls\") pod \"maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8\" (UID: \"7dd73413-f3df-4d9e-8de6-a07344a33085\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"
Jul 31 21:04:35.258774 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.258722    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv4s4\" (UniqueName: \"kubernetes.io/projected/7dd73413-f3df-4d9e-8de6-a07344a33085-kube-api-access-lv4s4\") pod \"maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8\" (UID: \"7dd73413-f3df-4d9e-8de6-a07344a33085\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"
Jul 31 21:04:35.361604 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.361512    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"
Jul 31 21:04:35.504296 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.504266    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"]
Jul 31 21:04:35.506124 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:04:35.506095    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dd73413_f3df_4d9e_8de6_a07344a33085.slice/crio-6cbfb096b6d6aca6e432d5ed59ab29e8a1b090c0c161d4ed6cc5f4741d959c0b WatchSource:0}: Error finding container 6cbfb096b6d6aca6e432d5ed59ab29e8a1b090c0c161d4ed6cc5f4741d959c0b: Status 404 returned error can't find the container with id 6cbfb096b6d6aca6e432d5ed59ab29e8a1b090c0c161d4ed6cc5f4741d959c0b
Jul 31 21:04:35.579868 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.579837    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:35.710246 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.710171    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:35.862906 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.862875    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld"]
Jul 31 21:04:35.863272 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.863254    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" containerName="istio-proxy"
Jul 31 21:04:35.863350 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.863276    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5e12e5-51f1-4cc0-a88e-59e06e1acc46" containerName="istio-proxy"
Jul 31 21:04:35.867458 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.867436    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld"
Jul 31 21:04:35.869297 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.869274    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-30ff49ee\""
Jul 31 21:04:35.869437 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.869313    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-30ff49ee-dockercfg-5xctq\""
Jul 31 21:04:35.876640 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.876621    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld"]
Jul 31 21:04:35.956120 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.956098    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14064497-e6d9-4c78-ba4e-bb5fe715c3c9-plugins-config-volume\") pod \"payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld\" (UID: \"14064497-e6d9-4c78-ba4e-bb5fe715c3c9\") " pod="openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld"
Jul 31 21:04:35.956269 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:35.956237    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn8bd\" (UniqueName: \"kubernetes.io/projected/14064497-e6d9-4c78-ba4e-bb5fe715c3c9-kube-api-access-zn8bd\") pod \"payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld\" (UID: \"14064497-e6d9-4c78-ba4e-bb5fe715c3c9\") " pod="openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld"
Jul 31 21:04:36.057608 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:36.057564    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn8bd\" (UniqueName: \"kubernetes.io/projected/14064497-e6d9-4c78-ba4e-bb5fe715c3c9-kube-api-access-zn8bd\") pod \"payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld\" (UID: \"14064497-e6d9-4c78-ba4e-bb5fe715c3c9\") " pod="openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld"
Jul 31 21:04:36.058095 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:36.057646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14064497-e6d9-4c78-ba4e-bb5fe715c3c9-plugins-config-volume\") pod \"payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld\" (UID: \"14064497-e6d9-4c78-ba4e-bb5fe715c3c9\") " pod="openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld"
Jul 31 21:04:36.058443 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:36.058418    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14064497-e6d9-4c78-ba4e-bb5fe715c3c9-plugins-config-volume\") pod \"payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld\" (UID: \"14064497-e6d9-4c78-ba4e-bb5fe715c3c9\") " pod="openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld"
Jul 31 21:04:36.064848 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:36.064818    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn8bd\" (UniqueName: \"kubernetes.io/projected/14064497-e6d9-4c78-ba4e-bb5fe715c3c9-kube-api-access-zn8bd\") pod \"payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld\" (UID: \"14064497-e6d9-4c78-ba4e-bb5fe715c3c9\") " pod="openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld"
Jul 31 21:04:36.180124 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:36.180089    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld"
Jul 31 21:04:36.317512 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:36.317490    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld"]
Jul 31 21:04:36.319473 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:04:36.319443    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14064497_e6d9_4c78_ba4e_bb5fe715c3c9.slice/crio-7482dd0b0b2263ba09cfa1c5de7c5564e9527d633f26b034237db60f47facd09 WatchSource:0}: Error finding container 7482dd0b0b2263ba09cfa1c5de7c5564e9527d633f26b034237db60f47facd09: Status 404 returned error can't find the container with id 7482dd0b0b2263ba09cfa1c5de7c5564e9527d633f26b034237db60f47facd09
Jul 31 21:04:36.454419 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:36.454379    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld" event={"ID":"14064497-e6d9-4c78-ba4e-bb5fe715c3c9","Type":"ContainerStarted","Data":"ee0c5be977240bad1f1f00c676ed98c37a81dc9c6303922109d589f56313d1f6"}
Jul 31 21:04:36.454621 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:36.454445    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld" event={"ID":"14064497-e6d9-4c78-ba4e-bb5fe715c3c9","Type":"ContainerStarted","Data":"7482dd0b0b2263ba09cfa1c5de7c5564e9527d633f26b034237db60f47facd09"}
Jul 31 21:04:36.454621 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:36.454579    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld"
Jul 31 21:04:36.456109 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:36.456087    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8" event={"ID":"7dd73413-f3df-4d9e-8de6-a07344a33085","Type":"ContainerStarted","Data":"9526da849b6ed34cf3357b28fadd8052d6ab15f8ae51df4a382e546b9f2a0a6f"}
Jul 31 21:04:36.456266 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:36.456127    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8" event={"ID":"7dd73413-f3df-4d9e-8de6-a07344a33085","Type":"ContainerStarted","Data":"6cbfb096b6d6aca6e432d5ed59ab29e8a1b090c0c161d4ed6cc5f4741d959c0b"}
Jul 31 21:04:36.456266 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:36.456150    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"
Jul 31 21:04:36.472167 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:36.472112    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld" podStartSLOduration=1.4720976700000001 podStartE2EDuration="1.47209767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:04:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:04:36.46928691 +0000 UTC m=+2085.074581273" watchObservedRunningTime="2026-07-31 21:04:36.47209767 +0000 UTC m=+2085.077392101"
Jul 31 21:04:36.484472 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:36.484151    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8" podStartSLOduration=1.0501365009999999 podStartE2EDuration="1.484133221s" totalImagesPullingTime="433.99672ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:04:36.483547521 +0000 UTC m=+2085.088841887" watchObservedRunningTime="2026-07-31 21:04:36.484133221 +0000 UTC m=+2085.089427585"
Jul 31 21:04:42.468901 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:42.468874    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"
Jul 31 21:04:47.465433 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:47.465403    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld"
Jul 31 21:04:52.017104 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:52.017071    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 21:04:52.022299 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:52.022277    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 21:04:52.024875 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:52.024854    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 21:04:52.030205 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:52.030187    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 21:04:55.065364 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:55.065324    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:55.119919 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:55.119879    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:58.935894 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:58.935854    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:59.677371 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:59.677299    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:04:59.769616 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:04:59.769576    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:00.151057 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:00.151024    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:06.184783 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:06.184727    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:06.281825 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:06.281788    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:06.511105 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:06.511026    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7"]
Jul 31 21:05:06.514894 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:06.514868    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7"
Jul 31 21:05:06.518793 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:06.518772    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 21:05:06.524831 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:06.524810    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7"]
Jul 31 21:05:06.621361 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:06.621332    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0bfd9c7-c95e-458d-98ef-869eeb48f8cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7\" (UID: \"e0bfd9c7-c95e-458d-98ef-869eeb48f8cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7"
Jul 31 21:05:06.722435 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:06.722403    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0bfd9c7-c95e-458d-98ef-869eeb48f8cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7\" (UID: \"e0bfd9c7-c95e-458d-98ef-869eeb48f8cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7"
Jul 31 21:05:06.723038 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:06.723018    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0bfd9c7-c95e-458d-98ef-869eeb48f8cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7\" (UID: \"e0bfd9c7-c95e-458d-98ef-869eeb48f8cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7"
Jul 31 21:05:06.828448 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:06.828363    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7"
Jul 31 21:05:06.968454 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:06.968423    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7"]
Jul 31 21:05:06.970505 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:05:06.970476    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0bfd9c7_c95e_458d_98ef_869eeb48f8cf.slice/crio-d01f47165bfed60b7055b54fb94291822247d2d919b3bdbdeaf6437c9bf37e29 WatchSource:0}: Error finding container d01f47165bfed60b7055b54fb94291822247d2d919b3bdbdeaf6437c9bf37e29: Status 404 returned error can't find the container with id d01f47165bfed60b7055b54fb94291822247d2d919b3bdbdeaf6437c9bf37e29
Jul 31 21:05:07.618476 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:07.618435    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7" event={"ID":"e0bfd9c7-c95e-458d-98ef-869eeb48f8cf","Type":"ContainerStarted","Data":"38939bed1dc8ea646e8b2a1f4e592633439203340951d015fd9180b620b63511"}
Jul 31 21:05:07.618910 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:07.618487    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7" event={"ID":"e0bfd9c7-c95e-458d-98ef-869eeb48f8cf","Type":"ContainerStarted","Data":"d01f47165bfed60b7055b54fb94291822247d2d919b3bdbdeaf6437c9bf37e29"}
Jul 31 21:05:07.634765 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:07.634695    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7" podStartSLOduration=1.634680715 podStartE2EDuration="1.634680715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:05:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:05:07.633577289 +0000 UTC m=+2116.238871652" watchObservedRunningTime="2026-07-31 21:05:07.634680715 +0000 UTC m=+2116.239975074"
Jul 31 21:05:08.625948 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:08.625909    2565 generic.go:356] "Generic (PLEG): container finished" podID="e0bfd9c7-c95e-458d-98ef-869eeb48f8cf" containerID="38939bed1dc8ea646e8b2a1f4e592633439203340951d015fd9180b620b63511" exitCode=0
Jul 31 21:05:08.626344 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:08.625972    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7" event={"ID":"e0bfd9c7-c95e-458d-98ef-869eeb48f8cf","Type":"ContainerDied","Data":"38939bed1dc8ea646e8b2a1f4e592633439203340951d015fd9180b620b63511"}
Jul 31 21:05:09.766229 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:09.766207    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7"
Jul 31 21:05:09.851855 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:09.851825    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0bfd9c7-c95e-458d-98ef-869eeb48f8cf-maas-api-service-ca\") pod \"e0bfd9c7-c95e-458d-98ef-869eeb48f8cf\" (UID: \"e0bfd9c7-c95e-458d-98ef-869eeb48f8cf\") "
Jul 31 21:05:09.852161 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:09.852139    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0bfd9c7-c95e-458d-98ef-869eeb48f8cf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e0bfd9c7-c95e-458d-98ef-869eeb48f8cf" (UID: "e0bfd9c7-c95e-458d-98ef-869eeb48f8cf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:05:09.953236 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:09.953210    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0bfd9c7-c95e-458d-98ef-869eeb48f8cf-maas-api-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:05:10.637593 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:10.637565    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7"
Jul 31 21:05:10.637785 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:10.637612    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7" event={"ID":"e0bfd9c7-c95e-458d-98ef-869eeb48f8cf","Type":"ContainerDied","Data":"d01f47165bfed60b7055b54fb94291822247d2d919b3bdbdeaf6437c9bf37e29"}
Jul 31 21:05:10.637785 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:10.637663    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d01f47165bfed60b7055b54fb94291822247d2d919b3bdbdeaf6437c9bf37e29"
Jul 31 21:05:16.902322 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:16.902289    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"]
Jul 31 21:05:16.902898 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:16.902534    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8" podUID="7dd73413-f3df-4d9e-8de6-a07344a33085" containerName="maas-api" containerID="cri-o://9526da849b6ed34cf3357b28fadd8052d6ab15f8ae51df4a382e546b9f2a0a6f" gracePeriod=30
Jul 31 21:05:16.933432 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:16.933399    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:16.962141 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:16.962114    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld"]
Jul 31 21:05:16.962368 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:16.962324    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld" podUID="14064497-e6d9-4c78-ba4e-bb5fe715c3c9" containerName="payload-processing" containerID="cri-o://ee0c5be977240bad1f1f00c676ed98c37a81dc9c6303922109d589f56313d1f6" gracePeriod=30
Jul 31 21:05:17.034492 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.034456    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:17.130427 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.130388    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:17.130583 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.130489    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7"]
Jul 31 21:05:17.132705 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.132680    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30ff49ee-rwrx7"]
Jul 31 21:05:17.210429 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.210405    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"
Jul 31 21:05:17.230272 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.230243    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:17.247768 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.247723    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld"
Jul 31 21:05:17.320976 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.320952    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dd73413-f3df-4d9e-8de6-a07344a33085-maas-api-tls\") pod \"7dd73413-f3df-4d9e-8de6-a07344a33085\" (UID: \"7dd73413-f3df-4d9e-8de6-a07344a33085\") "
Jul 31 21:05:17.321136 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.321033    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lv4s4\" (UniqueName: \"kubernetes.io/projected/7dd73413-f3df-4d9e-8de6-a07344a33085-kube-api-access-lv4s4\") pod \"7dd73413-f3df-4d9e-8de6-a07344a33085\" (UID: \"7dd73413-f3df-4d9e-8de6-a07344a33085\") "
Jul 31 21:05:17.321136 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.321054    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14064497-e6d9-4c78-ba4e-bb5fe715c3c9-plugins-config-volume\") pod \"14064497-e6d9-4c78-ba4e-bb5fe715c3c9\" (UID: \"14064497-e6d9-4c78-ba4e-bb5fe715c3c9\") "
Jul 31 21:05:17.321136 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.321072    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dd73413-f3df-4d9e-8de6-a07344a33085-openshift-service-ca\") pod \"7dd73413-f3df-4d9e-8de6-a07344a33085\" (UID: \"7dd73413-f3df-4d9e-8de6-a07344a33085\") "
Jul 31 21:05:17.321136 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.321118    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zn8bd\" (UniqueName: \"kubernetes.io/projected/14064497-e6d9-4c78-ba4e-bb5fe715c3c9-kube-api-access-zn8bd\") pod \"14064497-e6d9-4c78-ba4e-bb5fe715c3c9\" (UID: \"14064497-e6d9-4c78-ba4e-bb5fe715c3c9\") "
Jul 31 21:05:17.321460 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.321433    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14064497-e6d9-4c78-ba4e-bb5fe715c3c9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "14064497-e6d9-4c78-ba4e-bb5fe715c3c9" (UID: "14064497-e6d9-4c78-ba4e-bb5fe715c3c9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:05:17.321460 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.321445    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dd73413-f3df-4d9e-8de6-a07344a33085-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7dd73413-f3df-4d9e-8de6-a07344a33085" (UID: "7dd73413-f3df-4d9e-8de6-a07344a33085"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:05:17.323350 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.323328    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dd73413-f3df-4d9e-8de6-a07344a33085-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7dd73413-f3df-4d9e-8de6-a07344a33085" (UID: "7dd73413-f3df-4d9e-8de6-a07344a33085"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:05:17.323350 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.323336    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14064497-e6d9-4c78-ba4e-bb5fe715c3c9-kube-api-access-zn8bd" (OuterVolumeSpecName: "kube-api-access-zn8bd") pod "14064497-e6d9-4c78-ba4e-bb5fe715c3c9" (UID: "14064497-e6d9-4c78-ba4e-bb5fe715c3c9"). InnerVolumeSpecName "kube-api-access-zn8bd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:05:17.323484 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.323390    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dd73413-f3df-4d9e-8de6-a07344a33085-kube-api-access-lv4s4" (OuterVolumeSpecName: "kube-api-access-lv4s4") pod "7dd73413-f3df-4d9e-8de6-a07344a33085" (UID: "7dd73413-f3df-4d9e-8de6-a07344a33085"). InnerVolumeSpecName "kube-api-access-lv4s4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:05:17.421954 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.421869    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zn8bd\" (UniqueName: \"kubernetes.io/projected/14064497-e6d9-4c78-ba4e-bb5fe715c3c9-kube-api-access-zn8bd\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:05:17.421954 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.421899    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dd73413-f3df-4d9e-8de6-a07344a33085-maas-api-tls\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:05:17.421954 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.421909    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv4s4\" (UniqueName: \"kubernetes.io/projected/7dd73413-f3df-4d9e-8de6-a07344a33085-kube-api-access-lv4s4\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:05:17.421954 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.421918    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14064497-e6d9-4c78-ba4e-bb5fe715c3c9-plugins-config-volume\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:05:17.421954 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.421929    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dd73413-f3df-4d9e-8de6-a07344a33085-openshift-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:05:17.623126 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.623089    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:17.677309 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.677226    2565 generic.go:356] "Generic (PLEG): container finished" podID="14064497-e6d9-4c78-ba4e-bb5fe715c3c9" containerID="ee0c5be977240bad1f1f00c676ed98c37a81dc9c6303922109d589f56313d1f6" exitCode=0
Jul 31 21:05:17.677309 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.677270    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld"
Jul 31 21:05:17.677528 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.677317    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld" event={"ID":"14064497-e6d9-4c78-ba4e-bb5fe715c3c9","Type":"ContainerDied","Data":"ee0c5be977240bad1f1f00c676ed98c37a81dc9c6303922109d589f56313d1f6"}
Jul 31 21:05:17.677528 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.677378    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld" event={"ID":"14064497-e6d9-4c78-ba4e-bb5fe715c3c9","Type":"ContainerDied","Data":"7482dd0b0b2263ba09cfa1c5de7c5564e9527d633f26b034237db60f47facd09"}
Jul 31 21:05:17.677528 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.677408    2565 scope.go:117] "RemoveContainer" containerID="ee0c5be977240bad1f1f00c676ed98c37a81dc9c6303922109d589f56313d1f6"
Jul 31 21:05:17.678633 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.678611    2565 generic.go:356] "Generic (PLEG): container finished" podID="7dd73413-f3df-4d9e-8de6-a07344a33085" containerID="9526da849b6ed34cf3357b28fadd8052d6ab15f8ae51df4a382e546b9f2a0a6f" exitCode=0
Jul 31 21:05:17.678768 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.678643    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8" event={"ID":"7dd73413-f3df-4d9e-8de6-a07344a33085","Type":"ContainerDied","Data":"9526da849b6ed34cf3357b28fadd8052d6ab15f8ae51df4a382e546b9f2a0a6f"}
Jul 31 21:05:17.678768 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.678664    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"
Jul 31 21:05:17.678768 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.678690    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8" event={"ID":"7dd73413-f3df-4d9e-8de6-a07344a33085","Type":"ContainerDied","Data":"6cbfb096b6d6aca6e432d5ed59ab29e8a1b090c0c161d4ed6cc5f4741d959c0b"}
Jul 31 21:05:17.687885 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.687866    2565 scope.go:117] "RemoveContainer" containerID="ee0c5be977240bad1f1f00c676ed98c37a81dc9c6303922109d589f56313d1f6"
Jul 31 21:05:17.688307 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:05:17.688280    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee0c5be977240bad1f1f00c676ed98c37a81dc9c6303922109d589f56313d1f6\": container with ID starting with ee0c5be977240bad1f1f00c676ed98c37a81dc9c6303922109d589f56313d1f6 not found: ID does not exist" containerID="ee0c5be977240bad1f1f00c676ed98c37a81dc9c6303922109d589f56313d1f6"
Jul 31 21:05:17.688409 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.688314    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee0c5be977240bad1f1f00c676ed98c37a81dc9c6303922109d589f56313d1f6"} err="failed to get container status \"ee0c5be977240bad1f1f00c676ed98c37a81dc9c6303922109d589f56313d1f6\": rpc error: code = NotFound desc = could not find container \"ee0c5be977240bad1f1f00c676ed98c37a81dc9c6303922109d589f56313d1f6\": container with ID starting with ee0c5be977240bad1f1f00c676ed98c37a81dc9c6303922109d589f56313d1f6 not found: ID does not exist"
Jul 31 21:05:17.688409 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.688332    2565 scope.go:117] "RemoveContainer" containerID="9526da849b6ed34cf3357b28fadd8052d6ab15f8ae51df4a382e546b9f2a0a6f"
Jul 31 21:05:17.696877 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.696861    2565 scope.go:117] "RemoveContainer" containerID="9526da849b6ed34cf3357b28fadd8052d6ab15f8ae51df4a382e546b9f2a0a6f"
Jul 31 21:05:17.697140 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:05:17.697122    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9526da849b6ed34cf3357b28fadd8052d6ab15f8ae51df4a382e546b9f2a0a6f\": container with ID starting with 9526da849b6ed34cf3357b28fadd8052d6ab15f8ae51df4a382e546b9f2a0a6f not found: ID does not exist" containerID="9526da849b6ed34cf3357b28fadd8052d6ab15f8ae51df4a382e546b9f2a0a6f"
Jul 31 21:05:17.697210 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.697144    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9526da849b6ed34cf3357b28fadd8052d6ab15f8ae51df4a382e546b9f2a0a6f"} err="failed to get container status \"9526da849b6ed34cf3357b28fadd8052d6ab15f8ae51df4a382e546b9f2a0a6f\": rpc error: code = NotFound desc = could not find container \"9526da849b6ed34cf3357b28fadd8052d6ab15f8ae51df4a382e546b9f2a0a6f\": container with ID starting with 9526da849b6ed34cf3357b28fadd8052d6ab15f8ae51df4a382e546b9f2a0a6f not found: ID does not exist"
Jul 31 21:05:17.702441 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.702418    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld"]
Jul 31 21:05:17.707269 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.707251    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-30ff49ee-599f9bb-xf4ld"]
Jul 31 21:05:17.717090 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.717065    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"]
Jul 31 21:05:17.720985 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.720966    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-30ff49ee-5d586c8dfb-6w4q8"]
Jul 31 21:05:17.917169 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.917134    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14064497-e6d9-4c78-ba4e-bb5fe715c3c9" path="/var/lib/kubelet/pods/14064497-e6d9-4c78-ba4e-bb5fe715c3c9/volumes"
Jul 31 21:05:17.917686 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.917669    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dd73413-f3df-4d9e-8de6-a07344a33085" path="/var/lib/kubelet/pods/7dd73413-f3df-4d9e-8de6-a07344a33085/volumes"
Jul 31 21:05:17.918109 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:17.918091    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0bfd9c7-c95e-458d-98ef-869eeb48f8cf" path="/var/lib/kubelet/pods/e0bfd9c7-c95e-458d-98ef-869eeb48f8cf/volumes"
Jul 31 21:05:23.275104 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:23.275068    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:23.376129 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:23.376097    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:23.564628 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:23.564551    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:23.815474 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:23.815402    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:23.953901 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:23.953870    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:24.055474 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:24.055436    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:24.204013 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:24.203988    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:29.701698 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:29.701653    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:29.809984 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:29.809955    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:29.902144 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:29.902116    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:30.152866 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:30.152775    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:35.935660 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:35.935622    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:05:35.997635 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:05:35.997601    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:06:43.910273 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:06:43.910223    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:07:39.071753 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:39.071699    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:07:39.358306 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:39.358233    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:07:39.754200 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:39.754168    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:07:42.626622 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:42.626587    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:07:42.758950 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:42.758857    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:07:43.704679 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.704647    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"]
Jul 31 21:07:43.705157 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.705038    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0bfd9c7-c95e-458d-98ef-869eeb48f8cf" containerName="revoke-keys"
Jul 31 21:07:43.705157 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.705050    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0bfd9c7-c95e-458d-98ef-869eeb48f8cf" containerName="revoke-keys"
Jul 31 21:07:43.705157 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.705059    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14064497-e6d9-4c78-ba4e-bb5fe715c3c9" containerName="payload-processing"
Jul 31 21:07:43.705157 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.705065    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="14064497-e6d9-4c78-ba4e-bb5fe715c3c9" containerName="payload-processing"
Jul 31 21:07:43.705157 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.705083    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dd73413-f3df-4d9e-8de6-a07344a33085" containerName="maas-api"
Jul 31 21:07:43.705157 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.705093    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dd73413-f3df-4d9e-8de6-a07344a33085" containerName="maas-api"
Jul 31 21:07:43.705480 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.705178    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="14064497-e6d9-4c78-ba4e-bb5fe715c3c9" containerName="payload-processing"
Jul 31 21:07:43.705480 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.705188    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0bfd9c7-c95e-458d-98ef-869eeb48f8cf" containerName="revoke-keys"
Jul 31 21:07:43.705480 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.705198    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dd73413-f3df-4d9e-8de6-a07344a33085" containerName="maas-api"
Jul 31 21:07:43.708395 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.708376    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"
Jul 31 21:07:43.710271 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.710251    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-cceca8ff-serving-cert\""
Jul 31 21:07:43.718607 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.718582    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"]
Jul 31 21:07:43.738277 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.738251    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:07:43.807088 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.807032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-maas-api-tls\") pod \"maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8\" (UID: \"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"
Jul 31 21:07:43.807281 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.807117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d2xm\" (UniqueName: \"kubernetes.io/projected/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-kube-api-access-9d2xm\") pod \"maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8\" (UID: \"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"
Jul 31 21:07:43.807281 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.807257    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-openshift-service-ca\") pod \"maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8\" (UID: \"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"
Jul 31 21:07:43.908641 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.908606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-maas-api-tls\") pod \"maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8\" (UID: \"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"
Jul 31 21:07:43.908830 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.908651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d2xm\" (UniqueName: \"kubernetes.io/projected/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-kube-api-access-9d2xm\") pod \"maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8\" (UID: \"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"
Jul 31 21:07:43.908830 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.908678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-openshift-service-ca\") pod \"maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8\" (UID: \"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"
Jul 31 21:07:43.908830 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:07:43.908730    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-serving-cert: secret "maas-api-e2e-mt-cceca8ff-serving-cert" not found
Jul 31 21:07:43.908952 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:07:43.908838    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-maas-api-tls podName:ffcaf6c3-6bf3-4ce3-8322-90d99c702de0 nodeName:}" failed. No retries permitted until 2026-07-31 21:07:44.408817326 +0000 UTC m=+2273.014111692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-maas-api-tls") pod "maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8" (UID: "ffcaf6c3-6bf3-4ce3-8322-90d99c702de0") : secret "maas-api-e2e-mt-cceca8ff-serving-cert" not found
Jul 31 21:07:43.909313 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.909296    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-openshift-service-ca\") pod \"maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8\" (UID: \"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"
Jul 31 21:07:43.917122 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:43.917102    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d2xm\" (UniqueName: \"kubernetes.io/projected/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-kube-api-access-9d2xm\") pod \"maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8\" (UID: \"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"
Jul 31 21:07:44.010294 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.010215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:07:44.321861 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.321784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:07:44.412754 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.412695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-maas-api-tls\") pod \"maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8\" (UID: \"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"
Jul 31 21:07:44.415238 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.415208    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-maas-api-tls\") pod \"maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8\" (UID: \"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"
Jul 31 21:07:44.421728 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.421706    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:07:44.454006 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.453976    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng"]
Jul 31 21:07:44.457526 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.457505    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng"
Jul 31 21:07:44.459382 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.459359    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-cceca8ff-dockercfg-h927g\""
Jul 31 21:07:44.459382 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.459374    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-cceca8ff\""
Jul 31 21:07:44.467252 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.467231    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng"]
Jul 31 21:07:44.514288 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.514253    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b1dce34-8f91-4f2f-9128-7a10eb18aa0b-plugins-config-volume\") pod \"payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng\" (UID: \"5b1dce34-8f91-4f2f-9128-7a10eb18aa0b\") " pod="openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng"
Jul 31 21:07:44.514487 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.514462    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkgqh\" (UniqueName: \"kubernetes.io/projected/5b1dce34-8f91-4f2f-9128-7a10eb18aa0b-kube-api-access-jkgqh\") pod \"payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng\" (UID: \"5b1dce34-8f91-4f2f-9128-7a10eb18aa0b\") " pod="openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng"
Jul 31 21:07:44.615794 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.615692    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkgqh\" (UniqueName: \"kubernetes.io/projected/5b1dce34-8f91-4f2f-9128-7a10eb18aa0b-kube-api-access-jkgqh\") pod \"payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng\" (UID: \"5b1dce34-8f91-4f2f-9128-7a10eb18aa0b\") " pod="openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng"
Jul 31 21:07:44.615938 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.615792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b1dce34-8f91-4f2f-9128-7a10eb18aa0b-plugins-config-volume\") pod \"payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng\" (UID: \"5b1dce34-8f91-4f2f-9128-7a10eb18aa0b\") " pod="openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng"
Jul 31 21:07:44.616494 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.616472    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b1dce34-8f91-4f2f-9128-7a10eb18aa0b-plugins-config-volume\") pod \"payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng\" (UID: \"5b1dce34-8f91-4f2f-9128-7a10eb18aa0b\") " pod="openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng"
Jul 31 21:07:44.619505 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.619482    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"
Jul 31 21:07:44.623298 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.623273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkgqh\" (UniqueName: \"kubernetes.io/projected/5b1dce34-8f91-4f2f-9128-7a10eb18aa0b-kube-api-access-jkgqh\") pod \"payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng\" (UID: \"5b1dce34-8f91-4f2f-9128-7a10eb18aa0b\") " pod="openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng"
Jul 31 21:07:44.756760 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.756709    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"]
Jul 31 21:07:44.758651 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:07:44.758626    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffcaf6c3_6bf3_4ce3_8322_90d99c702de0.slice/crio-5c412b3998f28f8aa8765ece713f977d9820da1bac59889f66c714f141b3343d WatchSource:0}: Error finding container 5c412b3998f28f8aa8765ece713f977d9820da1bac59889f66c714f141b3343d: Status 404 returned error can't find the container with id 5c412b3998f28f8aa8765ece713f977d9820da1bac59889f66c714f141b3343d
Jul 31 21:07:44.760169 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.760151    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 21:07:44.769670 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:44.769651    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng"
Jul 31 21:07:45.114068 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:45.113936    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng"]
Jul 31 21:07:45.117434 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:07:45.117404    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b1dce34_8f91_4f2f_9128_7a10eb18aa0b.slice/crio-cc74ad9e1e95c8aedb70e664f65db76cc4b250133d92ba91e45bff586a740338 WatchSource:0}: Error finding container cc74ad9e1e95c8aedb70e664f65db76cc4b250133d92ba91e45bff586a740338: Status 404 returned error can't find the container with id cc74ad9e1e95c8aedb70e664f65db76cc4b250133d92ba91e45bff586a740338
Jul 31 21:07:45.450060 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:45.450025    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng" event={"ID":"5b1dce34-8f91-4f2f-9128-7a10eb18aa0b","Type":"ContainerStarted","Data":"7b8c4e48b3590f51cb758ae8cb370d441598ab5f4e9da612a54f5ea394d5e143"}
Jul 31 21:07:45.450239 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:45.450082    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng" event={"ID":"5b1dce34-8f91-4f2f-9128-7a10eb18aa0b","Type":"ContainerStarted","Data":"cc74ad9e1e95c8aedb70e664f65db76cc4b250133d92ba91e45bff586a740338"}
Jul 31 21:07:45.450239 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:45.450195    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng"
Jul 31 21:07:45.451327 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:45.451305    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8" event={"ID":"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0","Type":"ContainerStarted","Data":"5c412b3998f28f8aa8765ece713f977d9820da1bac59889f66c714f141b3343d"}
Jul 31 21:07:45.465052 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:45.465011    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng" podStartSLOduration=1.464998506 podStartE2EDuration="1.464998506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:07:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:07:45.463790042 +0000 UTC m=+2274.069084405" watchObservedRunningTime="2026-07-31 21:07:45.464998506 +0000 UTC m=+2274.070292869"
Jul 31 21:07:46.467252 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:46.467212    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8" event={"ID":"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0","Type":"ContainerStarted","Data":"e091adf22d25221a5ba14285da5e6002eb0e7257b83ef296835e10a4114a2e9f"}
Jul 31 21:07:46.484431 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:46.484382    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8" podStartSLOduration=2.747343598 podStartE2EDuration="3.48436729s" totalImagesPullingTime="737.023692ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:07:46.481279297 +0000 UTC m=+2275.086573674" watchObservedRunningTime="2026-07-31 21:07:46.48436729 +0000 UTC m=+2275.089661654"
Jul 31 21:07:47.473650 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:47.473607    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"
Jul 31 21:07:47.684287 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:47.684255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:07:47.887947 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:47.887861    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:07:52.143130 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:52.143096    2565 scope.go:117] "RemoveContainer" containerID="cb2000b1b3057ece6f5ed8b11c13b71b7886eef6dc81f100126e42f97b3208d5"
Jul 31 21:07:53.483403 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:53.483373    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"
Jul 31 21:07:56.469889 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:07:56.469862    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng"
Jul 31 21:08:07.575886 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:08:07.575851    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:08:34.389274 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:08:34.389242    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:09:02.492396 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:02.492353    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cceca8ff-kvbjg"]
Jul 31 21:09:02.495875 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:02.495852    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cceca8ff-kvbjg"
Jul 31 21:09:02.497685 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:02.497666    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 21:09:02.502370 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:02.502344    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cceca8ff-kvbjg"]
Jul 31 21:09:02.587263 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:02.587219    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3ead03c-43b7-4f1d-b9cc-4af91b648d8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cceca8ff-kvbjg\" (UID: \"c3ead03c-43b7-4f1d-b9cc-4af91b648d8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cceca8ff-kvbjg"
Jul 31 21:09:02.688763 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:02.688697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3ead03c-43b7-4f1d-b9cc-4af91b648d8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cceca8ff-kvbjg\" (UID: \"c3ead03c-43b7-4f1d-b9cc-4af91b648d8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cceca8ff-kvbjg"
Jul 31 21:09:02.689351 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:02.689331    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3ead03c-43b7-4f1d-b9cc-4af91b648d8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cceca8ff-kvbjg\" (UID: \"c3ead03c-43b7-4f1d-b9cc-4af91b648d8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cceca8ff-kvbjg"
Jul 31 21:09:02.808728 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:02.808637    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cceca8ff-kvbjg"
Jul 31 21:09:02.947186 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:02.947156    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cceca8ff-kvbjg"]
Jul 31 21:09:02.949321 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:09:02.949290    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3ead03c_43b7_4f1d_b9cc_4af91b648d8d.slice/crio-eda168e176941222078aba914dd60ef912cc4b45456912f320d5a51985ba535e WatchSource:0}: Error finding container eda168e176941222078aba914dd60ef912cc4b45456912f320d5a51985ba535e: Status 404 returned error can't find the container with id eda168e176941222078aba914dd60ef912cc4b45456912f320d5a51985ba535e
Jul 31 21:09:03.876056 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:03.876014    2565 generic.go:356] "Generic (PLEG): container finished" podID="c3ead03c-43b7-4f1d-b9cc-4af91b648d8d" containerID="5c43f7739e00b8ac90e7b0c054f94835ea2497d27b9118fa2063141c10da9788" exitCode=0
Jul 31 21:09:03.876454 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:03.876061    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cceca8ff-kvbjg" event={"ID":"c3ead03c-43b7-4f1d-b9cc-4af91b648d8d","Type":"ContainerDied","Data":"5c43f7739e00b8ac90e7b0c054f94835ea2497d27b9118fa2063141c10da9788"}
Jul 31 21:09:03.876454 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:03.876115    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cceca8ff-kvbjg" event={"ID":"c3ead03c-43b7-4f1d-b9cc-4af91b648d8d","Type":"ContainerStarted","Data":"eda168e176941222078aba914dd60ef912cc4b45456912f320d5a51985ba535e"}
Jul 31 21:09:05.021655 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:05.021631    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cceca8ff-kvbjg"
Jul 31 21:09:05.114039 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:05.114004    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3ead03c-43b7-4f1d-b9cc-4af91b648d8d-maas-api-service-ca\") pod \"c3ead03c-43b7-4f1d-b9cc-4af91b648d8d\" (UID: \"c3ead03c-43b7-4f1d-b9cc-4af91b648d8d\") "
Jul 31 21:09:05.114367 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:05.114345    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3ead03c-43b7-4f1d-b9cc-4af91b648d8d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c3ead03c-43b7-4f1d-b9cc-4af91b648d8d" (UID: "c3ead03c-43b7-4f1d-b9cc-4af91b648d8d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:09:05.215183 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:05.215147    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3ead03c-43b7-4f1d-b9cc-4af91b648d8d-maas-api-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:09:05.888413 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:05.888376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cceca8ff-kvbjg" event={"ID":"c3ead03c-43b7-4f1d-b9cc-4af91b648d8d","Type":"ContainerDied","Data":"eda168e176941222078aba914dd60ef912cc4b45456912f320d5a51985ba535e"}
Jul 31 21:09:05.888590 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:05.888424    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eda168e176941222078aba914dd60ef912cc4b45456912f320d5a51985ba535e"
Jul 31 21:09:05.888590 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:05.888385    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cceca8ff-kvbjg"
Jul 31 21:09:18.035170 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.035128    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"]
Jul 31 21:09:18.035710 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.035449    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8" podUID="ffcaf6c3-6bf3-4ce3-8322-90d99c702de0" containerName="maas-api" containerID="cri-o://e091adf22d25221a5ba14285da5e6002eb0e7257b83ef296835e10a4114a2e9f" gracePeriod=30
Jul 31 21:09:18.060899 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.060856    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:09:18.085808 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.085777    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng"]
Jul 31 21:09:18.086059 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.086034    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng" podUID="5b1dce34-8f91-4f2f-9128-7a10eb18aa0b" containerName="payload-processing" containerID="cri-o://7b8c4e48b3590f51cb758ae8cb370d441598ab5f4e9da612a54f5ea394d5e143" gracePeriod=30
Jul 31 21:09:18.161040 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.161007    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:09:18.230673 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.230640    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cceca8ff-kvbjg"]
Jul 31 21:09:18.231919 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.231851    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:09:18.235078 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.234534    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cceca8ff-kvbjg"]
Jul 31 21:09:18.345342 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.345314    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"
Jul 31 21:09:18.376425 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.376399    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng"
Jul 31 21:09:18.539229 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.539189    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-openshift-service-ca\") pod \"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0\" (UID: \"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0\") "
Jul 31 21:09:18.539229 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.539240    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-maas-api-tls\") pod \"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0\" (UID: \"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0\") "
Jul 31 21:09:18.539503 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.539265    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9d2xm\" (UniqueName: \"kubernetes.io/projected/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-kube-api-access-9d2xm\") pod \"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0\" (UID: \"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0\") "
Jul 31 21:09:18.539503 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.539291    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b1dce34-8f91-4f2f-9128-7a10eb18aa0b-plugins-config-volume\") pod \"5b1dce34-8f91-4f2f-9128-7a10eb18aa0b\" (UID: \"5b1dce34-8f91-4f2f-9128-7a10eb18aa0b\") "
Jul 31 21:09:18.539503 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.539308    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkgqh\" (UniqueName: \"kubernetes.io/projected/5b1dce34-8f91-4f2f-9128-7a10eb18aa0b-kube-api-access-jkgqh\") pod \"5b1dce34-8f91-4f2f-9128-7a10eb18aa0b\" (UID: \"5b1dce34-8f91-4f2f-9128-7a10eb18aa0b\") "
Jul 31 21:09:18.539699 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.539661    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b1dce34-8f91-4f2f-9128-7a10eb18aa0b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5b1dce34-8f91-4f2f-9128-7a10eb18aa0b" (UID: "5b1dce34-8f91-4f2f-9128-7a10eb18aa0b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:09:18.539699 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.539667    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ffcaf6c3-6bf3-4ce3-8322-90d99c702de0" (UID: "ffcaf6c3-6bf3-4ce3-8322-90d99c702de0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:09:18.541650 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.541623    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-kube-api-access-9d2xm" (OuterVolumeSpecName: "kube-api-access-9d2xm") pod "ffcaf6c3-6bf3-4ce3-8322-90d99c702de0" (UID: "ffcaf6c3-6bf3-4ce3-8322-90d99c702de0"). InnerVolumeSpecName "kube-api-access-9d2xm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:09:18.541797 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.541649    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ffcaf6c3-6bf3-4ce3-8322-90d99c702de0" (UID: "ffcaf6c3-6bf3-4ce3-8322-90d99c702de0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:09:18.541797 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.541659    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b1dce34-8f91-4f2f-9128-7a10eb18aa0b-kube-api-access-jkgqh" (OuterVolumeSpecName: "kube-api-access-jkgqh") pod "5b1dce34-8f91-4f2f-9128-7a10eb18aa0b" (UID: "5b1dce34-8f91-4f2f-9128-7a10eb18aa0b"). InnerVolumeSpecName "kube-api-access-jkgqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:09:18.640211 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.640125    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-openshift-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:09:18.640211 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.640159    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-maas-api-tls\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:09:18.640211 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.640169    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d2xm\" (UniqueName: \"kubernetes.io/projected/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0-kube-api-access-9d2xm\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:09:18.640211 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.640178    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b1dce34-8f91-4f2f-9128-7a10eb18aa0b-plugins-config-volume\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:09:18.640211 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.640187    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkgqh\" (UniqueName: \"kubernetes.io/projected/5b1dce34-8f91-4f2f-9128-7a10eb18aa0b-kube-api-access-jkgqh\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:09:18.955843 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.955812    2565 generic.go:356] "Generic (PLEG): container finished" podID="5b1dce34-8f91-4f2f-9128-7a10eb18aa0b" containerID="7b8c4e48b3590f51cb758ae8cb370d441598ab5f4e9da612a54f5ea394d5e143" exitCode=0
Jul 31 21:09:18.955998 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.955858    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng"
Jul 31 21:09:18.955998 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.955900    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng" event={"ID":"5b1dce34-8f91-4f2f-9128-7a10eb18aa0b","Type":"ContainerDied","Data":"7b8c4e48b3590f51cb758ae8cb370d441598ab5f4e9da612a54f5ea394d5e143"}
Jul 31 21:09:18.955998 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.955951    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng" event={"ID":"5b1dce34-8f91-4f2f-9128-7a10eb18aa0b","Type":"ContainerDied","Data":"cc74ad9e1e95c8aedb70e664f65db76cc4b250133d92ba91e45bff586a740338"}
Jul 31 21:09:18.955998 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.955987    2565 scope.go:117] "RemoveContainer" containerID="7b8c4e48b3590f51cb758ae8cb370d441598ab5f4e9da612a54f5ea394d5e143"
Jul 31 21:09:18.957270 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.957237    2565 generic.go:356] "Generic (PLEG): container finished" podID="ffcaf6c3-6bf3-4ce3-8322-90d99c702de0" containerID="e091adf22d25221a5ba14285da5e6002eb0e7257b83ef296835e10a4114a2e9f" exitCode=0
Jul 31 21:09:18.957407 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.957301    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"
Jul 31 21:09:18.957407 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.957338    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8" event={"ID":"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0","Type":"ContainerDied","Data":"e091adf22d25221a5ba14285da5e6002eb0e7257b83ef296835e10a4114a2e9f"}
Jul 31 21:09:18.957407 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.957378    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8" event={"ID":"ffcaf6c3-6bf3-4ce3-8322-90d99c702de0","Type":"ContainerDied","Data":"5c412b3998f28f8aa8765ece713f977d9820da1bac59889f66c714f141b3343d"}
Jul 31 21:09:18.965260 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.965243    2565 scope.go:117] "RemoveContainer" containerID="7b8c4e48b3590f51cb758ae8cb370d441598ab5f4e9da612a54f5ea394d5e143"
Jul 31 21:09:18.965580 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:09:18.965543    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b8c4e48b3590f51cb758ae8cb370d441598ab5f4e9da612a54f5ea394d5e143\": container with ID starting with 7b8c4e48b3590f51cb758ae8cb370d441598ab5f4e9da612a54f5ea394d5e143 not found: ID does not exist" containerID="7b8c4e48b3590f51cb758ae8cb370d441598ab5f4e9da612a54f5ea394d5e143"
Jul 31 21:09:18.965725 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.965580    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b8c4e48b3590f51cb758ae8cb370d441598ab5f4e9da612a54f5ea394d5e143"} err="failed to get container status \"7b8c4e48b3590f51cb758ae8cb370d441598ab5f4e9da612a54f5ea394d5e143\": rpc error: code = NotFound desc = could not find container \"7b8c4e48b3590f51cb758ae8cb370d441598ab5f4e9da612a54f5ea394d5e143\": container with ID starting with 7b8c4e48b3590f51cb758ae8cb370d441598ab5f4e9da612a54f5ea394d5e143 not found: ID does not exist"
Jul 31 21:09:18.965725 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.965603    2565 scope.go:117] "RemoveContainer" containerID="e091adf22d25221a5ba14285da5e6002eb0e7257b83ef296835e10a4114a2e9f"
Jul 31 21:09:18.974712 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.974696    2565 scope.go:117] "RemoveContainer" containerID="e091adf22d25221a5ba14285da5e6002eb0e7257b83ef296835e10a4114a2e9f"
Jul 31 21:09:18.975000 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:09:18.974979    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e091adf22d25221a5ba14285da5e6002eb0e7257b83ef296835e10a4114a2e9f\": container with ID starting with e091adf22d25221a5ba14285da5e6002eb0e7257b83ef296835e10a4114a2e9f not found: ID does not exist" containerID="e091adf22d25221a5ba14285da5e6002eb0e7257b83ef296835e10a4114a2e9f"
Jul 31 21:09:18.975057 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.975008    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e091adf22d25221a5ba14285da5e6002eb0e7257b83ef296835e10a4114a2e9f"} err="failed to get container status \"e091adf22d25221a5ba14285da5e6002eb0e7257b83ef296835e10a4114a2e9f\": rpc error: code = NotFound desc = could not find container \"e091adf22d25221a5ba14285da5e6002eb0e7257b83ef296835e10a4114a2e9f\": container with ID starting with e091adf22d25221a5ba14285da5e6002eb0e7257b83ef296835e10a4114a2e9f not found: ID does not exist"
Jul 31 21:09:18.982284 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.982264    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"]
Jul 31 21:09:18.986926 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.986894    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cceca8ff-69f58f7b97-lgrs8"]
Jul 31 21:09:18.997512 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:18.997491    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng"]
Jul 31 21:09:19.001959 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:19.001938    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-cceca8ff-84985c65d6-n8kng"]
Jul 31 21:09:19.915373 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:19.915343    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b1dce34-8f91-4f2f-9128-7a10eb18aa0b" path="/var/lib/kubelet/pods/5b1dce34-8f91-4f2f-9128-7a10eb18aa0b/volumes"
Jul 31 21:09:19.915764 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:19.915673    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3ead03c-43b7-4f1d-b9cc-4af91b648d8d" path="/var/lib/kubelet/pods/c3ead03c-43b7-4f1d-b9cc-4af91b648d8d/volumes"
Jul 31 21:09:19.916032 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:19.916019    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffcaf6c3-6bf3-4ce3-8322-90d99c702de0" path="/var/lib/kubelet/pods/ffcaf6c3-6bf3-4ce3-8322-90d99c702de0/volumes"
Jul 31 21:09:21.498825 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:21.498783    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:09:21.743898 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:21.743862    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:09:21.839707 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:21.839628    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:09:26.673131 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:26.673099    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:09:52.051591 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:52.051566    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 21:09:52.056353 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:52.056330    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 21:09:52.061435 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:52.061417    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 21:09:52.066010 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:09:52.065982    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 21:10:02.790284 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:02.790253    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:04.210700 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:04.210647    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:09.043694 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:09.043662    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:09.144110 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:09.144065    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:09.307458 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:09.307368    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:09.537668 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:09.537629    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:20.863788 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:20.863710    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:20.957132 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:20.957092    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:21.056702 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:21.056666    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:21.663856 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:21.663815    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:21.760471 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:21.760438    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:21.859672 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:21.859641    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:23.131705 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:23.131663    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:29.388123 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:29.388090    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:29.454975 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:29.454944    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:30.133852 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:30.133821    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:36.242855 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:36.242804    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:36.342256 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:36.342223    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:36.438092 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:36.438059    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:46.999985 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:46.999949    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:10:47.199808 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:10:47.199774    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:08.175563 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:08.175520    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:14.223088 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:14.223056    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:14.326201 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:14.326162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:14.574581 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:14.574500    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:14.861947 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:14.861865    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:15.838293 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:15.838252    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:17.604355 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:17.604316    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:17.702508 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:17.702472    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:18.804119 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:18.804089    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"]
Jul 31 21:11:18.804627 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:18.804510    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b1dce34-8f91-4f2f-9128-7a10eb18aa0b" containerName="payload-processing"
Jul 31 21:11:18.804627 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:18.804530    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b1dce34-8f91-4f2f-9128-7a10eb18aa0b" containerName="payload-processing"
Jul 31 21:11:18.804627 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:18.804542    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffcaf6c3-6bf3-4ce3-8322-90d99c702de0" containerName="maas-api"
Jul 31 21:11:18.804627 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:18.804550    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffcaf6c3-6bf3-4ce3-8322-90d99c702de0" containerName="maas-api"
Jul 31 21:11:18.804627 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:18.804563    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3ead03c-43b7-4f1d-b9cc-4af91b648d8d" containerName="revoke-keys"
Jul 31 21:11:18.804627 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:18.804568    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3ead03c-43b7-4f1d-b9cc-4af91b648d8d" containerName="revoke-keys"
Jul 31 21:11:18.804627 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:18.804632    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffcaf6c3-6bf3-4ce3-8322-90d99c702de0" containerName="maas-api"
Jul 31 21:11:18.805060 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:18.804640    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b1dce34-8f91-4f2f-9128-7a10eb18aa0b" containerName="payload-processing"
Jul 31 21:11:18.805060 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:18.804649    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3ead03c-43b7-4f1d-b9cc-4af91b648d8d" containerName="revoke-keys"
Jul 31 21:11:18.807713 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:18.807691    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"
Jul 31 21:11:18.810831 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:18.810805    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-ecdb81-serving-cert\""
Jul 31 21:11:18.829498 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:18.829467    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"]
Jul 31 21:11:18.887793 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:18.887757    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:18.908131 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:18.908102    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c676572d-af92-4744-9141-605be0491b97-maas-api-tls\") pod \"maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf\" (UID: \"c676572d-af92-4744-9141-605be0491b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"
Jul 31 21:11:18.908131 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:18.908141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c676572d-af92-4744-9141-605be0491b97-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf\" (UID: \"c676572d-af92-4744-9141-605be0491b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"
Jul 31 21:11:18.908366 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:18.908170    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkj6p\" (UniqueName: \"kubernetes.io/projected/c676572d-af92-4744-9141-605be0491b97-kube-api-access-kkj6p\") pod \"maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf\" (UID: \"c676572d-af92-4744-9141-605be0491b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"
Jul 31 21:11:19.009432 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.009398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c676572d-af92-4744-9141-605be0491b97-maas-api-tls\") pod \"maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf\" (UID: \"c676572d-af92-4744-9141-605be0491b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"
Jul 31 21:11:19.009634 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.009437    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c676572d-af92-4744-9141-605be0491b97-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf\" (UID: \"c676572d-af92-4744-9141-605be0491b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"
Jul 31 21:11:19.009634 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.009467    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkj6p\" (UniqueName: \"kubernetes.io/projected/c676572d-af92-4744-9141-605be0491b97-kube-api-access-kkj6p\") pod \"maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf\" (UID: \"c676572d-af92-4744-9141-605be0491b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"
Jul 31 21:11:19.009634 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:11:19.009560    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-serving-cert: secret "maas-api-e2e-inf-a-ecdb81-serving-cert" not found
Jul 31 21:11:19.009634 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:11:19.009634    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c676572d-af92-4744-9141-605be0491b97-maas-api-tls podName:c676572d-af92-4744-9141-605be0491b97 nodeName:}" failed. No retries permitted until 2026-07-31 21:11:19.509614501 +0000 UTC m=+2488.114908844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c676572d-af92-4744-9141-605be0491b97-maas-api-tls") pod "maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf" (UID: "c676572d-af92-4744-9141-605be0491b97") : secret "maas-api-e2e-inf-a-ecdb81-serving-cert" not found
Jul 31 21:11:19.010174 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.010149    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c676572d-af92-4744-9141-605be0491b97-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf\" (UID: \"c676572d-af92-4744-9141-605be0491b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"
Jul 31 21:11:19.028386 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.028355    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkj6p\" (UniqueName: \"kubernetes.io/projected/c676572d-af92-4744-9141-605be0491b97-kube-api-access-kkj6p\") pod \"maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf\" (UID: \"c676572d-af92-4744-9141-605be0491b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"
Jul 31 21:11:19.270777 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.270727    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:19.383649 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.383608    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:19.480526 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.480493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:19.514271 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.514233    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c676572d-af92-4744-9141-605be0491b97-maas-api-tls\") pod \"maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf\" (UID: \"c676572d-af92-4744-9141-605be0491b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"
Jul 31 21:11:19.516804 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.516778    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c676572d-af92-4744-9141-605be0491b97-maas-api-tls\") pod \"maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf\" (UID: \"c676572d-af92-4744-9141-605be0491b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"
Jul 31 21:11:19.554113 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.554040    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm"]
Jul 31 21:11:19.557501 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.557484    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm"
Jul 31 21:11:19.559373 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.559347    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-ecdb81\""
Jul 31 21:11:19.559503 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.559400    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-ecdb81-dockercfg-x2xvn\""
Jul 31 21:11:19.565417 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.565395    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm"]
Jul 31 21:11:19.615702 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.615659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx54c\" (UniqueName: \"kubernetes.io/projected/b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54-kube-api-access-hx54c\") pod \"payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm\" (UID: \"b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm"
Jul 31 21:11:19.615899 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.615860    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm\" (UID: \"b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm"
Jul 31 21:11:19.717324 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.717282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm\" (UID: \"b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm"
Jul 31 21:11:19.717521 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.717387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx54c\" (UniqueName: \"kubernetes.io/projected/b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54-kube-api-access-hx54c\") pod \"payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm\" (UID: \"b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm"
Jul 31 21:11:19.718035 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.718015    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm\" (UID: \"b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm"
Jul 31 21:11:19.718123 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.718106    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"
Jul 31 21:11:19.725229 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.725206    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx54c\" (UniqueName: \"kubernetes.io/projected/b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54-kube-api-access-hx54c\") pod \"payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm\" (UID: \"b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm"
Jul 31 21:11:19.860416 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.860372    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"]
Jul 31 21:11:19.866697 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:11:19.866040    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc676572d_af92_4744_9141_605be0491b97.slice/crio-76021fa550a999e1ac339deea62b0fbc49ff77e821a49c8adefc17e1167a6f7d WatchSource:0}: Error finding container 76021fa550a999e1ac339deea62b0fbc49ff77e821a49c8adefc17e1167a6f7d: Status 404 returned error can't find the container with id 76021fa550a999e1ac339deea62b0fbc49ff77e821a49c8adefc17e1167a6f7d
Jul 31 21:11:19.870172 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:19.870149    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm"
Jul 31 21:11:20.016855 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:20.016825    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm"]
Jul 31 21:11:20.017804 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:11:20.017776    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f5a9c1_1a25_404e_a2c7_6f4aa5a85f54.slice/crio-744caecdab0c5900f4bb04de03f0d85cc68e111ed4b27b7b7a9f5547ad022fcb WatchSource:0}: Error finding container 744caecdab0c5900f4bb04de03f0d85cc68e111ed4b27b7b7a9f5547ad022fcb: Status 404 returned error can't find the container with id 744caecdab0c5900f4bb04de03f0d85cc68e111ed4b27b7b7a9f5547ad022fcb
Jul 31 21:11:20.589496 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:20.589459    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm" event={"ID":"b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54","Type":"ContainerStarted","Data":"9931e3df79eb93a957c7de4b6dd0acd76222832a1357ab1b8a8d90db418075aa"}
Jul 31 21:11:20.589646 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:20.589520    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm" event={"ID":"b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54","Type":"ContainerStarted","Data":"744caecdab0c5900f4bb04de03f0d85cc68e111ed4b27b7b7a9f5547ad022fcb"}
Jul 31 21:11:20.589720 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:20.589651    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm"
Jul 31 21:11:20.591253 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:20.591230    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf" event={"ID":"c676572d-af92-4744-9141-605be0491b97","Type":"ContainerStarted","Data":"bac3d9b5b5fd7e1c6d3494e3781632edc4487ba83906fcb3069104a99c69e21d"}
Jul 31 21:11:20.591359 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:20.591265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf" event={"ID":"c676572d-af92-4744-9141-605be0491b97","Type":"ContainerStarted","Data":"76021fa550a999e1ac339deea62b0fbc49ff77e821a49c8adefc17e1167a6f7d"}
Jul 31 21:11:20.591396 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:20.591380    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"
Jul 31 21:11:20.605130 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:20.605086    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm" podStartSLOduration=1.605050881 podStartE2EDuration="1.605050881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:11:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:11:20.603125392 +0000 UTC m=+2489.208419758" watchObservedRunningTime="2026-07-31 21:11:20.605050881 +0000 UTC m=+2489.210345296"
Jul 31 21:11:20.618849 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:20.618807    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf" podStartSLOduration=2.031559379 podStartE2EDuration="2.618794561s" totalImagesPullingTime="587.235182ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:11:20.617503372 +0000 UTC m=+2489.222797736" watchObservedRunningTime="2026-07-31 21:11:20.618794561 +0000 UTC m=+2489.224088926"
Jul 31 21:11:26.601687 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:26.601658    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"
Jul 31 21:11:31.598816 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:31.598783    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm"
Jul 31 21:11:42.615338 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:42.615300    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:42.959633 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:42.959603    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:43.266858 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:43.266776    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:43.408480 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:43.408437    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:45.719871 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:45.719835    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:45.818203 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:45.818167    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:46.812857 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:46.812822    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"]
Jul 31 21:11:46.817269 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:46.817242    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"
Jul 31 21:11:46.819424 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:46.819398    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-c8d2ed-serving-cert\""
Jul 31 21:11:46.825380 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:46.825355    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"]
Jul 31 21:11:46.854477 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:46.854446    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:46.855778 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:46.855711    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fssmn\" (UniqueName: \"kubernetes.io/projected/527f71a5-3d1a-4b04-b894-d1ca7c024572-kube-api-access-fssmn\") pod \"maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw\" (UID: \"527f71a5-3d1a-4b04-b894-d1ca7c024572\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"
Jul 31 21:11:46.855910 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:46.855793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527f71a5-3d1a-4b04-b894-d1ca7c024572-maas-api-tls\") pod \"maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw\" (UID: \"527f71a5-3d1a-4b04-b894-d1ca7c024572\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"
Jul 31 21:11:46.855910 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:46.855888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527f71a5-3d1a-4b04-b894-d1ca7c024572-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw\" (UID: \"527f71a5-3d1a-4b04-b894-d1ca7c024572\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"
Jul 31 21:11:46.957006 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:46.956973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527f71a5-3d1a-4b04-b894-d1ca7c024572-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw\" (UID: \"527f71a5-3d1a-4b04-b894-d1ca7c024572\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"
Jul 31 21:11:46.957200 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:46.957038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fssmn\" (UniqueName: \"kubernetes.io/projected/527f71a5-3d1a-4b04-b894-d1ca7c024572-kube-api-access-fssmn\") pod \"maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw\" (UID: \"527f71a5-3d1a-4b04-b894-d1ca7c024572\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"
Jul 31 21:11:46.957200 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:46.957063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527f71a5-3d1a-4b04-b894-d1ca7c024572-maas-api-tls\") pod \"maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw\" (UID: \"527f71a5-3d1a-4b04-b894-d1ca7c024572\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"
Jul 31 21:11:46.957851 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:46.957821    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527f71a5-3d1a-4b04-b894-d1ca7c024572-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw\" (UID: \"527f71a5-3d1a-4b04-b894-d1ca7c024572\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"
Jul 31 21:11:46.958265 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:46.958240    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:46.959804 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:46.959784    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527f71a5-3d1a-4b04-b894-d1ca7c024572-maas-api-tls\") pod \"maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw\" (UID: \"527f71a5-3d1a-4b04-b894-d1ca7c024572\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"
Jul 31 21:11:46.966118 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:46.966099    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fssmn\" (UniqueName: \"kubernetes.io/projected/527f71a5-3d1a-4b04-b894-d1ca7c024572-kube-api-access-fssmn\") pod \"maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw\" (UID: \"527f71a5-3d1a-4b04-b894-d1ca7c024572\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"
Jul 31 21:11:47.131772 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.131662    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"
Jul 31 21:11:47.272334 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.272308    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"]
Jul 31 21:11:47.274214 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:11:47.274191    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527f71a5_3d1a_4b04_b894_d1ca7c024572.slice/crio-6b1fe243c0a689363e86a6ccb1ed0bfdd0b3c290ea3bb5aac6f21dee0a264330 WatchSource:0}: Error finding container 6b1fe243c0a689363e86a6ccb1ed0bfdd0b3c290ea3bb5aac6f21dee0a264330: Status 404 returned error can't find the container with id 6b1fe243c0a689363e86a6ccb1ed0bfdd0b3c290ea3bb5aac6f21dee0a264330
Jul 31 21:11:47.393457 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.393382    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:47.488285 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.488252    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:47.520911 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.520875    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k"]
Jul 31 21:11:47.525596 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.525578    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k"
Jul 31 21:11:47.527648 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.527628    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-c8d2ed\""
Jul 31 21:11:47.527787 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.527675    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-c8d2ed-dockercfg-cr8mb\""
Jul 31 21:11:47.535714 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.535690    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k"]
Jul 31 21:11:47.561246 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.561217    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl4w5\" (UniqueName: \"kubernetes.io/projected/9ac9baac-ceb1-43e3-ba0f-b616983a1ff3-kube-api-access-gl4w5\") pod \"payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k\" (UID: \"9ac9baac-ceb1-43e3-ba0f-b616983a1ff3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k"
Jul 31 21:11:47.561402 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.561280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ac9baac-ceb1-43e3-ba0f-b616983a1ff3-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k\" (UID: \"9ac9baac-ceb1-43e3-ba0f-b616983a1ff3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k"
Jul 31 21:11:47.662067 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.662041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl4w5\" (UniqueName: \"kubernetes.io/projected/9ac9baac-ceb1-43e3-ba0f-b616983a1ff3-kube-api-access-gl4w5\") pod \"payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k\" (UID: \"9ac9baac-ceb1-43e3-ba0f-b616983a1ff3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k"
Jul 31 21:11:47.662218 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.662097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ac9baac-ceb1-43e3-ba0f-b616983a1ff3-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k\" (UID: \"9ac9baac-ceb1-43e3-ba0f-b616983a1ff3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k"
Jul 31 21:11:47.662772 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.662722    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ac9baac-ceb1-43e3-ba0f-b616983a1ff3-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k\" (UID: \"9ac9baac-ceb1-43e3-ba0f-b616983a1ff3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k"
Jul 31 21:11:47.674955 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.674933    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl4w5\" (UniqueName: \"kubernetes.io/projected/9ac9baac-ceb1-43e3-ba0f-b616983a1ff3-kube-api-access-gl4w5\") pod \"payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k\" (UID: \"9ac9baac-ceb1-43e3-ba0f-b616983a1ff3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k"
Jul 31 21:11:47.740046 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.740014    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw" event={"ID":"527f71a5-3d1a-4b04-b894-d1ca7c024572","Type":"ContainerStarted","Data":"58ace0c2762027adce9b9158f80c5647b50cc7c14a9efaa095d1595d22b936d2"}
Jul 31 21:11:47.740241 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.740068    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw" event={"ID":"527f71a5-3d1a-4b04-b894-d1ca7c024572","Type":"ContainerStarted","Data":"6b1fe243c0a689363e86a6ccb1ed0bfdd0b3c290ea3bb5aac6f21dee0a264330"}
Jul 31 21:11:47.740241 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.740110    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"
Jul 31 21:11:47.756781 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.756708    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw" podStartSLOduration=1.453911085 podStartE2EDuration="1.756691773s" totalImagesPullingTime="302.780688ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:11:47.754790916 +0000 UTC m=+2516.360085282" watchObservedRunningTime="2026-07-31 21:11:47.756691773 +0000 UTC m=+2516.361986135"
Jul 31 21:11:47.838061 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.838026    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k"
Jul 31 21:11:47.981615 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:47.981587    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k"]
Jul 31 21:11:47.983239 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:11:47.983212    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac9baac_ceb1_43e3_ba0f_b616983a1ff3.slice/crio-77574f0e1c699acb0ee1142c43698a6a4d3d387cedf15b753f474a546209f93b WatchSource:0}: Error finding container 77574f0e1c699acb0ee1142c43698a6a4d3d387cedf15b753f474a546209f93b: Status 404 returned error can't find the container with id 77574f0e1c699acb0ee1142c43698a6a4d3d387cedf15b753f474a546209f93b
Jul 31 21:11:48.747518 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:48.747478    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k" event={"ID":"9ac9baac-ceb1-43e3-ba0f-b616983a1ff3","Type":"ContainerStarted","Data":"33270b3f97dbac7b2ec82ef06770c349818189c9a21b9fe519a294835bae8b5f"}
Jul 31 21:11:48.747727 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:48.747536    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k" event={"ID":"9ac9baac-ceb1-43e3-ba0f-b616983a1ff3","Type":"ContainerStarted","Data":"77574f0e1c699acb0ee1142c43698a6a4d3d387cedf15b753f474a546209f93b"}
Jul 31 21:11:48.747818 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:48.747780    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k"
Jul 31 21:11:48.763517 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:48.763462    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k" podStartSLOduration=1.763447293 podStartE2EDuration="1.763447293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:11:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:11:48.760861405 +0000 UTC m=+2517.366155763" watchObservedRunningTime="2026-07-31 21:11:48.763447293 +0000 UTC m=+2517.368741656"
Jul 31 21:11:50.589351 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:50.589286    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:50.646388 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:50.646353    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:11:52.196252 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:52.196220    2565 scope.go:117] "RemoveContainer" containerID="38939bed1dc8ea646e8b2a1f4e592633439203340951d015fd9180b620b63511"
Jul 31 21:11:53.755264 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:53.755226    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"
Jul 31 21:11:59.756533 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:11:59.756499    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k"
Jul 31 21:12:10.724387 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:12:10.724333    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:12:36.417863 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:12:36.417819    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:13:07.407834 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:07.407803    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:13:51.047520 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:51.047485    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:13:52.032227 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:52.032180    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:13:52.125813 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:52.125779    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ecdb81-xpfrc"]
Jul 31 21:13:52.128687 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:52.128669    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ecdb81-xpfrc"
Jul 31 21:13:52.131029 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:52.131001    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 21:13:52.134748 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:52.134704    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ecdb81-xpfrc"]
Jul 31 21:13:52.309896 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:52.309803    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2602e1ac-4403-480e-aacd-9815cb1c0c2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-ecdb81-xpfrc\" (UID: \"2602e1ac-4403-480e-aacd-9815cb1c0c2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ecdb81-xpfrc"
Jul 31 21:13:52.410811 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:52.410777    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2602e1ac-4403-480e-aacd-9815cb1c0c2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-ecdb81-xpfrc\" (UID: \"2602e1ac-4403-480e-aacd-9815cb1c0c2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ecdb81-xpfrc"
Jul 31 21:13:52.411398 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:52.411377    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2602e1ac-4403-480e-aacd-9815cb1c0c2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-ecdb81-xpfrc\" (UID: \"2602e1ac-4403-480e-aacd-9815cb1c0c2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ecdb81-xpfrc"
Jul 31 21:13:52.443418 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:52.443371    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ecdb81-xpfrc"
Jul 31 21:13:52.584720 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:52.584518    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ecdb81-xpfrc"]
Jul 31 21:13:52.587541 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:13:52.587499    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2602e1ac_4403_480e_aacd_9815cb1c0c2e.slice/crio-0586fcafd3c9bc876733862491148d882c4fb48dd4d7a9c0f4f7e5766ac99304 WatchSource:0}: Error finding container 0586fcafd3c9bc876733862491148d882c4fb48dd4d7a9c0f4f7e5766ac99304: Status 404 returned error can't find the container with id 0586fcafd3c9bc876733862491148d882c4fb48dd4d7a9c0f4f7e5766ac99304
Jul 31 21:13:53.416790 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:53.416749    2565 generic.go:356] "Generic (PLEG): container finished" podID="2602e1ac-4403-480e-aacd-9815cb1c0c2e" containerID="ceed7578f8d9ec75f99f84e79b97c3e53e27a0f86c31b0222e76ff34a1967d3f" exitCode=0
Jul 31 21:13:53.417220 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:53.416785    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ecdb81-xpfrc" event={"ID":"2602e1ac-4403-480e-aacd-9815cb1c0c2e","Type":"ContainerDied","Data":"ceed7578f8d9ec75f99f84e79b97c3e53e27a0f86c31b0222e76ff34a1967d3f"}
Jul 31 21:13:53.417220 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:53.416879    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ecdb81-xpfrc" event={"ID":"2602e1ac-4403-480e-aacd-9815cb1c0c2e","Type":"ContainerStarted","Data":"0586fcafd3c9bc876733862491148d882c4fb48dd4d7a9c0f4f7e5766ac99304"}
Jul 31 21:13:54.574999 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:54.574972    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ecdb81-xpfrc"
Jul 31 21:13:54.735179 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:54.735147    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2602e1ac-4403-480e-aacd-9815cb1c0c2e-maas-api-service-ca\") pod \"2602e1ac-4403-480e-aacd-9815cb1c0c2e\" (UID: \"2602e1ac-4403-480e-aacd-9815cb1c0c2e\") "
Jul 31 21:13:54.735564 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:54.735538    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2602e1ac-4403-480e-aacd-9815cb1c0c2e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2602e1ac-4403-480e-aacd-9815cb1c0c2e" (UID: "2602e1ac-4403-480e-aacd-9815cb1c0c2e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:13:54.836611 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:54.836574    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2602e1ac-4403-480e-aacd-9815cb1c0c2e-maas-api-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:13:55.429347 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:55.429310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ecdb81-xpfrc" event={"ID":"2602e1ac-4403-480e-aacd-9815cb1c0c2e","Type":"ContainerDied","Data":"0586fcafd3c9bc876733862491148d882c4fb48dd4d7a9c0f4f7e5766ac99304"}
Jul 31 21:13:55.429552 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:55.429368    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0586fcafd3c9bc876733862491148d882c4fb48dd4d7a9c0f4f7e5766ac99304"
Jul 31 21:13:55.429552 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:55.429330    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ecdb81-xpfrc"
Jul 31 21:13:56.159081 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.159048    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"]
Jul 31 21:13:56.159533 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.159261    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf" podUID="c676572d-af92-4744-9141-605be0491b97" containerName="maas-api" containerID="cri-o://bac3d9b5b5fd7e1c6d3494e3781632edc4487ba83906fcb3069104a99c69e21d" gracePeriod=30
Jul 31 21:13:56.192404 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.192365    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:13:56.238366 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.238323    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm"]
Jul 31 21:13:56.238566 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.238531    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm" podUID="b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54" containerName="payload-pre-processing" containerID="cri-o://9931e3df79eb93a957c7de4b6dd0acd76222832a1357ab1b8a8d90db418075aa" gracePeriod=30
Jul 31 21:13:56.291450 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.291421    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:13:56.392011 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.391618    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:13:56.407151 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.407078    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ecdb81-xpfrc"]
Jul 31 21:13:56.410695 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.410612    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ecdb81-xpfrc"]
Jul 31 21:13:56.441301 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.441250    2565 generic.go:356] "Generic (PLEG): container finished" podID="b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54" containerID="9931e3df79eb93a957c7de4b6dd0acd76222832a1357ab1b8a8d90db418075aa" exitCode=0
Jul 31 21:13:56.441475 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.441318    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm" event={"ID":"b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54","Type":"ContainerDied","Data":"9931e3df79eb93a957c7de4b6dd0acd76222832a1357ab1b8a8d90db418075aa"}
Jul 31 21:13:56.443066 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.443035    2565 generic.go:356] "Generic (PLEG): container finished" podID="c676572d-af92-4744-9141-605be0491b97" containerID="bac3d9b5b5fd7e1c6d3494e3781632edc4487ba83906fcb3069104a99c69e21d" exitCode=0
Jul 31 21:13:56.443066 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.443063    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf" event={"ID":"c676572d-af92-4744-9141-605be0491b97","Type":"ContainerDied","Data":"bac3d9b5b5fd7e1c6d3494e3781632edc4487ba83906fcb3069104a99c69e21d"}
Jul 31 21:13:56.460023 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.459995    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:13:56.496487 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.496461    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"
Jul 31 21:13:56.532127 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.532104    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm"
Jul 31 21:13:56.550139 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.550106    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx54c\" (UniqueName: \"kubernetes.io/projected/b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54-kube-api-access-hx54c\") pod \"b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54\" (UID: \"b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54\") "
Jul 31 21:13:56.550343 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.550171    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c676572d-af92-4744-9141-605be0491b97-maas-api-tls\") pod \"c676572d-af92-4744-9141-605be0491b97\" (UID: \"c676572d-af92-4744-9141-605be0491b97\") "
Jul 31 21:13:56.550343 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.550248    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkj6p\" (UniqueName: \"kubernetes.io/projected/c676572d-af92-4744-9141-605be0491b97-kube-api-access-kkj6p\") pod \"c676572d-af92-4744-9141-605be0491b97\" (UID: \"c676572d-af92-4744-9141-605be0491b97\") "
Jul 31 21:13:56.550343 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.550276    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54-plugins-config-volume\") pod \"b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54\" (UID: \"b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54\") "
Jul 31 21:13:56.550343 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.550325    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c676572d-af92-4744-9141-605be0491b97-openshift-service-ca\") pod \"c676572d-af92-4744-9141-605be0491b97\" (UID: \"c676572d-af92-4744-9141-605be0491b97\") "
Jul 31 21:13:56.550908 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.550841    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c676572d-af92-4744-9141-605be0491b97-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c676572d-af92-4744-9141-605be0491b97" (UID: "c676572d-af92-4744-9141-605be0491b97"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:13:56.550908 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.550844    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54" (UID: "b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:13:56.553284 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.553242    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c676572d-af92-4744-9141-605be0491b97-kube-api-access-kkj6p" (OuterVolumeSpecName: "kube-api-access-kkj6p") pod "c676572d-af92-4744-9141-605be0491b97" (UID: "c676572d-af92-4744-9141-605be0491b97"). InnerVolumeSpecName "kube-api-access-kkj6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:13:56.553396 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.553293    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54-kube-api-access-hx54c" (OuterVolumeSpecName: "kube-api-access-hx54c") pod "b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54" (UID: "b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54"). InnerVolumeSpecName "kube-api-access-hx54c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:13:56.553579 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.553555    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c676572d-af92-4744-9141-605be0491b97-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c676572d-af92-4744-9141-605be0491b97" (UID: "c676572d-af92-4744-9141-605be0491b97"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:13:56.651283 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.651244    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx54c\" (UniqueName: \"kubernetes.io/projected/b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54-kube-api-access-hx54c\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:13:56.651283 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.651279    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c676572d-af92-4744-9141-605be0491b97-maas-api-tls\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:13:56.651283 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.651292    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkj6p\" (UniqueName: \"kubernetes.io/projected/c676572d-af92-4744-9141-605be0491b97-kube-api-access-kkj6p\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:13:56.651555 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.651304    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54-plugins-config-volume\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:13:56.651555 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.651318    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c676572d-af92-4744-9141-605be0491b97-openshift-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:13:56.757294 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:56.757259    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:13:57.450510 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:57.450477    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm"
Jul 31 21:13:57.450947 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:57.450479    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm" event={"ID":"b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54","Type":"ContainerDied","Data":"744caecdab0c5900f4bb04de03f0d85cc68e111ed4b27b7b7a9f5547ad022fcb"}
Jul 31 21:13:57.450947 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:57.450631    2565 scope.go:117] "RemoveContainer" containerID="9931e3df79eb93a957c7de4b6dd0acd76222832a1357ab1b8a8d90db418075aa"
Jul 31 21:13:57.452106 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:57.451918    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"
Jul 31 21:13:57.452106 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:57.451922    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf" event={"ID":"c676572d-af92-4744-9141-605be0491b97","Type":"ContainerDied","Data":"76021fa550a999e1ac339deea62b0fbc49ff77e821a49c8adefc17e1167a6f7d"}
Jul 31 21:13:57.460556 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:57.460536    2565 scope.go:117] "RemoveContainer" containerID="bac3d9b5b5fd7e1c6d3494e3781632edc4487ba83906fcb3069104a99c69e21d"
Jul 31 21:13:57.474607 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:57.474580    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"]
Jul 31 21:13:57.477460 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:57.477439    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ecdb81-69b95d7855-rwmzf"]
Jul 31 21:13:57.485770 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:57.485718    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm"]
Jul 31 21:13:57.498354 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:57.498321    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ecdb81-5d9f486968-zscrm"]
Jul 31 21:13:57.915601 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:57.915518    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2602e1ac-4403-480e-aacd-9815cb1c0c2e" path="/var/lib/kubelet/pods/2602e1ac-4403-480e-aacd-9815cb1c0c2e/volumes"
Jul 31 21:13:57.915907 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:57.915893    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54" path="/var/lib/kubelet/pods/b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54/volumes"
Jul 31 21:13:57.916232 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:13:57.916221    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c676572d-af92-4744-9141-605be0491b97" path="/var/lib/kubelet/pods/c676572d-af92-4744-9141-605be0491b97/volumes"
Jul 31 21:14:01.929326 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:01.929294    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:07.799383 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:07.799341    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:08.076392 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.076308    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:08.315712 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.315680    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:08.427097 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.427007    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8d2ed-tskg2"]
Jul 31 21:14:08.427560 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.427539    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54" containerName="payload-pre-processing"
Jul 31 21:14:08.427607 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.427566    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54" containerName="payload-pre-processing"
Jul 31 21:14:08.427607 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.427588    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2602e1ac-4403-480e-aacd-9815cb1c0c2e" containerName="revoke-keys"
Jul 31 21:14:08.427607 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.427596    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2602e1ac-4403-480e-aacd-9815cb1c0c2e" containerName="revoke-keys"
Jul 31 21:14:08.427697 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.427621    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c676572d-af92-4744-9141-605be0491b97" containerName="maas-api"
Jul 31 21:14:08.427697 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.427630    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c676572d-af92-4744-9141-605be0491b97" containerName="maas-api"
Jul 31 21:14:08.427798 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.427715    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2602e1ac-4403-480e-aacd-9815cb1c0c2e" containerName="revoke-keys"
Jul 31 21:14:08.427798 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.427727    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c676572d-af92-4744-9141-605be0491b97" containerName="maas-api"
Jul 31 21:14:08.427798 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.427755    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5f5a9c1-1a25-404e-a2c7-6f4aa5a85f54" containerName="payload-pre-processing"
Jul 31 21:14:08.431335 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.431311    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8d2ed-tskg2"
Jul 31 21:14:08.433332 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.433209    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 21:14:08.435080 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.435045    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8d2ed-tskg2"]
Jul 31 21:14:08.560595 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.560555    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c8d2ed-tskg2\" (UID: \"7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8d2ed-tskg2"
Jul 31 21:14:08.661914 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.661880    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c8d2ed-tskg2\" (UID: \"7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8d2ed-tskg2"
Jul 31 21:14:08.662529 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.662508    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c8d2ed-tskg2\" (UID: \"7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8d2ed-tskg2"
Jul 31 21:14:08.745570 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.745539    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8d2ed-tskg2"
Jul 31 21:14:08.889628 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:08.889598    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8d2ed-tskg2"]
Jul 31 21:14:08.892210 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:14:08.892184    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ffa7fc1_0e0a_4afe_9e6f_18dbfe4c4fa8.slice/crio-7616df1af4fa3ef1095845babaedb3d49d1df067bbb376790978551c9fee2308 WatchSource:0}: Error finding container 7616df1af4fa3ef1095845babaedb3d49d1df067bbb376790978551c9fee2308: Status 404 returned error can't find the container with id 7616df1af4fa3ef1095845babaedb3d49d1df067bbb376790978551c9fee2308
Jul 31 21:14:09.518856 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:09.518823    2565 generic.go:356] "Generic (PLEG): container finished" podID="7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8" containerID="9fe53e767fb3909c087dd4c6b709536e4fc3f0f93f08a0cb95e13702b1724b5d" exitCode=0
Jul 31 21:14:09.519043 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:09.518922    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8d2ed-tskg2" event={"ID":"7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8","Type":"ContainerDied","Data":"9fe53e767fb3909c087dd4c6b709536e4fc3f0f93f08a0cb95e13702b1724b5d"}
Jul 31 21:14:09.519043 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:09.518983    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8d2ed-tskg2" event={"ID":"7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8","Type":"ContainerStarted","Data":"7616df1af4fa3ef1095845babaedb3d49d1df067bbb376790978551c9fee2308"}
Jul 31 21:14:10.662369 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:10.662342    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8d2ed-tskg2"
Jul 31 21:14:10.778871 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:10.778787    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8-maas-api-service-ca\") pod \"7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8\" (UID: \"7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8\") "
Jul 31 21:14:10.779185 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:10.779161    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8" (UID: "7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:14:10.879942 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:10.879904    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8-maas-api-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:14:11.530500 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:11.530468    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8d2ed-tskg2" event={"ID":"7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8","Type":"ContainerDied","Data":"7616df1af4fa3ef1095845babaedb3d49d1df067bbb376790978551c9fee2308"}
Jul 31 21:14:11.530500 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:11.530486    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8d2ed-tskg2"
Jul 31 21:14:11.530776 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:11.530523    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7616df1af4fa3ef1095845babaedb3d49d1df067bbb376790978551c9fee2308"
Jul 31 21:14:18.809954 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:18.809917    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"]
Jul 31 21:14:18.810595 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:18.810163    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw" podUID="527f71a5-3d1a-4b04-b894-d1ca7c024572" containerName="maas-api" containerID="cri-o://58ace0c2762027adce9b9158f80c5647b50cc7c14a9efaa095d1595d22b936d2" gracePeriod=30
Jul 31 21:14:18.835926 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:18.835883    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:18.864554 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:18.864522    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k"]
Jul 31 21:14:18.864800 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:18.864774    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k" podUID="9ac9baac-ceb1-43e3-ba0f-b616983a1ff3" containerName="payload-processing" containerID="cri-o://33270b3f97dbac7b2ec82ef06770c349818189c9a21b9fe519a294835bae8b5f" gracePeriod=30
Jul 31 21:14:18.935600 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:18.935564    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:19.005614 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.005581    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8d2ed-tskg2"]
Jul 31 21:14:19.007003 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.006982    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:19.008050 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.008030    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c8d2ed-tskg2"]
Jul 31 21:14:19.064035 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.063934    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:19.119676 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.119651    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"
Jul 31 21:14:19.153507 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.153479    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k"
Jul 31 21:14:19.257932 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.257895    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527f71a5-3d1a-4b04-b894-d1ca7c024572-openshift-service-ca\") pod \"527f71a5-3d1a-4b04-b894-d1ca7c024572\" (UID: \"527f71a5-3d1a-4b04-b894-d1ca7c024572\") "
Jul 31 21:14:19.258125 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.257961    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527f71a5-3d1a-4b04-b894-d1ca7c024572-maas-api-tls\") pod \"527f71a5-3d1a-4b04-b894-d1ca7c024572\" (UID: \"527f71a5-3d1a-4b04-b894-d1ca7c024572\") "
Jul 31 21:14:19.258125 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.257995    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl4w5\" (UniqueName: \"kubernetes.io/projected/9ac9baac-ceb1-43e3-ba0f-b616983a1ff3-kube-api-access-gl4w5\") pod \"9ac9baac-ceb1-43e3-ba0f-b616983a1ff3\" (UID: \"9ac9baac-ceb1-43e3-ba0f-b616983a1ff3\") "
Jul 31 21:14:19.258125 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.258068    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fssmn\" (UniqueName: \"kubernetes.io/projected/527f71a5-3d1a-4b04-b894-d1ca7c024572-kube-api-access-fssmn\") pod \"527f71a5-3d1a-4b04-b894-d1ca7c024572\" (UID: \"527f71a5-3d1a-4b04-b894-d1ca7c024572\") "
Jul 31 21:14:19.258125 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.258107    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ac9baac-ceb1-43e3-ba0f-b616983a1ff3-plugins-config-volume\") pod \"9ac9baac-ceb1-43e3-ba0f-b616983a1ff3\" (UID: \"9ac9baac-ceb1-43e3-ba0f-b616983a1ff3\") "
Jul 31 21:14:19.258329 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.258260    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/527f71a5-3d1a-4b04-b894-d1ca7c024572-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "527f71a5-3d1a-4b04-b894-d1ca7c024572" (UID: "527f71a5-3d1a-4b04-b894-d1ca7c024572"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:14:19.258384 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.258373    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527f71a5-3d1a-4b04-b894-d1ca7c024572-openshift-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:14:19.258561 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.258532    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ac9baac-ceb1-43e3-ba0f-b616983a1ff3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9ac9baac-ceb1-43e3-ba0f-b616983a1ff3" (UID: "9ac9baac-ceb1-43e3-ba0f-b616983a1ff3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:14:19.260393 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.260373    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/527f71a5-3d1a-4b04-b894-d1ca7c024572-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "527f71a5-3d1a-4b04-b894-d1ca7c024572" (UID: "527f71a5-3d1a-4b04-b894-d1ca7c024572"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:14:19.260393 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.260377    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/527f71a5-3d1a-4b04-b894-d1ca7c024572-kube-api-access-fssmn" (OuterVolumeSpecName: "kube-api-access-fssmn") pod "527f71a5-3d1a-4b04-b894-d1ca7c024572" (UID: "527f71a5-3d1a-4b04-b894-d1ca7c024572"). InnerVolumeSpecName "kube-api-access-fssmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:14:19.260521 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.260386    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ac9baac-ceb1-43e3-ba0f-b616983a1ff3-kube-api-access-gl4w5" (OuterVolumeSpecName: "kube-api-access-gl4w5") pod "9ac9baac-ceb1-43e3-ba0f-b616983a1ff3" (UID: "9ac9baac-ceb1-43e3-ba0f-b616983a1ff3"). InnerVolumeSpecName "kube-api-access-gl4w5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:14:19.359393 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.359314    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fssmn\" (UniqueName: \"kubernetes.io/projected/527f71a5-3d1a-4b04-b894-d1ca7c024572-kube-api-access-fssmn\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:14:19.359393 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.359340    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ac9baac-ceb1-43e3-ba0f-b616983a1ff3-plugins-config-volume\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:14:19.359393 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.359374    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527f71a5-3d1a-4b04-b894-d1ca7c024572-maas-api-tls\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:14:19.359393 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.359382    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl4w5\" (UniqueName: \"kubernetes.io/projected/9ac9baac-ceb1-43e3-ba0f-b616983a1ff3-kube-api-access-gl4w5\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:14:19.399522 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.399495    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:19.573552 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.573511    2565 generic.go:356] "Generic (PLEG): container finished" podID="527f71a5-3d1a-4b04-b894-d1ca7c024572" containerID="58ace0c2762027adce9b9158f80c5647b50cc7c14a9efaa095d1595d22b936d2" exitCode=0
Jul 31 21:14:19.573728 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.573560    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"
Jul 31 21:14:19.573728 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.573611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw" event={"ID":"527f71a5-3d1a-4b04-b894-d1ca7c024572","Type":"ContainerDied","Data":"58ace0c2762027adce9b9158f80c5647b50cc7c14a9efaa095d1595d22b936d2"}
Jul 31 21:14:19.573728 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.573666    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw" event={"ID":"527f71a5-3d1a-4b04-b894-d1ca7c024572","Type":"ContainerDied","Data":"6b1fe243c0a689363e86a6ccb1ed0bfdd0b3c290ea3bb5aac6f21dee0a264330"}
Jul 31 21:14:19.573728 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.573697    2565 scope.go:117] "RemoveContainer" containerID="58ace0c2762027adce9b9158f80c5647b50cc7c14a9efaa095d1595d22b936d2"
Jul 31 21:14:19.575189 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.575158    2565 generic.go:356] "Generic (PLEG): container finished" podID="9ac9baac-ceb1-43e3-ba0f-b616983a1ff3" containerID="33270b3f97dbac7b2ec82ef06770c349818189c9a21b9fe519a294835bae8b5f" exitCode=0
Jul 31 21:14:19.575321 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.575193    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k" event={"ID":"9ac9baac-ceb1-43e3-ba0f-b616983a1ff3","Type":"ContainerDied","Data":"33270b3f97dbac7b2ec82ef06770c349818189c9a21b9fe519a294835bae8b5f"}
Jul 31 21:14:19.575321 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.575246    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k" event={"ID":"9ac9baac-ceb1-43e3-ba0f-b616983a1ff3","Type":"ContainerDied","Data":"77574f0e1c699acb0ee1142c43698a6a4d3d387cedf15b753f474a546209f93b"}
Jul 31 21:14:19.575321 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.575205    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k"
Jul 31 21:14:19.584984 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.584857    2565 scope.go:117] "RemoveContainer" containerID="58ace0c2762027adce9b9158f80c5647b50cc7c14a9efaa095d1595d22b936d2"
Jul 31 21:14:19.586642 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:14:19.586617    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58ace0c2762027adce9b9158f80c5647b50cc7c14a9efaa095d1595d22b936d2\": container with ID starting with 58ace0c2762027adce9b9158f80c5647b50cc7c14a9efaa095d1595d22b936d2 not found: ID does not exist" containerID="58ace0c2762027adce9b9158f80c5647b50cc7c14a9efaa095d1595d22b936d2"
Jul 31 21:14:19.586778 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.586650    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58ace0c2762027adce9b9158f80c5647b50cc7c14a9efaa095d1595d22b936d2"} err="failed to get container status \"58ace0c2762027adce9b9158f80c5647b50cc7c14a9efaa095d1595d22b936d2\": rpc error: code = NotFound desc = could not find container \"58ace0c2762027adce9b9158f80c5647b50cc7c14a9efaa095d1595d22b936d2\": container with ID starting with 58ace0c2762027adce9b9158f80c5647b50cc7c14a9efaa095d1595d22b936d2 not found: ID does not exist"
Jul 31 21:14:19.586778 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.586667    2565 scope.go:117] "RemoveContainer" containerID="33270b3f97dbac7b2ec82ef06770c349818189c9a21b9fe519a294835bae8b5f"
Jul 31 21:14:19.595396 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.595376    2565 scope.go:117] "RemoveContainer" containerID="33270b3f97dbac7b2ec82ef06770c349818189c9a21b9fe519a294835bae8b5f"
Jul 31 21:14:19.595662 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:14:19.595644    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33270b3f97dbac7b2ec82ef06770c349818189c9a21b9fe519a294835bae8b5f\": container with ID starting with 33270b3f97dbac7b2ec82ef06770c349818189c9a21b9fe519a294835bae8b5f not found: ID does not exist" containerID="33270b3f97dbac7b2ec82ef06770c349818189c9a21b9fe519a294835bae8b5f"
Jul 31 21:14:19.595704 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.595672    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33270b3f97dbac7b2ec82ef06770c349818189c9a21b9fe519a294835bae8b5f"} err="failed to get container status \"33270b3f97dbac7b2ec82ef06770c349818189c9a21b9fe519a294835bae8b5f\": rpc error: code = NotFound desc = could not find container \"33270b3f97dbac7b2ec82ef06770c349818189c9a21b9fe519a294835bae8b5f\": container with ID starting with 33270b3f97dbac7b2ec82ef06770c349818189c9a21b9fe519a294835bae8b5f not found: ID does not exist"
Jul 31 21:14:19.599627 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.599604    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k"]
Jul 31 21:14:19.605660 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.605636    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c8d2ed-668864bfb4-nbz7k"]
Jul 31 21:14:19.614247 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.614172    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"]
Jul 31 21:14:19.622789 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.622761    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c8d2ed-7bd57c7c45-xl6xw"]
Jul 31 21:14:19.915874 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.915792    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="527f71a5-3d1a-4b04-b894-d1ca7c024572" path="/var/lib/kubelet/pods/527f71a5-3d1a-4b04-b894-d1ca7c024572/volumes"
Jul 31 21:14:19.916263 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.916149    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8" path="/var/lib/kubelet/pods/7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8/volumes"
Jul 31 21:14:19.916463 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:19.916450    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ac9baac-ceb1-43e3-ba0f-b616983a1ff3" path="/var/lib/kubelet/pods/9ac9baac-ceb1-43e3-ba0f-b616983a1ff3/volumes"
Jul 31 21:14:25.156473 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:25.156436    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:25.217105 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:25.217057    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:25.434003 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:25.433975    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:25.652891 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:25.652861    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:26.005260 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.005227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:26.282306 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.282221    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"]
Jul 31 21:14:26.282682 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.282593    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8" containerName="revoke-keys"
Jul 31 21:14:26.282682 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.282610    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8" containerName="revoke-keys"
Jul 31 21:14:26.282682 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.282634    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="527f71a5-3d1a-4b04-b894-d1ca7c024572" containerName="maas-api"
Jul 31 21:14:26.282682 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.282639    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="527f71a5-3d1a-4b04-b894-d1ca7c024572" containerName="maas-api"
Jul 31 21:14:26.282682 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.282648    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ac9baac-ceb1-43e3-ba0f-b616983a1ff3" containerName="payload-processing"
Jul 31 21:14:26.282682 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.282654    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ac9baac-ceb1-43e3-ba0f-b616983a1ff3" containerName="payload-processing"
Jul 31 21:14:26.282938 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.282720    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ffa7fc1-0e0a-4afe-9e6f-18dbfe4c4fa8" containerName="revoke-keys"
Jul 31 21:14:26.282938 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.282729    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ac9baac-ceb1-43e3-ba0f-b616983a1ff3" containerName="payload-processing"
Jul 31 21:14:26.282938 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.282764    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="527f71a5-3d1a-4b04-b894-d1ca7c024572" containerName="maas-api"
Jul 31 21:14:26.287022 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.287002    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.289106 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.289086    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-268e33-openshift-default-dockercfg-9pm8d\""
Jul 31 21:14:26.302521 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.302483    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"]
Jul 31 21:14:26.307170 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.307127    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:26.424204 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.424163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8790733e-ca5b-4b23-a938-5c04f123ad65-istiod-ca-cert\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.424204 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.424211    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-envoy\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.424430 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.424229    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-workload-certs\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.424430 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.424279    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-data\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.424430 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.424330    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5n8n\" (UniqueName: \"kubernetes.io/projected/8790733e-ca5b-4b23-a938-5c04f123ad65-kube-api-access-k5n8n\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.424430 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.424395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-podinfo\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.424564 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.424438    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-workload-socket\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.424564 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.424457    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-credential-socket\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.424564 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.424519    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-token\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.525383 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.525340    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-envoy\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.525581 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.525386    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-workload-certs\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.525581 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.525416    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-data\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.525581 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.525444    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5n8n\" (UniqueName: \"kubernetes.io/projected/8790733e-ca5b-4b23-a938-5c04f123ad65-kube-api-access-k5n8n\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.525581 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.525503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-podinfo\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.525581 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.525553    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-workload-socket\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.525581 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.525575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-credential-socket\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.525905 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.525705    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-token\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.525905 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.525806    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8790733e-ca5b-4b23-a938-5c04f123ad65-istiod-ca-cert\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.525905 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.525834    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-workload-certs\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.525905 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.525890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-data\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.526353 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.526329    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-credential-socket\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.526447 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.526359    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-workload-socket\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.526447 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.526435    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8790733e-ca5b-4b23-a938-5c04f123ad65-istiod-ca-cert\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.527886 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.527868    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-envoy\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.528082 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.528063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-podinfo\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.533063 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.533004    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-token\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.533188 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.533172    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5n8n\" (UniqueName: \"kubernetes.io/projected/8790733e-ca5b-4b23-a938-5c04f123ad65-kube-api-access-k5n8n\") pod \"e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") " pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.603964 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.603925    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:26.725892 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.725855    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:26.749715 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.749683    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"]
Jul 31 21:14:26.750893 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:14:26.750864    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8790733e_ca5b_4b23_a938_5c04f123ad65.slice/crio-32849280968add50f927d6a68b99cc24225e202bef94e9acb8994b895045ebfe WatchSource:0}: Error finding container 32849280968add50f927d6a68b99cc24225e202bef94e9acb8994b895045ebfe: Status 404 returned error can't find the container with id 32849280968add50f927d6a68b99cc24225e202bef94e9acb8994b895045ebfe
Jul 31 21:14:26.753092 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.753060    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:14:26.753173 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.753125    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:14:26.753173 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:26.753153    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:14:27.621405 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:27.621367    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm" event={"ID":"8790733e-ca5b-4b23-a938-5c04f123ad65","Type":"ContainerStarted","Data":"80595a9c6fa964c00b8e76be2894e05daf43d318d1f251e9b700785e118b140d"}
Jul 31 21:14:27.621929 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:27.621423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm" event={"ID":"8790733e-ca5b-4b23-a938-5c04f123ad65","Type":"ContainerStarted","Data":"32849280968add50f927d6a68b99cc24225e202bef94e9acb8994b895045ebfe"}
Jul 31 21:14:27.640016 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:27.639963    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm" podStartSLOduration=1.639949669 podStartE2EDuration="1.639949669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:14:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:14:27.637984937 +0000 UTC m=+2676.243279300" watchObservedRunningTime="2026-07-31 21:14:27.639949669 +0000 UTC m=+2676.245244032"
Jul 31 21:14:28.604581 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:28.604542    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:28.609594 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:28.609567    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:28.626577 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:28.626550    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:28.627615 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:28.627596    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:29.646129 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:29.646094    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:29.743164 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:29.743127    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:30.743253 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:30.743220    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"]
Jul 31 21:14:30.746620 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:30.746592    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"
Jul 31 21:14:30.748916 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:30.748895    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-268e33-serving-cert\""
Jul 31 21:14:30.759990 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:30.759966    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"]
Jul 31 21:14:30.778980 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:30.778944    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:30.867026 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:30.866986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/563cfa29-cf6d-41bb-ad20-360886850e98-openshift-service-ca\") pod \"maas-api-e2e-api-a-268e33-5f848b47cd-g67mq\" (UID: \"563cfa29-cf6d-41bb-ad20-360886850e98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"
Jul 31 21:14:30.867209 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:30.867049    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/563cfa29-cf6d-41bb-ad20-360886850e98-maas-api-tls\") pod \"maas-api-e2e-api-a-268e33-5f848b47cd-g67mq\" (UID: \"563cfa29-cf6d-41bb-ad20-360886850e98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"
Jul 31 21:14:30.867209 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:30.867115    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqjvc\" (UniqueName: \"kubernetes.io/projected/563cfa29-cf6d-41bb-ad20-360886850e98-kube-api-access-xqjvc\") pod \"maas-api-e2e-api-a-268e33-5f848b47cd-g67mq\" (UID: \"563cfa29-cf6d-41bb-ad20-360886850e98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"
Jul 31 21:14:30.968044 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:30.968005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqjvc\" (UniqueName: \"kubernetes.io/projected/563cfa29-cf6d-41bb-ad20-360886850e98-kube-api-access-xqjvc\") pod \"maas-api-e2e-api-a-268e33-5f848b47cd-g67mq\" (UID: \"563cfa29-cf6d-41bb-ad20-360886850e98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"
Jul 31 21:14:30.968044 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:30.968050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/563cfa29-cf6d-41bb-ad20-360886850e98-openshift-service-ca\") pod \"maas-api-e2e-api-a-268e33-5f848b47cd-g67mq\" (UID: \"563cfa29-cf6d-41bb-ad20-360886850e98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"
Jul 31 21:14:30.968258 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:30.968093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/563cfa29-cf6d-41bb-ad20-360886850e98-maas-api-tls\") pod \"maas-api-e2e-api-a-268e33-5f848b47cd-g67mq\" (UID: \"563cfa29-cf6d-41bb-ad20-360886850e98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"
Jul 31 21:14:30.968258 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:14:30.968195    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-serving-cert: secret "maas-api-e2e-api-a-268e33-serving-cert" not found
Jul 31 21:14:30.968258 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:14:30.968247    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/563cfa29-cf6d-41bb-ad20-360886850e98-maas-api-tls podName:563cfa29-cf6d-41bb-ad20-360886850e98 nodeName:}" failed. No retries permitted until 2026-07-31 21:14:31.468232262 +0000 UTC m=+2680.073526616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/563cfa29-cf6d-41bb-ad20-360886850e98-maas-api-tls") pod "maas-api-e2e-api-a-268e33-5f848b47cd-g67mq" (UID: "563cfa29-cf6d-41bb-ad20-360886850e98") : secret "maas-api-e2e-api-a-268e33-serving-cert" not found
Jul 31 21:14:30.968788 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:30.968769    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/563cfa29-cf6d-41bb-ad20-360886850e98-openshift-service-ca\") pod \"maas-api-e2e-api-a-268e33-5f848b47cd-g67mq\" (UID: \"563cfa29-cf6d-41bb-ad20-360886850e98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"
Jul 31 21:14:30.983811 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:30.983784    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqjvc\" (UniqueName: \"kubernetes.io/projected/563cfa29-cf6d-41bb-ad20-360886850e98-kube-api-access-xqjvc\") pod \"maas-api-e2e-api-a-268e33-5f848b47cd-g67mq\" (UID: \"563cfa29-cf6d-41bb-ad20-360886850e98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"
Jul 31 21:14:31.231430 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:31.231361    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:31.320287 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:31.320254    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:31.397764 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:31.397693    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:31.473585 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:31.473539    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/563cfa29-cf6d-41bb-ad20-360886850e98-maas-api-tls\") pod \"maas-api-e2e-api-a-268e33-5f848b47cd-g67mq\" (UID: \"563cfa29-cf6d-41bb-ad20-360886850e98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"
Jul 31 21:14:31.479273 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:31.479243    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/563cfa29-cf6d-41bb-ad20-360886850e98-maas-api-tls\") pod \"maas-api-e2e-api-a-268e33-5f848b47cd-g67mq\" (UID: \"563cfa29-cf6d-41bb-ad20-360886850e98\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"
Jul 31 21:14:31.660845 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:31.660760    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"
Jul 31 21:14:31.802635 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:31.802599    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"]
Jul 31 21:14:31.804435 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:14:31.804405    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod563cfa29_cf6d_41bb_ad20_360886850e98.slice/crio-f28a0051f2db47ab17ef5efbb71702675792b0a6872784a1d2e172da6ae2127f WatchSource:0}: Error finding container f28a0051f2db47ab17ef5efbb71702675792b0a6872784a1d2e172da6ae2127f: Status 404 returned error can't find the container with id f28a0051f2db47ab17ef5efbb71702675792b0a6872784a1d2e172da6ae2127f
Jul 31 21:14:31.805789 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:31.805771    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 21:14:32.651692 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:32.651574    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq" event={"ID":"563cfa29-cf6d-41bb-ad20-360886850e98","Type":"ContainerStarted","Data":"2cf43885c504dac6f4c35404f5bd76117418d74f1e7965cd72cbee65c3f40152"}
Jul 31 21:14:32.651692 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:32.651643    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq" event={"ID":"563cfa29-cf6d-41bb-ad20-360886850e98","Type":"ContainerStarted","Data":"f28a0051f2db47ab17ef5efbb71702675792b0a6872784a1d2e172da6ae2127f"}
Jul 31 21:14:32.651692 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:32.651673    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"
Jul 31 21:14:32.670601 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:32.670547    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq" podStartSLOduration=2.222594453 podStartE2EDuration="2.670529796s" totalImagesPullingTime="447.935343ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:14:32.668182567 +0000 UTC m=+2681.273476961" watchObservedRunningTime="2026-07-31 21:14:32.670529796 +0000 UTC m=+2681.275824159"
Jul 31 21:14:38.670812 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:38.670775    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"
Jul 31 21:14:43.628519 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:43.628445    2565 patch_prober.go:28] interesting pod/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 31 21:14:43.628895 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:43.628517    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm" podUID="8790733e-ca5b-4b23-a938-5c04f123ad65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 31 21:14:43.719762 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:43.719654    2565 generic.go:356] "Generic (PLEG): container finished" podID="8790733e-ca5b-4b23-a938-5c04f123ad65" containerID="80595a9c6fa964c00b8e76be2894e05daf43d318d1f251e9b700785e118b140d" exitCode=0
Jul 31 21:14:43.719918 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:43.719765    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm" event={"ID":"8790733e-ca5b-4b23-a938-5c04f123ad65","Type":"ContainerDied","Data":"80595a9c6fa964c00b8e76be2894e05daf43d318d1f251e9b700785e118b140d"}
Jul 31 21:14:43.720330 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:43.720310    2565 scope.go:117] "RemoveContainer" containerID="80595a9c6fa964c00b8e76be2894e05daf43d318d1f251e9b700785e118b140d"
Jul 31 21:14:43.721556 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:43.721528    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:14:43.721631 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:43.721616    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:14:43.721674 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:43.721658    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:14:44.727524 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:44.727492    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm" event={"ID":"8790733e-ca5b-4b23-a938-5c04f123ad65","Type":"ContainerStarted","Data":"109623ceda980d6e72f076ffb010c8f023ce42466e9e5860fa1ba03f04c04a23"}
Jul 31 21:14:45.604418 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:45.604385    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:45.604595 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:45.604512    2565 patch_prober.go:28] interesting pod/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 31 21:14:45.604595 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:45.604571    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm" podUID="8790733e-ca5b-4b23-a938-5c04f123ad65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 31 21:14:46.604715 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:46.604676    2565 patch_prober.go:28] interesting pod/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 31 21:14:46.605126 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:46.604775    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm" podUID="8790733e-ca5b-4b23-a938-5c04f123ad65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 31 21:14:47.605014 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:47.604977    2565 patch_prober.go:28] interesting pod/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 31 21:14:47.605399 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:47.605033    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm" podUID="8790733e-ca5b-4b23-a938-5c04f123ad65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 31 21:14:48.604607 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:48.604567    2565 patch_prober.go:28] interesting pod/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 31 21:14:48.604820 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:48.604629    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm" podUID="8790733e-ca5b-4b23-a938-5c04f123ad65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 31 21:14:49.604830 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:49.604792    2565 patch_prober.go:28] interesting pod/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 31 21:14:49.605273 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:49.604850    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm" podUID="8790733e-ca5b-4b23-a938-5c04f123ad65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 31 21:14:50.609136 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:50.609102    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:50.609558 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:50.609378    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:50.610118 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:50.610102    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:14:52.088699 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:52.088665    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 21:14:52.093629 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:52.093609    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 21:14:52.099469 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:52.099446    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 21:14:52.104051 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:52.104031    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 21:14:54.588677 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:54.588649    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:55.054232 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:55.054198    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:55.367698 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:55.367620    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:55.685962 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:55.685927    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:58.704135 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:58.704100    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:58.801824 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:58.801789    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:59.788217 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:59.788182    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"]
Jul 31 21:14:59.791864 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:59.791835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"
Jul 31 21:14:59.793615 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:59.793593    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-9a0b6d-serving-cert\""
Jul 31 21:14:59.801337 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:59.801309    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"]
Jul 31 21:14:59.845820 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:59.845789    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t84zg\" (UniqueName: \"kubernetes.io/projected/245a5ac4-7156-402f-a79e-9e4107c034d8-kube-api-access-t84zg\") pod \"maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2\" (UID: \"245a5ac4-7156-402f-a79e-9e4107c034d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"
Jul 31 21:14:59.845962 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:59.845858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/245a5ac4-7156-402f-a79e-9e4107c034d8-openshift-service-ca\") pod \"maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2\" (UID: \"245a5ac4-7156-402f-a79e-9e4107c034d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"
Jul 31 21:14:59.845962 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:59.845938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/245a5ac4-7156-402f-a79e-9e4107c034d8-maas-api-tls\") pod \"maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2\" (UID: \"245a5ac4-7156-402f-a79e-9e4107c034d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"
Jul 31 21:14:59.856832 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:59.855951    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:14:59.947304 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:59.947265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/245a5ac4-7156-402f-a79e-9e4107c034d8-maas-api-tls\") pod \"maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2\" (UID: \"245a5ac4-7156-402f-a79e-9e4107c034d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"
Jul 31 21:14:59.947478 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:59.947312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t84zg\" (UniqueName: \"kubernetes.io/projected/245a5ac4-7156-402f-a79e-9e4107c034d8-kube-api-access-t84zg\") pod \"maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2\" (UID: \"245a5ac4-7156-402f-a79e-9e4107c034d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"
Jul 31 21:14:59.947478 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:59.947387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/245a5ac4-7156-402f-a79e-9e4107c034d8-openshift-service-ca\") pod \"maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2\" (UID: \"245a5ac4-7156-402f-a79e-9e4107c034d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"
Jul 31 21:14:59.947478 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:14:59.947443    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-serving-cert: secret "maas-api-e2e-api-b-9a0b6d-serving-cert" not found
Jul 31 21:14:59.947619 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:14:59.947534    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/245a5ac4-7156-402f-a79e-9e4107c034d8-maas-api-tls podName:245a5ac4-7156-402f-a79e-9e4107c034d8 nodeName:}" failed. No retries permitted until 2026-07-31 21:15:00.447514137 +0000 UTC m=+2709.052808484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/245a5ac4-7156-402f-a79e-9e4107c034d8-maas-api-tls") pod "maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2" (UID: "245a5ac4-7156-402f-a79e-9e4107c034d8") : secret "maas-api-e2e-api-b-9a0b6d-serving-cert" not found
Jul 31 21:14:59.948192 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:59.948161    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/245a5ac4-7156-402f-a79e-9e4107c034d8-openshift-service-ca\") pod \"maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2\" (UID: \"245a5ac4-7156-402f-a79e-9e4107c034d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"
Jul 31 21:14:59.955232 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:14:59.955210    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t84zg\" (UniqueName: \"kubernetes.io/projected/245a5ac4-7156-402f-a79e-9e4107c034d8-kube-api-access-t84zg\") pod \"maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2\" (UID: \"245a5ac4-7156-402f-a79e-9e4107c034d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"
Jul 31 21:15:00.052196 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.052109    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:15:00.369880 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.369790    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:15:00.451001 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.450953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/245a5ac4-7156-402f-a79e-9e4107c034d8-maas-api-tls\") pod \"maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2\" (UID: \"245a5ac4-7156-402f-a79e-9e4107c034d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"
Jul 31 21:15:00.453504 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.453478    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/245a5ac4-7156-402f-a79e-9e4107c034d8-maas-api-tls\") pod \"maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2\" (UID: \"245a5ac4-7156-402f-a79e-9e4107c034d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"
Jul 31 21:15:00.466527 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.466498    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:15:00.472852 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.472824    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd"]
Jul 31 21:15:00.476628 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.476607    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd"
Jul 31 21:15:00.478679 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.478659    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-9a0b6d\""
Jul 31 21:15:00.480178 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.480161    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-9a0b6d-dockercfg-gpr72\""
Jul 31 21:15:00.485971 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.485951    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd"]
Jul 31 21:15:00.552345 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.552308    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0131694-89a4-4f28-a04d-7b835bbb61fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd\" (UID: \"e0131694-89a4-4f28-a04d-7b835bbb61fa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd"
Jul 31 21:15:00.552522 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.552371    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5jcl\" (UniqueName: \"kubernetes.io/projected/e0131694-89a4-4f28-a04d-7b835bbb61fa-kube-api-access-g5jcl\") pod \"payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd\" (UID: \"e0131694-89a4-4f28-a04d-7b835bbb61fa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd"
Jul 31 21:15:00.653952 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.653855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0131694-89a4-4f28-a04d-7b835bbb61fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd\" (UID: \"e0131694-89a4-4f28-a04d-7b835bbb61fa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd"
Jul 31 21:15:00.654109 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.653972    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5jcl\" (UniqueName: \"kubernetes.io/projected/e0131694-89a4-4f28-a04d-7b835bbb61fa-kube-api-access-g5jcl\") pod \"payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd\" (UID: \"e0131694-89a4-4f28-a04d-7b835bbb61fa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd"
Jul 31 21:15:00.654549 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.654529    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0131694-89a4-4f28-a04d-7b835bbb61fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd\" (UID: \"e0131694-89a4-4f28-a04d-7b835bbb61fa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd"
Jul 31 21:15:00.661423 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.661397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5jcl\" (UniqueName: \"kubernetes.io/projected/e0131694-89a4-4f28-a04d-7b835bbb61fa-kube-api-access-g5jcl\") pod \"payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd\" (UID: \"e0131694-89a4-4f28-a04d-7b835bbb61fa\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd"
Jul 31 21:15:00.704856 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.704820    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"
Jul 31 21:15:00.789378 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.789346    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd"
Jul 31 21:15:00.848927 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.848877    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"]
Jul 31 21:15:00.849909 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:15:00.849871    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245a5ac4_7156_402f_a79e_9e4107c034d8.slice/crio-493283315d39fe832ef8e522df9c86fd67e507621bcb9945bc20b3537a047803 WatchSource:0}: Error finding container 493283315d39fe832ef8e522df9c86fd67e507621bcb9945bc20b3537a047803: Status 404 returned error can't find the container with id 493283315d39fe832ef8e522df9c86fd67e507621bcb9945bc20b3537a047803
Jul 31 21:15:00.938773 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:00.938748    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd"]
Jul 31 21:15:00.940503 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:15:00.940468    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0131694_89a4_4f28_a04d_7b835bbb61fa.slice/crio-f2ddb7b98bb256d695442115bd0001ad8897d9a80bd534bd0790818eed97a52b WatchSource:0}: Error finding container f2ddb7b98bb256d695442115bd0001ad8897d9a80bd534bd0790818eed97a52b: Status 404 returned error can't find the container with id f2ddb7b98bb256d695442115bd0001ad8897d9a80bd534bd0790818eed97a52b
Jul 31 21:15:01.823711 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:01.823677    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd" event={"ID":"e0131694-89a4-4f28-a04d-7b835bbb61fa","Type":"ContainerStarted","Data":"dc2008ec20502e08fa94e50851b0ab9c92f9defde901639fbfbb5ea961daf6c2"}
Jul 31 21:15:01.824252 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:01.823762    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd" event={"ID":"e0131694-89a4-4f28-a04d-7b835bbb61fa","Type":"ContainerStarted","Data":"f2ddb7b98bb256d695442115bd0001ad8897d9a80bd534bd0790818eed97a52b"}
Jul 31 21:15:01.824252 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:01.823796    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd"
Jul 31 21:15:01.825420 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:01.825396    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2" event={"ID":"245a5ac4-7156-402f-a79e-9e4107c034d8","Type":"ContainerStarted","Data":"ce9fd9896f5dc08371f0702b217e01c0871d0300d592f12aa630e4f02ed8cc2a"}
Jul 31 21:15:01.825520 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:01.825435    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2" event={"ID":"245a5ac4-7156-402f-a79e-9e4107c034d8","Type":"ContainerStarted","Data":"493283315d39fe832ef8e522df9c86fd67e507621bcb9945bc20b3537a047803"}
Jul 31 21:15:01.825520 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:01.825456    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"
Jul 31 21:15:01.841585 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:01.841534    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd" podStartSLOduration=1.8415185699999999 podStartE2EDuration="1.84151857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:15:01.840316606 +0000 UTC m=+2710.445610957" watchObservedRunningTime="2026-07-31 21:15:01.84151857 +0000 UTC m=+2710.446812932"
Jul 31 21:15:01.859216 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:01.859166    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2" podStartSLOduration=2.360957326 podStartE2EDuration="2.859152065s" totalImagesPullingTime="498.194739ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:15:01.857329226 +0000 UTC m=+2710.462623590" watchObservedRunningTime="2026-07-31 21:15:01.859152065 +0000 UTC m=+2710.464446427"
Jul 31 21:15:07.836373 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:07.836342    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"
Jul 31 21:15:12.832879 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:12.832849    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd"
Jul 31 21:15:17.545920 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:17.545887    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:15:18.914684 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:18.914654    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:15:28.851963 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:28.851929    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:15:42.697427 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:42.697395    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"]
Jul 31 21:15:42.698230 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:42.698197    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq" podUID="563cfa29-cf6d-41bb-ad20-360886850e98" containerName="maas-api" containerID="cri-o://2cf43885c504dac6f4c35404f5bd76117418d74f1e7965cd72cbee65c3f40152" gracePeriod=30
Jul 31 21:15:42.730827 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:42.730799    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:15:42.791675 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:42.791538    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:15:42.850344 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:42.850311    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:15:42.951985 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:42.951945    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:15:42.958469 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:42.958446    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"
Jul 31 21:15:43.051360 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.051273    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/563cfa29-cf6d-41bb-ad20-360886850e98-maas-api-tls\") pod \"563cfa29-cf6d-41bb-ad20-360886850e98\" (UID: \"563cfa29-cf6d-41bb-ad20-360886850e98\") "
Jul 31 21:15:43.051528 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.051378    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqjvc\" (UniqueName: \"kubernetes.io/projected/563cfa29-cf6d-41bb-ad20-360886850e98-kube-api-access-xqjvc\") pod \"563cfa29-cf6d-41bb-ad20-360886850e98\" (UID: \"563cfa29-cf6d-41bb-ad20-360886850e98\") "
Jul 31 21:15:43.051528 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.051470    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/563cfa29-cf6d-41bb-ad20-360886850e98-openshift-service-ca\") pod \"563cfa29-cf6d-41bb-ad20-360886850e98\" (UID: \"563cfa29-cf6d-41bb-ad20-360886850e98\") "
Jul 31 21:15:43.051942 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.051915    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/563cfa29-cf6d-41bb-ad20-360886850e98-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "563cfa29-cf6d-41bb-ad20-360886850e98" (UID: "563cfa29-cf6d-41bb-ad20-360886850e98"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:15:43.052688 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.052660    2565 generic.go:356] "Generic (PLEG): container finished" podID="563cfa29-cf6d-41bb-ad20-360886850e98" containerID="2cf43885c504dac6f4c35404f5bd76117418d74f1e7965cd72cbee65c3f40152" exitCode=0
Jul 31 21:15:43.052844 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.052768    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"
Jul 31 21:15:43.052844 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.052782    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq" event={"ID":"563cfa29-cf6d-41bb-ad20-360886850e98","Type":"ContainerDied","Data":"2cf43885c504dac6f4c35404f5bd76117418d74f1e7965cd72cbee65c3f40152"}
Jul 31 21:15:43.052966 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.052853    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq" event={"ID":"563cfa29-cf6d-41bb-ad20-360886850e98","Type":"ContainerDied","Data":"f28a0051f2db47ab17ef5efbb71702675792b0a6872784a1d2e172da6ae2127f"}
Jul 31 21:15:43.052966 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.052886    2565 scope.go:117] "RemoveContainer" containerID="2cf43885c504dac6f4c35404f5bd76117418d74f1e7965cd72cbee65c3f40152"
Jul 31 21:15:43.054149 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.054003    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/563cfa29-cf6d-41bb-ad20-360886850e98-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "563cfa29-cf6d-41bb-ad20-360886850e98" (UID: "563cfa29-cf6d-41bb-ad20-360886850e98"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:15:43.054220 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.054196    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/563cfa29-cf6d-41bb-ad20-360886850e98-kube-api-access-xqjvc" (OuterVolumeSpecName: "kube-api-access-xqjvc") pod "563cfa29-cf6d-41bb-ad20-360886850e98" (UID: "563cfa29-cf6d-41bb-ad20-360886850e98"). InnerVolumeSpecName "kube-api-access-xqjvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:15:43.071855 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.071835    2565 scope.go:117] "RemoveContainer" containerID="2cf43885c504dac6f4c35404f5bd76117418d74f1e7965cd72cbee65c3f40152"
Jul 31 21:15:43.072124 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:15:43.072103    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cf43885c504dac6f4c35404f5bd76117418d74f1e7965cd72cbee65c3f40152\": container with ID starting with 2cf43885c504dac6f4c35404f5bd76117418d74f1e7965cd72cbee65c3f40152 not found: ID does not exist" containerID="2cf43885c504dac6f4c35404f5bd76117418d74f1e7965cd72cbee65c3f40152"
Jul 31 21:15:43.072180 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.072135    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cf43885c504dac6f4c35404f5bd76117418d74f1e7965cd72cbee65c3f40152"} err="failed to get container status \"2cf43885c504dac6f4c35404f5bd76117418d74f1e7965cd72cbee65c3f40152\": rpc error: code = NotFound desc = could not find container \"2cf43885c504dac6f4c35404f5bd76117418d74f1e7965cd72cbee65c3f40152\": container with ID starting with 2cf43885c504dac6f4c35404f5bd76117418d74f1e7965cd72cbee65c3f40152 not found: ID does not exist"
Jul 31 21:15:43.152417 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.152383    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/563cfa29-cf6d-41bb-ad20-360886850e98-maas-api-tls\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:15:43.152417 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.152417    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqjvc\" (UniqueName: \"kubernetes.io/projected/563cfa29-cf6d-41bb-ad20-360886850e98-kube-api-access-xqjvc\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:15:43.152626 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.152430    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/563cfa29-cf6d-41bb-ad20-360886850e98-openshift-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:15:43.360958 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.360929    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:15:43.374121 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.374095    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"]
Jul 31 21:15:43.377168 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.377145    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-268e33-5f848b47cd-g67mq"]
Jul 31 21:15:43.921215 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:43.921183    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="563cfa29-cf6d-41bb-ad20-360886850e98" path="/var/lib/kubelet/pods/563cfa29-cf6d-41bb-ad20-360886850e98/volumes"
Jul 31 21:15:49.456928 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:49.456892    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:15:49.559549 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:49.559512    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:15:49.685620 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:49.685587    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"]
Jul 31 21:15:49.685882 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:49.685856    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm" podUID="8790733e-ca5b-4b23-a938-5c04f123ad65" containerName="istio-proxy" containerID="cri-o://109623ceda980d6e72f076ffb010c8f023ce42466e9e5860fa1ba03f04c04a23" gracePeriod=30
Jul 31 21:15:49.706275 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:49.706245    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:15:49.936598 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:49.936566    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:15:50.611684 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:50.611647    2565 patch_prober.go:28] interesting pod/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 21:15:50.612073 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:50.611721    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm" podUID="8790733e-ca5b-4b23-a938-5c04f123ad65" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 21:15:52.263898 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:52.263863    2565 scope.go:117] "RemoveContainer" containerID="5c43f7739e00b8ac90e7b0c054f94835ea2497d27b9118fa2063141c10da9788"
Jul 31 21:15:54.933077 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:54.933053    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:15:55.059952 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.059859    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-envoy\") pod \"8790733e-ca5b-4b23-a938-5c04f123ad65\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") "
Jul 31 21:15:55.059952 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.059906    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8790733e-ca5b-4b23-a938-5c04f123ad65-istiod-ca-cert\") pod \"8790733e-ca5b-4b23-a938-5c04f123ad65\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") "
Jul 31 21:15:55.059952 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.059925    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5n8n\" (UniqueName: \"kubernetes.io/projected/8790733e-ca5b-4b23-a938-5c04f123ad65-kube-api-access-k5n8n\") pod \"8790733e-ca5b-4b23-a938-5c04f123ad65\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") "
Jul 31 21:15:55.060240 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.059960    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-podinfo\") pod \"8790733e-ca5b-4b23-a938-5c04f123ad65\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") "
Jul 31 21:15:55.060240 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.060038    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-workload-certs\") pod \"8790733e-ca5b-4b23-a938-5c04f123ad65\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") "
Jul 31 21:15:55.060240 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.060061    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-data\") pod \"8790733e-ca5b-4b23-a938-5c04f123ad65\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") "
Jul 31 21:15:55.060240 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.060131    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-credential-socket\") pod \"8790733e-ca5b-4b23-a938-5c04f123ad65\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") "
Jul 31 21:15:55.060240 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.060156    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-token\") pod \"8790733e-ca5b-4b23-a938-5c04f123ad65\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") "
Jul 31 21:15:55.060240 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.060202    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-workload-socket\") pod \"8790733e-ca5b-4b23-a938-5c04f123ad65\" (UID: \"8790733e-ca5b-4b23-a938-5c04f123ad65\") "
Jul 31 21:15:55.060561 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.060383    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8790733e-ca5b-4b23-a938-5c04f123ad65" (UID: "8790733e-ca5b-4b23-a938-5c04f123ad65"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:15:55.060561 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.060385    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-data" (OuterVolumeSpecName: "istio-data") pod "8790733e-ca5b-4b23-a938-5c04f123ad65" (UID: "8790733e-ca5b-4b23-a938-5c04f123ad65"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:15:55.060561 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.060423    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8790733e-ca5b-4b23-a938-5c04f123ad65-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8790733e-ca5b-4b23-a938-5c04f123ad65" (UID: "8790733e-ca5b-4b23-a938-5c04f123ad65"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:15:55.060917 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.060566    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8790733e-ca5b-4b23-a938-5c04f123ad65-istiod-ca-cert\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:15:55.060917 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.060585    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-workload-certs\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:15:55.060917 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.060598    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-data\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:15:55.060917 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.060617    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8790733e-ca5b-4b23-a938-5c04f123ad65" (UID: "8790733e-ca5b-4b23-a938-5c04f123ad65"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:15:55.060917 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.060680    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8790733e-ca5b-4b23-a938-5c04f123ad65" (UID: "8790733e-ca5b-4b23-a938-5c04f123ad65"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:15:55.062286 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.062254    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8790733e-ca5b-4b23-a938-5c04f123ad65" (UID: "8790733e-ca5b-4b23-a938-5c04f123ad65"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:15:55.062419 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.062380    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8790733e-ca5b-4b23-a938-5c04f123ad65-kube-api-access-k5n8n" (OuterVolumeSpecName: "kube-api-access-k5n8n") pod "8790733e-ca5b-4b23-a938-5c04f123ad65" (UID: "8790733e-ca5b-4b23-a938-5c04f123ad65"). InnerVolumeSpecName "kube-api-access-k5n8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:15:55.062502 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.062449    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8790733e-ca5b-4b23-a938-5c04f123ad65" (UID: "8790733e-ca5b-4b23-a938-5c04f123ad65"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 21:15:55.062760 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.062716    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-token" (OuterVolumeSpecName: "istio-token") pod "8790733e-ca5b-4b23-a938-5c04f123ad65" (UID: "8790733e-ca5b-4b23-a938-5c04f123ad65"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:15:55.134333 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.134303    2565 generic.go:356] "Generic (PLEG): container finished" podID="8790733e-ca5b-4b23-a938-5c04f123ad65" containerID="109623ceda980d6e72f076ffb010c8f023ce42466e9e5860fa1ba03f04c04a23" exitCode=0
Jul 31 21:15:55.134495 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.134361    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"
Jul 31 21:15:55.134495 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.134388    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm" event={"ID":"8790733e-ca5b-4b23-a938-5c04f123ad65","Type":"ContainerDied","Data":"109623ceda980d6e72f076ffb010c8f023ce42466e9e5860fa1ba03f04c04a23"}
Jul 31 21:15:55.134495 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.134461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm" event={"ID":"8790733e-ca5b-4b23-a938-5c04f123ad65","Type":"ContainerDied","Data":"32849280968add50f927d6a68b99cc24225e202bef94e9acb8994b895045ebfe"}
Jul 31 21:15:55.134495 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.134483    2565 scope.go:117] "RemoveContainer" containerID="109623ceda980d6e72f076ffb010c8f023ce42466e9e5860fa1ba03f04c04a23"
Jul 31 21:15:55.144583 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.144567    2565 scope.go:117] "RemoveContainer" containerID="80595a9c6fa964c00b8e76be2894e05daf43d318d1f251e9b700785e118b140d"
Jul 31 21:15:55.153083 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.153064    2565 scope.go:117] "RemoveContainer" containerID="109623ceda980d6e72f076ffb010c8f023ce42466e9e5860fa1ba03f04c04a23"
Jul 31 21:15:55.153327 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:15:55.153309    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"109623ceda980d6e72f076ffb010c8f023ce42466e9e5860fa1ba03f04c04a23\": container with ID starting with 109623ceda980d6e72f076ffb010c8f023ce42466e9e5860fa1ba03f04c04a23 not found: ID does not exist" containerID="109623ceda980d6e72f076ffb010c8f023ce42466e9e5860fa1ba03f04c04a23"
Jul 31 21:15:55.153374 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.153336    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"109623ceda980d6e72f076ffb010c8f023ce42466e9e5860fa1ba03f04c04a23"} err="failed to get container status \"109623ceda980d6e72f076ffb010c8f023ce42466e9e5860fa1ba03f04c04a23\": rpc error: code = NotFound desc = could not find container \"109623ceda980d6e72f076ffb010c8f023ce42466e9e5860fa1ba03f04c04a23\": container with ID starting with 109623ceda980d6e72f076ffb010c8f023ce42466e9e5860fa1ba03f04c04a23 not found: ID does not exist"
Jul 31 21:15:55.153374 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.153353    2565 scope.go:117] "RemoveContainer" containerID="80595a9c6fa964c00b8e76be2894e05daf43d318d1f251e9b700785e118b140d"
Jul 31 21:15:55.154228 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:15:55.154138    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80595a9c6fa964c00b8e76be2894e05daf43d318d1f251e9b700785e118b140d\": container with ID starting with 80595a9c6fa964c00b8e76be2894e05daf43d318d1f251e9b700785e118b140d not found: ID does not exist" containerID="80595a9c6fa964c00b8e76be2894e05daf43d318d1f251e9b700785e118b140d"
Jul 31 21:15:55.154228 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.154202    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80595a9c6fa964c00b8e76be2894e05daf43d318d1f251e9b700785e118b140d"} err="failed to get container status \"80595a9c6fa964c00b8e76be2894e05daf43d318d1f251e9b700785e118b140d\": rpc error: code = NotFound desc = could not find container \"80595a9c6fa964c00b8e76be2894e05daf43d318d1f251e9b700785e118b140d\": container with ID starting with 80595a9c6fa964c00b8e76be2894e05daf43d318d1f251e9b700785e118b140d not found: ID does not exist"
Jul 31 21:15:55.157108 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.157086    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"]
Jul 31 21:15:55.161212 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.161192    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-credential-socket\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:15:55.161212 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.161213    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-token\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:15:55.161328 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.161223    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-workload-socket\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:15:55.161328 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.161233    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-envoy\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:15:55.161328 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.161241    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5n8n\" (UniqueName: \"kubernetes.io/projected/8790733e-ca5b-4b23-a938-5c04f123ad65-kube-api-access-k5n8n\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:15:55.161328 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.161251    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8790733e-ca5b-4b23-a938-5c04f123ad65-istio-podinfo\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:15:55.162362 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.162344    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-268e33-openshift-default-85f55bd57d-dxcxm"]
Jul 31 21:15:55.915122 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:15:55.915090    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8790733e-ca5b-4b23-a938-5c04f123ad65" path="/var/lib/kubelet/pods/8790733e-ca5b-4b23-a938-5c04f123ad65/volumes"
Jul 31 21:16:00.901501 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:00.901467    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"]
Jul 31 21:16:00.901952 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:00.901756    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2" podUID="245a5ac4-7156-402f-a79e-9e4107c034d8" containerName="maas-api" containerID="cri-o://ce9fd9896f5dc08371f0702b217e01c0871d0300d592f12aa630e4f02ed8cc2a" gracePeriod=30
Jul 31 21:16:00.926520 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:00.926494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:00.958148 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:00.958113    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd"]
Jul 31 21:16:00.958407 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:00.958359    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd" podUID="e0131694-89a4-4f28-a04d-7b835bbb61fa" containerName="payload-pre-processing" containerID="cri-o://dc2008ec20502e08fa94e50851b0ab9c92f9defde901639fbfbb5ea961daf6c2" gracePeriod=30
Jul 31 21:16:01.022416 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.022385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:01.123180 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.123136    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:01.171763 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.171709    2565 generic.go:356] "Generic (PLEG): container finished" podID="245a5ac4-7156-402f-a79e-9e4107c034d8" containerID="ce9fd9896f5dc08371f0702b217e01c0871d0300d592f12aa630e4f02ed8cc2a" exitCode=0
Jul 31 21:16:01.171963 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.171773    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2" event={"ID":"245a5ac4-7156-402f-a79e-9e4107c034d8","Type":"ContainerDied","Data":"ce9fd9896f5dc08371f0702b217e01c0871d0300d592f12aa630e4f02ed8cc2a"}
Jul 31 21:16:01.173859 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.173832    2565 generic.go:356] "Generic (PLEG): container finished" podID="e0131694-89a4-4f28-a04d-7b835bbb61fa" containerID="dc2008ec20502e08fa94e50851b0ab9c92f9defde901639fbfbb5ea961daf6c2" exitCode=0
Jul 31 21:16:01.173977 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.173879    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd" event={"ID":"e0131694-89a4-4f28-a04d-7b835bbb61fa","Type":"ContainerDied","Data":"dc2008ec20502e08fa94e50851b0ab9c92f9defde901639fbfbb5ea961daf6c2"}
Jul 31 21:16:01.194538 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.194499    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:01.233870 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.233843    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"
Jul 31 21:16:01.264960 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.264932    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd"
Jul 31 21:16:01.315645 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.315616    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/245a5ac4-7156-402f-a79e-9e4107c034d8-openshift-service-ca\") pod \"245a5ac4-7156-402f-a79e-9e4107c034d8\" (UID: \"245a5ac4-7156-402f-a79e-9e4107c034d8\") "
Jul 31 21:16:01.315852 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.315708    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t84zg\" (UniqueName: \"kubernetes.io/projected/245a5ac4-7156-402f-a79e-9e4107c034d8-kube-api-access-t84zg\") pod \"245a5ac4-7156-402f-a79e-9e4107c034d8\" (UID: \"245a5ac4-7156-402f-a79e-9e4107c034d8\") "
Jul 31 21:16:01.315852 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.315810    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/245a5ac4-7156-402f-a79e-9e4107c034d8-maas-api-tls\") pod \"245a5ac4-7156-402f-a79e-9e4107c034d8\" (UID: \"245a5ac4-7156-402f-a79e-9e4107c034d8\") "
Jul 31 21:16:01.316030 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.316002    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/245a5ac4-7156-402f-a79e-9e4107c034d8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "245a5ac4-7156-402f-a79e-9e4107c034d8" (UID: "245a5ac4-7156-402f-a79e-9e4107c034d8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:16:01.316166 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.316095    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/245a5ac4-7156-402f-a79e-9e4107c034d8-openshift-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:16:01.318014 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.317991    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/245a5ac4-7156-402f-a79e-9e4107c034d8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "245a5ac4-7156-402f-a79e-9e4107c034d8" (UID: "245a5ac4-7156-402f-a79e-9e4107c034d8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:16:01.318119 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.318072    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/245a5ac4-7156-402f-a79e-9e4107c034d8-kube-api-access-t84zg" (OuterVolumeSpecName: "kube-api-access-t84zg") pod "245a5ac4-7156-402f-a79e-9e4107c034d8" (UID: "245a5ac4-7156-402f-a79e-9e4107c034d8"). InnerVolumeSpecName "kube-api-access-t84zg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:16:01.417128 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.417013    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0131694-89a4-4f28-a04d-7b835bbb61fa-plugins-config-volume\") pod \"e0131694-89a4-4f28-a04d-7b835bbb61fa\" (UID: \"e0131694-89a4-4f28-a04d-7b835bbb61fa\") "
Jul 31 21:16:01.417128 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.417091    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5jcl\" (UniqueName: \"kubernetes.io/projected/e0131694-89a4-4f28-a04d-7b835bbb61fa-kube-api-access-g5jcl\") pod \"e0131694-89a4-4f28-a04d-7b835bbb61fa\" (UID: \"e0131694-89a4-4f28-a04d-7b835bbb61fa\") "
Jul 31 21:16:01.417375 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.417312    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/245a5ac4-7156-402f-a79e-9e4107c034d8-maas-api-tls\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:16:01.417375 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.417331    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t84zg\" (UniqueName: \"kubernetes.io/projected/245a5ac4-7156-402f-a79e-9e4107c034d8-kube-api-access-t84zg\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:16:01.417451 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.417374    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0131694-89a4-4f28-a04d-7b835bbb61fa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e0131694-89a4-4f28-a04d-7b835bbb61fa" (UID: "e0131694-89a4-4f28-a04d-7b835bbb61fa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:16:01.419259 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.419235    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0131694-89a4-4f28-a04d-7b835bbb61fa-kube-api-access-g5jcl" (OuterVolumeSpecName: "kube-api-access-g5jcl") pod "e0131694-89a4-4f28-a04d-7b835bbb61fa" (UID: "e0131694-89a4-4f28-a04d-7b835bbb61fa"). InnerVolumeSpecName "kube-api-access-g5jcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:16:01.501713 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.501682    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:01.518073 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.518045    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0131694-89a4-4f28-a04d-7b835bbb61fa-plugins-config-volume\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:16:01.518073 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:01.518069    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5jcl\" (UniqueName: \"kubernetes.io/projected/e0131694-89a4-4f28-a04d-7b835bbb61fa-kube-api-access-g5jcl\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:16:02.180340 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:02.180297    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd" event={"ID":"e0131694-89a4-4f28-a04d-7b835bbb61fa","Type":"ContainerDied","Data":"f2ddb7b98bb256d695442115bd0001ad8897d9a80bd534bd0790818eed97a52b"}
Jul 31 21:16:02.180773 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:02.180342    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd"
Jul 31 21:16:02.180773 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:02.180376    2565 scope.go:117] "RemoveContainer" containerID="dc2008ec20502e08fa94e50851b0ab9c92f9defde901639fbfbb5ea961daf6c2"
Jul 31 21:16:02.181833 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:02.181811    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"
Jul 31 21:16:02.181957 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:02.181851    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2" event={"ID":"245a5ac4-7156-402f-a79e-9e4107c034d8","Type":"ContainerDied","Data":"493283315d39fe832ef8e522df9c86fd67e507621bcb9945bc20b3537a047803"}
Jul 31 21:16:02.190246 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:02.190228    2565 scope.go:117] "RemoveContainer" containerID="ce9fd9896f5dc08371f0702b217e01c0871d0300d592f12aa630e4f02ed8cc2a"
Jul 31 21:16:02.197038 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:02.197015    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"]
Jul 31 21:16:02.199129 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:02.199026    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9a0b6d-5b485cd4c8-jd9g2"]
Jul 31 21:16:02.207782 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:02.207758    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd"]
Jul 31 21:16:02.209787 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:02.209763    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9a0b6d-555d948c9b-n6qdd"]
Jul 31 21:16:03.915668 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:03.915637    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="245a5ac4-7156-402f-a79e-9e4107c034d8" path="/var/lib/kubelet/pods/245a5ac4-7156-402f-a79e-9e4107c034d8/volumes"
Jul 31 21:16:03.916047 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:03.916027    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0131694-89a4-4f28-a04d-7b835bbb61fa" path="/var/lib/kubelet/pods/e0131694-89a4-4f28-a04d-7b835bbb61fa/volumes"
Jul 31 21:16:07.289671 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:07.289630    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:07.389679 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:07.389639    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:07.550518 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:07.550435    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:07.785101 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:07.785069    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:08.106198 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.106168    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:08.503567 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.503533    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"]
Jul 31 21:16:08.503952 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.503901    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8790733e-ca5b-4b23-a938-5c04f123ad65" containerName="istio-proxy"
Jul 31 21:16:08.503952 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.503916    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8790733e-ca5b-4b23-a938-5c04f123ad65" containerName="istio-proxy"
Jul 31 21:16:08.503952 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.503934    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="563cfa29-cf6d-41bb-ad20-360886850e98" containerName="maas-api"
Jul 31 21:16:08.503952 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.503940    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="563cfa29-cf6d-41bb-ad20-360886850e98" containerName="maas-api"
Jul 31 21:16:08.503952 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.503955    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="245a5ac4-7156-402f-a79e-9e4107c034d8" containerName="maas-api"
Jul 31 21:16:08.504118 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.503960    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="245a5ac4-7156-402f-a79e-9e4107c034d8" containerName="maas-api"
Jul 31 21:16:08.504118 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.503967    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0131694-89a4-4f28-a04d-7b835bbb61fa" containerName="payload-pre-processing"
Jul 31 21:16:08.504118 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.503972    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0131694-89a4-4f28-a04d-7b835bbb61fa" containerName="payload-pre-processing"
Jul 31 21:16:08.504118 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.504040    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="563cfa29-cf6d-41bb-ad20-360886850e98" containerName="maas-api"
Jul 31 21:16:08.504118 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.504047    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8790733e-ca5b-4b23-a938-5c04f123ad65" containerName="istio-proxy"
Jul 31 21:16:08.504118 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.504054    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="245a5ac4-7156-402f-a79e-9e4107c034d8" containerName="maas-api"
Jul 31 21:16:08.504118 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.504061    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0131694-89a4-4f28-a04d-7b835bbb61fa" containerName="payload-pre-processing"
Jul 31 21:16:08.508621 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.508600    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.511024 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.511008    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-8de79c-openshift-default-dockercfg-hwrcz\""
Jul 31 21:16:08.527698 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.527673    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"]
Jul 31 21:16:08.565312 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.565275    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:08.676894 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.676859    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istiod-ca-cert\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.677076 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.676910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-podinfo\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.677076 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.677033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-data\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.677229 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.677080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7wbm\" (UniqueName: \"kubernetes.io/projected/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-kube-api-access-v7wbm\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.677229 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.677150    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-credential-socket\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.677229 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.677203    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-workload-socket\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.677380 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.677241    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-token\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.677380 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.677270    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-workload-certs\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.677380 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.677303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-envoy\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.777978 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.777891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-credential-socket\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.777978 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.777934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-workload-socket\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.777978 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.777957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-token\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.777978 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.777976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-workload-certs\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.778332 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.777993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-envoy\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.778332 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.778046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istiod-ca-cert\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.778332 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.778072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-podinfo\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.778332 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.778110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-data\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.778332 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.778140    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7wbm\" (UniqueName: \"kubernetes.io/projected/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-kube-api-access-v7wbm\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.778621 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.778372    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-workload-certs\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.778621 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.778405    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-workload-socket\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.778621 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.778423    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-credential-socket\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.778811 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.778618    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-data\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.778884 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.778866    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istiod-ca-cert\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.780468 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.780446    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-envoy\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.780783 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.780768    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-podinfo\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.785191 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.785166    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-token\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.785306 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.785238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7wbm\" (UniqueName: \"kubernetes.io/projected/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-kube-api-access-v7wbm\") pod \"e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") " pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.818854 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.818826    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:08.894461 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.894428    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:08.961318 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.961293    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"]
Jul 31 21:16:08.963115 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:16:08.963088    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce7b7ebd_e300_46ae_8c29_c7259d3f2517.slice/crio-21157a890c8782ff7f6e2d6b329fc8bf9636bd158a726a864d2cabf0572f4d09 WatchSource:0}: Error finding container 21157a890c8782ff7f6e2d6b329fc8bf9636bd158a726a864d2cabf0572f4d09: Status 404 returned error can't find the container with id 21157a890c8782ff7f6e2d6b329fc8bf9636bd158a726a864d2cabf0572f4d09
Jul 31 21:16:08.965147 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.965114    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:16:08.965257 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.965176    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:16:08.965257 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:08.965206    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:16:09.222682 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:09.222641    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv" event={"ID":"ce7b7ebd-e300-46ae-8c29-c7259d3f2517","Type":"ContainerStarted","Data":"235ab84e3084bf8f8929c4834556f46f30abf1f9d014110b1d8b9ae462a37590"}
Jul 31 21:16:09.222871 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:09.222702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv" event={"ID":"ce7b7ebd-e300-46ae-8c29-c7259d3f2517","Type":"ContainerStarted","Data":"21157a890c8782ff7f6e2d6b329fc8bf9636bd158a726a864d2cabf0572f4d09"}
Jul 31 21:16:09.243034 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:09.242980    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv" podStartSLOduration=1.242962835 podStartE2EDuration="1.242962835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:16:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:16:09.240594478 +0000 UTC m=+2777.845888842" watchObservedRunningTime="2026-07-31 21:16:09.242962835 +0000 UTC m=+2777.848257198"
Jul 31 21:16:09.819331 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:09.819282    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:10.824509 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:10.824480    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:11.159565 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:11.159450    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:11.233567 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:11.233532    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:11.234447 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:11.234427    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:11.253719 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:11.253692    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:12.242774 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.242729    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"]
Jul 31 21:16:12.243239 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.243152    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8790733e-ca5b-4b23-a938-5c04f123ad65" containerName="istio-proxy"
Jul 31 21:16:12.243239 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.243171    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8790733e-ca5b-4b23-a938-5c04f123ad65" containerName="istio-proxy"
Jul 31 21:16:12.243378 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.243251    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8790733e-ca5b-4b23-a938-5c04f123ad65" containerName="istio-proxy"
Jul 31 21:16:12.246727 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.246705    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"
Jul 31 21:16:12.248755 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.248717    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-8de79c-serving-cert\""
Jul 31 21:16:12.254780 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.254758    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"]
Jul 31 21:16:12.271293 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.271252    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:12.411318 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.411279    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll6b5\" (UniqueName: \"kubernetes.io/projected/547d6511-7377-4536-aac1-9936f2e6685f-kube-api-access-ll6b5\") pod \"maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg\" (UID: \"547d6511-7377-4536-aac1-9936f2e6685f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"
Jul 31 21:16:12.411509 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.411372    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/547d6511-7377-4536-aac1-9936f2e6685f-maas-api-tls\") pod \"maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg\" (UID: \"547d6511-7377-4536-aac1-9936f2e6685f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"
Jul 31 21:16:12.411600 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.411499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/547d6511-7377-4536-aac1-9936f2e6685f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg\" (UID: \"547d6511-7377-4536-aac1-9936f2e6685f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"
Jul 31 21:16:12.512429 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.512337    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll6b5\" (UniqueName: \"kubernetes.io/projected/547d6511-7377-4536-aac1-9936f2e6685f-kube-api-access-ll6b5\") pod \"maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg\" (UID: \"547d6511-7377-4536-aac1-9936f2e6685f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"
Jul 31 21:16:12.512429 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.512380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/547d6511-7377-4536-aac1-9936f2e6685f-maas-api-tls\") pod \"maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg\" (UID: \"547d6511-7377-4536-aac1-9936f2e6685f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"
Jul 31 21:16:12.512429 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.512425    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/547d6511-7377-4536-aac1-9936f2e6685f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg\" (UID: \"547d6511-7377-4536-aac1-9936f2e6685f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"
Jul 31 21:16:12.512660 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:16:12.512556    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-serving-cert: secret "maas-api-e2e-shared-a-8de79c-serving-cert" not found
Jul 31 21:16:12.512660 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:16:12.512626    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/547d6511-7377-4536-aac1-9936f2e6685f-maas-api-tls podName:547d6511-7377-4536-aac1-9936f2e6685f nodeName:}" failed. No retries permitted until 2026-07-31 21:16:13.012609652 +0000 UTC m=+2781.617903992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/547d6511-7377-4536-aac1-9936f2e6685f-maas-api-tls") pod "maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg" (UID: "547d6511-7377-4536-aac1-9936f2e6685f") : secret "maas-api-e2e-shared-a-8de79c-serving-cert" not found
Jul 31 21:16:12.513085 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.513067    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/547d6511-7377-4536-aac1-9936f2e6685f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg\" (UID: \"547d6511-7377-4536-aac1-9936f2e6685f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"
Jul 31 21:16:12.522111 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.522089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll6b5\" (UniqueName: \"kubernetes.io/projected/547d6511-7377-4536-aac1-9936f2e6685f-kube-api-access-ll6b5\") pod \"maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg\" (UID: \"547d6511-7377-4536-aac1-9936f2e6685f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"
Jul 31 21:16:12.664906 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.664871    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:12.767184 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.767084    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:12.855944 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:12.855914    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:13.018337 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:13.018235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/547d6511-7377-4536-aac1-9936f2e6685f-maas-api-tls\") pod \"maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg\" (UID: \"547d6511-7377-4536-aac1-9936f2e6685f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"
Jul 31 21:16:13.021008 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:13.020973    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/547d6511-7377-4536-aac1-9936f2e6685f-maas-api-tls\") pod \"maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg\" (UID: \"547d6511-7377-4536-aac1-9936f2e6685f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"
Jul 31 21:16:13.160903 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:13.160866    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"
Jul 31 21:16:13.312566 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:13.312532    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"]
Jul 31 21:16:13.314023 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:16:13.313985    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod547d6511_7377_4536_aac1_9936f2e6685f.slice/crio-7d5999be01045ab126fb3e3216b32d07309cd495fd430df13c9abf34ede66852 WatchSource:0}: Error finding container 7d5999be01045ab126fb3e3216b32d07309cd495fd430df13c9abf34ede66852: Status 404 returned error can't find the container with id 7d5999be01045ab126fb3e3216b32d07309cd495fd430df13c9abf34ede66852
Jul 31 21:16:14.253195 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:14.253155    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg" event={"ID":"547d6511-7377-4536-aac1-9936f2e6685f","Type":"ContainerStarted","Data":"cd5e572becf2c49c5428fa4e68fbb7c9f7e27c9021a2c7c3304c44b8302f4dc9"}
Jul 31 21:16:14.253407 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:14.253215    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg" event={"ID":"547d6511-7377-4536-aac1-9936f2e6685f","Type":"ContainerStarted","Data":"7d5999be01045ab126fb3e3216b32d07309cd495fd430df13c9abf34ede66852"}
Jul 31 21:16:14.253407 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:14.253242    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"
Jul 31 21:16:14.268303 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:14.268249    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg" podStartSLOduration=1.880676073 podStartE2EDuration="2.268234405s" totalImagesPullingTime="387.558332ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:16:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:16:14.266063645 +0000 UTC m=+2782.871358020" watchObservedRunningTime="2026-07-31 21:16:14.268234405 +0000 UTC m=+2782.873528767"
Jul 31 21:16:20.270903 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:20.270873    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"
Jul 31 21:16:25.320576 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:25.320539    2565 generic.go:356] "Generic (PLEG): container finished" podID="ce7b7ebd-e300-46ae-8c29-c7259d3f2517" containerID="235ab84e3084bf8f8929c4834556f46f30abf1f9d014110b1d8b9ae462a37590" exitCode=0
Jul 31 21:16:25.321022 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:25.320608    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv" event={"ID":"ce7b7ebd-e300-46ae-8c29-c7259d3f2517","Type":"ContainerDied","Data":"235ab84e3084bf8f8929c4834556f46f30abf1f9d014110b1d8b9ae462a37590"}
Jul 31 21:16:25.321022 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:25.321005    2565 scope.go:117] "RemoveContainer" containerID="235ab84e3084bf8f8929c4834556f46f30abf1f9d014110b1d8b9ae462a37590"
Jul 31 21:16:25.322037 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:25.322006    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:16:25.322153 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:25.322093    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:16:25.322153 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:25.322141    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 31 21:16:26.233906 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:26.233869    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:26.328528 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:26.328495    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv" event={"ID":"ce7b7ebd-e300-46ae-8c29-c7259d3f2517","Type":"ContainerStarted","Data":"b8c9d77b39590a25d0dc81b2215f1a3cd08af654a220814d7c6730b5f516cd3f"}
Jul 31 21:16:26.819400 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:26.819363    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:26.820530 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:26.820505    2565 patch_prober.go:28] interesting pod/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 31 21:16:26.820647 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:26.820557    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv" podUID="ce7b7ebd-e300-46ae-8c29-c7259d3f2517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 31 21:16:27.820782 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:27.819320    2565 patch_prober.go:28] interesting pod/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 31 21:16:27.820782 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:27.819393    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv" podUID="ce7b7ebd-e300-46ae-8c29-c7259d3f2517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 31 21:16:28.819316 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:28.819275    2565 patch_prober.go:28] interesting pod/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 31 21:16:28.819498 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:28.819332    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv" podUID="ce7b7ebd-e300-46ae-8c29-c7259d3f2517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 31 21:16:29.820070 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:29.820031    2565 patch_prober.go:28] interesting pod/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 31 21:16:29.820483 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:29.820089    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv" podUID="ce7b7ebd-e300-46ae-8c29-c7259d3f2517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 31 21:16:30.820069 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:30.820029    2565 patch_prober.go:28] interesting pod/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 31 21:16:30.820260 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:30.820094    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv" podUID="ce7b7ebd-e300-46ae-8c29-c7259d3f2517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 31 21:16:31.823916 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:31.823885    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:31.824374 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:31.824178    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:31.824975 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:31.824956    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:16:36.137159 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:36.137119    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:36.475392 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:36.475342    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:36.783394 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:36.783308    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:37.128142 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:37.128060    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:39.336484 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:39.336443    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:39.429561 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:39.429524    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:40.406917 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:40.406888    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"]
Jul 31 21:16:40.419294 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:40.419264    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"
Jul 31 21:16:40.419832 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:40.419805    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"]
Jul 31 21:16:40.421449 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:40.421425    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-6938c5-serving-cert\""
Jul 31 21:16:40.447716 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:40.447680    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:40.491299 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:40.491259    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2rkc\" (UniqueName: \"kubernetes.io/projected/9b66542c-f15b-4fd3-a88f-230d3e523c46-kube-api-access-b2rkc\") pod \"maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf\" (UID: \"9b66542c-f15b-4fd3-a88f-230d3e523c46\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"
Jul 31 21:16:40.491471 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:40.491304    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b66542c-f15b-4fd3-a88f-230d3e523c46-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf\" (UID: \"9b66542c-f15b-4fd3-a88f-230d3e523c46\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"
Jul 31 21:16:40.491471 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:40.491443    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b66542c-f15b-4fd3-a88f-230d3e523c46-maas-api-tls\") pod \"maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf\" (UID: \"9b66542c-f15b-4fd3-a88f-230d3e523c46\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"
Jul 31 21:16:40.592906 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:40.592872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2rkc\" (UniqueName: \"kubernetes.io/projected/9b66542c-f15b-4fd3-a88f-230d3e523c46-kube-api-access-b2rkc\") pod \"maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf\" (UID: \"9b66542c-f15b-4fd3-a88f-230d3e523c46\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"
Jul 31 21:16:40.593082 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:40.592914    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b66542c-f15b-4fd3-a88f-230d3e523c46-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf\" (UID: \"9b66542c-f15b-4fd3-a88f-230d3e523c46\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"
Jul 31 21:16:40.593082 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:40.592993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b66542c-f15b-4fd3-a88f-230d3e523c46-maas-api-tls\") pod \"maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf\" (UID: \"9b66542c-f15b-4fd3-a88f-230d3e523c46\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"
Jul 31 21:16:40.593641 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:40.593616    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b66542c-f15b-4fd3-a88f-230d3e523c46-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf\" (UID: \"9b66542c-f15b-4fd3-a88f-230d3e523c46\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"
Jul 31 21:16:40.595599 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:40.595554    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b66542c-f15b-4fd3-a88f-230d3e523c46-maas-api-tls\") pod \"maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf\" (UID: \"9b66542c-f15b-4fd3-a88f-230d3e523c46\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"
Jul 31 21:16:40.596891 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:40.596860    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:40.599848 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:40.599828    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2rkc\" (UniqueName: \"kubernetes.io/projected/9b66542c-f15b-4fd3-a88f-230d3e523c46-kube-api-access-b2rkc\") pod \"maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf\" (UID: \"9b66542c-f15b-4fd3-a88f-230d3e523c46\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"
Jul 31 21:16:40.730942 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:40.730911    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"
Jul 31 21:16:40.873679 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:40.873654    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"]
Jul 31 21:16:40.875892 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:16:40.875862    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b66542c_f15b_4fd3_a88f_230d3e523c46.slice/crio-47ab68da224ae834d8d5b27700be960cb5deb685dae8947be3bcf12deea95c7d WatchSource:0}: Error finding container 47ab68da224ae834d8d5b27700be960cb5deb685dae8947be3bcf12deea95c7d: Status 404 returned error can't find the container with id 47ab68da224ae834d8d5b27700be960cb5deb685dae8947be3bcf12deea95c7d
Jul 31 21:16:40.936582 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:40.936549    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:41.031666 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:41.031570    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:41.421420 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:41.421391    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf" event={"ID":"9b66542c-f15b-4fd3-a88f-230d3e523c46","Type":"ContainerStarted","Data":"47ab68da224ae834d8d5b27700be960cb5deb685dae8947be3bcf12deea95c7d"}
Jul 31 21:16:42.429551 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:42.429513    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf" event={"ID":"9b66542c-f15b-4fd3-a88f-230d3e523c46","Type":"ContainerStarted","Data":"a3a2e3eba688081f1e03196b6892ebbb25770c6a50f75444aecc347462f1f437"}
Jul 31 21:16:42.430055 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:42.429580    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"
Jul 31 21:16:42.445095 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:42.445044    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf" podStartSLOduration=1.9408171429999999 podStartE2EDuration="2.445029213s" totalImagesPullingTime="504.21207ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:16:42.44302683 +0000 UTC m=+2811.048321194" watchObservedRunningTime="2026-07-31 21:16:42.445029213 +0000 UTC m=+2811.050323575"
Jul 31 21:16:46.599427 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:46.599395    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:16:48.441322 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:16:48.441290    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"
Jul 31 21:17:04.337438 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:17:04.337402    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:17:10.907696 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:17:10.907661    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:17:29.816483 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:17:29.816440    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:17:35.756415 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:17:35.756378    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:18:19.035824 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:18:19.035783    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:18:19.100904 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:18:19.100861    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:19:52.126214 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:19:52.126174    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 21:19:52.131225 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:19:52.131200    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 21:19:52.137670 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:19:52.137649    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 21:19:52.142621 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:19:52.142599    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 21:20:35.030836 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:20:35.030794    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:20:36.211577 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:20:36.211536    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:20:52.334895 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:20:52.334810    2565 scope.go:117] "RemoveContainer" containerID="9fe53e767fb3909c087dd4c6b709536e4fc3f0f93f08a0cb95e13702b1724b5d"
Jul 31 21:20:52.344399 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:20:52.344370    2565 scope.go:117] "RemoveContainer" containerID="ceed7578f8d9ec75f99f84e79b97c3e53e27a0f86c31b0222e76ff34a1967d3f"
Jul 31 21:20:52.442829 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:20:52.442789    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:20:53.523295 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:20:53.523263    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:20:59.611677 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:20:59.611644    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:21:17.209687 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:21:17.209634    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:21:25.155545 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:21:25.155510    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:21:48.075746 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:21:48.075713    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:22:01.897859 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:22:01.897824    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:22:01.949173 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:22:01.949134    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:22:06.896302 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:22:06.896260    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:22:44.377152 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:22:44.377038    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:22:45.217143 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:22:45.217112    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:22:56.983027 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:22:56.982992    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:23:20.678185 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:23:20.678141    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:23:25.208949 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:23:25.208916    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:24:33.281569 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:33.281531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:24:33.428355 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:33.428326    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:24:52.161833 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:52.161804    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 21:24:52.167079 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:52.167057    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 21:24:52.182748 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:52.182707    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 21:24:52.187536 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:52.187515    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 21:24:52.726153 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:52.726123    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:24:53.128537 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:53.128453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:24:53.225253 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:53.225219    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:24:56.013196 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:56.013164    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:24:56.112510 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:56.112471    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:24:57.106549 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.106514    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"]
Jul 31 21:24:57.110120 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.110103    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"
Jul 31 21:24:57.112240 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.112220    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-b4cb74-serving-cert\""
Jul 31 21:24:57.120282 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.120249    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"]
Jul 31 21:24:57.205665 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.205625    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:24:57.218895 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.218862    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/481fdbca-62c3-4b4a-926d-90938c9dc581-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7\" (UID: \"481fdbca-62c3-4b4a-926d-90938c9dc581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"
Jul 31 21:24:57.219075 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.218926    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nt24\" (UniqueName: \"kubernetes.io/projected/481fdbca-62c3-4b4a-926d-90938c9dc581-kube-api-access-8nt24\") pod \"maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7\" (UID: \"481fdbca-62c3-4b4a-926d-90938c9dc581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"
Jul 31 21:24:57.219075 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.219020    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/481fdbca-62c3-4b4a-926d-90938c9dc581-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7\" (UID: \"481fdbca-62c3-4b4a-926d-90938c9dc581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"
Jul 31 21:24:57.320442 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.320406    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/481fdbca-62c3-4b4a-926d-90938c9dc581-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7\" (UID: \"481fdbca-62c3-4b4a-926d-90938c9dc581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"
Jul 31 21:24:57.320617 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.320480    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nt24\" (UniqueName: \"kubernetes.io/projected/481fdbca-62c3-4b4a-926d-90938c9dc581-kube-api-access-8nt24\") pod \"maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7\" (UID: \"481fdbca-62c3-4b4a-926d-90938c9dc581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"
Jul 31 21:24:57.320617 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.320523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/481fdbca-62c3-4b4a-926d-90938c9dc581-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7\" (UID: \"481fdbca-62c3-4b4a-926d-90938c9dc581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"
Jul 31 21:24:57.320617 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:24:57.320578    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-serving-cert: secret "maas-api-e2e-ipp-a-b4cb74-serving-cert" not found
Jul 31 21:24:57.320720 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:24:57.320662    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/481fdbca-62c3-4b4a-926d-90938c9dc581-maas-api-tls podName:481fdbca-62c3-4b4a-926d-90938c9dc581 nodeName:}" failed. No retries permitted until 2026-07-31 21:24:57.820639684 +0000 UTC m=+3306.425934039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/481fdbca-62c3-4b4a-926d-90938c9dc581-maas-api-tls") pod "maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7" (UID: "481fdbca-62c3-4b4a-926d-90938c9dc581") : secret "maas-api-e2e-ipp-a-b4cb74-serving-cert" not found
Jul 31 21:24:57.321192 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.321172    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/481fdbca-62c3-4b4a-926d-90938c9dc581-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7\" (UID: \"481fdbca-62c3-4b4a-926d-90938c9dc581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"
Jul 31 21:24:57.328525 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.328501    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nt24\" (UniqueName: \"kubernetes.io/projected/481fdbca-62c3-4b4a-926d-90938c9dc581-kube-api-access-8nt24\") pod \"maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7\" (UID: \"481fdbca-62c3-4b4a-926d-90938c9dc581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"
Jul 31 21:24:57.638900 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.638868    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:24:57.728654 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.728618    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:24:57.736188 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.736158    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7"]
Jul 31 21:24:57.739571 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.739555    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7"
Jul 31 21:24:57.741747 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.741716    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-b4cb74\""
Jul 31 21:24:57.741893 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.741716    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-b4cb74-dockercfg-p8nn5\""
Jul 31 21:24:57.747991 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.747970    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7"]
Jul 31 21:24:57.782682 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.782650    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn"]
Jul 31 21:24:57.786172 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.786148    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn"
Jul 31 21:24:57.798412 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.798386    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn"]
Jul 31 21:24:57.825437 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.825393    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/481fdbca-62c3-4b4a-926d-90938c9dc581-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7\" (UID: \"481fdbca-62c3-4b4a-926d-90938c9dc581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"
Jul 31 21:24:57.825651 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.825444    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a59352df-533c-411f-8f83-737160742355-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7\" (UID: \"a59352df-533c-411f-8f83-737160742355\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7"
Jul 31 21:24:57.825651 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.825487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2p2g\" (UniqueName: \"kubernetes.io/projected/a59352df-533c-411f-8f83-737160742355-kube-api-access-q2p2g\") pod \"payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7\" (UID: \"a59352df-533c-411f-8f83-737160742355\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7"
Jul 31 21:24:57.838167 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.837927    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/481fdbca-62c3-4b4a-926d-90938c9dc581-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7\" (UID: \"481fdbca-62c3-4b4a-926d-90938c9dc581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"
Jul 31 21:24:57.926539 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.926443    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk7cr\" (UniqueName: \"kubernetes.io/projected/0fc7c3c9-decc-4560-9960-93bb24bd07c4-kube-api-access-mk7cr\") pod \"payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn\" (UID: \"0fc7c3c9-decc-4560-9960-93bb24bd07c4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn"
Jul 31 21:24:57.926539 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.926501    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fc7c3c9-decc-4560-9960-93bb24bd07c4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn\" (UID: \"0fc7c3c9-decc-4560-9960-93bb24bd07c4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn"
Jul 31 21:24:57.926836 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.926607    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a59352df-533c-411f-8f83-737160742355-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7\" (UID: \"a59352df-533c-411f-8f83-737160742355\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7"
Jul 31 21:24:57.926836 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.926661    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2p2g\" (UniqueName: \"kubernetes.io/projected/a59352df-533c-411f-8f83-737160742355-kube-api-access-q2p2g\") pod \"payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7\" (UID: \"a59352df-533c-411f-8f83-737160742355\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7"
Jul 31 21:24:57.927273 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.927249    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a59352df-533c-411f-8f83-737160742355-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7\" (UID: \"a59352df-533c-411f-8f83-737160742355\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7"
Jul 31 21:24:57.934671 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:57.934637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2p2g\" (UniqueName: \"kubernetes.io/projected/a59352df-533c-411f-8f83-737160742355-kube-api-access-q2p2g\") pod \"payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7\" (UID: \"a59352df-533c-411f-8f83-737160742355\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7"
Jul 31 21:24:58.021288 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:58.021245    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"
Jul 31 21:24:58.027746 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:58.027708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk7cr\" (UniqueName: \"kubernetes.io/projected/0fc7c3c9-decc-4560-9960-93bb24bd07c4-kube-api-access-mk7cr\") pod \"payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn\" (UID: \"0fc7c3c9-decc-4560-9960-93bb24bd07c4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn"
Jul 31 21:24:58.027922 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:58.027891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fc7c3c9-decc-4560-9960-93bb24bd07c4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn\" (UID: \"0fc7c3c9-decc-4560-9960-93bb24bd07c4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn"
Jul 31 21:24:58.028575 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:58.028549    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fc7c3c9-decc-4560-9960-93bb24bd07c4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn\" (UID: \"0fc7c3c9-decc-4560-9960-93bb24bd07c4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn"
Jul 31 21:24:58.035812 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:58.035793    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk7cr\" (UniqueName: \"kubernetes.io/projected/0fc7c3c9-decc-4560-9960-93bb24bd07c4-kube-api-access-mk7cr\") pod \"payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn\" (UID: \"0fc7c3c9-decc-4560-9960-93bb24bd07c4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn"
Jul 31 21:24:58.051660 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:58.051631    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7"
Jul 31 21:24:58.099010 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:58.098978    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn"
Jul 31 21:24:58.190398 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:58.190300    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"]
Jul 31 21:24:58.192872 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:24:58.192556    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod481fdbca_62c3_4b4a_926d_90938c9dc581.slice/crio-35b1ee5bcaedce27311b0528062a814a5febf4a21df9c2660a468be1381b0c4a WatchSource:0}: Error finding container 35b1ee5bcaedce27311b0528062a814a5febf4a21df9c2660a468be1381b0c4a: Status 404 returned error can't find the container with id 35b1ee5bcaedce27311b0528062a814a5febf4a21df9c2660a468be1381b0c4a
Jul 31 21:24:58.194177 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:58.194149    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 21:24:58.227273 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:58.227228    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7"]
Jul 31 21:24:58.267292 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:58.266985    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn"]
Jul 31 21:24:58.268948 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:24:58.268920    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc7c3c9_decc_4560_9960_93bb24bd07c4.slice/crio-b9b8aaacd902b03f68873411a7aa593c31e370b726ce72ab10fb714609e6872e WatchSource:0}: Error finding container b9b8aaacd902b03f68873411a7aa593c31e370b726ce72ab10fb714609e6872e: Status 404 returned error can't find the container with id b9b8aaacd902b03f68873411a7aa593c31e370b726ce72ab10fb714609e6872e
Jul 31 21:24:59.108012 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:59.107979    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn" event={"ID":"0fc7c3c9-decc-4560-9960-93bb24bd07c4","Type":"ContainerStarted","Data":"d2637b683497ee7b34f5d3ada062e59a1dfb53219196b0279a18528e80cd8aba"}
Jul 31 21:24:59.108217 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:59.108035    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn" event={"ID":"0fc7c3c9-decc-4560-9960-93bb24bd07c4","Type":"ContainerStarted","Data":"b9b8aaacd902b03f68873411a7aa593c31e370b726ce72ab10fb714609e6872e"}
Jul 31 21:24:59.108217 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:59.108155    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn"
Jul 31 21:24:59.109692 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:59.109664    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7" event={"ID":"481fdbca-62c3-4b4a-926d-90938c9dc581","Type":"ContainerStarted","Data":"c852b5b1099912b7be34d541823d18ace45ea0c8c980a31210db35e8b3a7eb1c"}
Jul 31 21:24:59.109828 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:59.109715    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7" event={"ID":"481fdbca-62c3-4b4a-926d-90938c9dc581","Type":"ContainerStarted","Data":"35b1ee5bcaedce27311b0528062a814a5febf4a21df9c2660a468be1381b0c4a"}
Jul 31 21:24:59.109828 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:59.109770    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"
Jul 31 21:24:59.111260 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:59.111240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7" event={"ID":"a59352df-533c-411f-8f83-737160742355","Type":"ContainerStarted","Data":"c72b5e95aa1fa15882e9adc9835aa53d623d9fc2b9aed937fcab166b55d8d5ea"}
Jul 31 21:24:59.111355 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:59.111274    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7" event={"ID":"a59352df-533c-411f-8f83-737160742355","Type":"ContainerStarted","Data":"38431a2cfa3ba1246dfb382c7631673ba8361ea0895c32313eff21805faeff80"}
Jul 31 21:24:59.111355 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:59.111304    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7"
Jul 31 21:24:59.123687 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:59.123649    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn" podStartSLOduration=2.12363445 podStartE2EDuration="2.12363445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:24:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:24:59.121115484 +0000 UTC m=+3307.726409870" watchObservedRunningTime="2026-07-31 21:24:59.12363445 +0000 UTC m=+3307.728928814"
Jul 31 21:24:59.136676 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:59.136631    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7" podStartSLOduration=2.136617362 podStartE2EDuration="2.136617362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:24:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:24:59.134564468 +0000 UTC m=+3307.739858831" watchObservedRunningTime="2026-07-31 21:24:59.136617362 +0000 UTC m=+3307.741911724"
Jul 31 21:24:59.150455 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:24:59.150396    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7" podStartSLOduration=1.732547601 podStartE2EDuration="2.150374061s" totalImagesPullingTime="417.82646ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:24:59.149265886 +0000 UTC m=+3307.754560270" watchObservedRunningTime="2026-07-31 21:24:59.150374061 +0000 UTC m=+3307.755668428"
Jul 31 21:25:05.122630 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:05.122596    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"
Jul 31 21:25:10.118936 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:10.118907    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7"
Jul 31 21:25:10.119428 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:10.118977    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn"
Jul 31 21:25:18.413786 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:18.413691    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:25:18.514298 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:18.514262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:25:21.009589 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:21.009553    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:25:21.721101 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:21.721067    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:25:22.020700 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:22.020618    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:25:22.348361 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:22.348282    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:25:25.145701 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:25.145666    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:25:25.247562 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:25.247527    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:25:26.451194 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:26.451161    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:25:26.655079 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:26.655041    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:25:27.013005 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.012972    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:25:27.110005 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.109963    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:25:27.114121 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.114092    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c"]
Jul 31 21:25:27.118805 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.118785    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c"
Jul 31 21:25:27.120918 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.120895    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-5c3fd2\""
Jul 31 21:25:27.121029 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.120956    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-5c3fd2-dockercfg-2btth\""
Jul 31 21:25:27.127566 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.127537    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c"]
Jul 31 21:25:27.149184 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.149151    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct"]
Jul 31 21:25:27.152725 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.152702    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct"
Jul 31 21:25:27.163833 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.163794    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct"]
Jul 31 21:25:27.197343 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.197298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b96e8fc3-4367-404d-8f5d-369050206263-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c\" (UID: \"b96e8fc3-4367-404d-8f5d-369050206263\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c"
Jul 31 21:25:27.197557 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.197360    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9ljn\" (UniqueName: \"kubernetes.io/projected/b96e8fc3-4367-404d-8f5d-369050206263-kube-api-access-g9ljn\") pod \"payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c\" (UID: \"b96e8fc3-4367-404d-8f5d-369050206263\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c"
Jul 31 21:25:27.197557 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.197416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7psz8\" (UniqueName: \"kubernetes.io/projected/673b7321-853c-40bf-a9c8-2ed52b3939df-kube-api-access-7psz8\") pod \"payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct\" (UID: \"673b7321-853c-40bf-a9c8-2ed52b3939df\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct"
Jul 31 21:25:27.197557 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.197448    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/673b7321-853c-40bf-a9c8-2ed52b3939df-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct\" (UID: \"673b7321-853c-40bf-a9c8-2ed52b3939df\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct"
Jul 31 21:25:27.298483 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.298397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9ljn\" (UniqueName: \"kubernetes.io/projected/b96e8fc3-4367-404d-8f5d-369050206263-kube-api-access-g9ljn\") pod \"payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c\" (UID: \"b96e8fc3-4367-404d-8f5d-369050206263\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c"
Jul 31 21:25:27.298483 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.298448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7psz8\" (UniqueName: \"kubernetes.io/projected/673b7321-853c-40bf-a9c8-2ed52b3939df-kube-api-access-7psz8\") pod \"payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct\" (UID: \"673b7321-853c-40bf-a9c8-2ed52b3939df\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct"
Jul 31 21:25:27.298483 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.298474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/673b7321-853c-40bf-a9c8-2ed52b3939df-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct\" (UID: \"673b7321-853c-40bf-a9c8-2ed52b3939df\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct"
Jul 31 21:25:27.298702 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.298560    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b96e8fc3-4367-404d-8f5d-369050206263-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c\" (UID: \"b96e8fc3-4367-404d-8f5d-369050206263\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c"
Jul 31 21:25:27.299293 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.299260    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b96e8fc3-4367-404d-8f5d-369050206263-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c\" (UID: \"b96e8fc3-4367-404d-8f5d-369050206263\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c"
Jul 31 21:25:27.299389 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.299371    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/673b7321-853c-40bf-a9c8-2ed52b3939df-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct\" (UID: \"673b7321-853c-40bf-a9c8-2ed52b3939df\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct"
Jul 31 21:25:27.306574 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.306544    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7psz8\" (UniqueName: \"kubernetes.io/projected/673b7321-853c-40bf-a9c8-2ed52b3939df-kube-api-access-7psz8\") pod \"payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct\" (UID: \"673b7321-853c-40bf-a9c8-2ed52b3939df\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct"
Jul 31 21:25:27.306720 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.306544    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9ljn\" (UniqueName: \"kubernetes.io/projected/b96e8fc3-4367-404d-8f5d-369050206263-kube-api-access-g9ljn\") pod \"payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c\" (UID: \"b96e8fc3-4367-404d-8f5d-369050206263\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c"
Jul 31 21:25:27.430336 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.430290    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c"
Jul 31 21:25:27.465715 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.465684    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct"
Jul 31 21:25:27.586818 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.586785    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c"]
Jul 31 21:25:27.588913 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:25:27.588879    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96e8fc3_4367_404d_8f5d_369050206263.slice/crio-d25cb3889f1afb63c76f4a1a437d9c9922b95e4db22244cc9a8ef27587a10b5c WatchSource:0}: Error finding container d25cb3889f1afb63c76f4a1a437d9c9922b95e4db22244cc9a8ef27587a10b5c: Status 404 returned error can't find the container with id d25cb3889f1afb63c76f4a1a437d9c9922b95e4db22244cc9a8ef27587a10b5c
Jul 31 21:25:27.625989 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:27.625958    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct"]
Jul 31 21:25:27.627087 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:25:27.627043    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod673b7321_853c_40bf_a9c8_2ed52b3939df.slice/crio-aa816ca6f73a8033c457e144a438bb33d306970db8e4a763393666783b941615 WatchSource:0}: Error finding container aa816ca6f73a8033c457e144a438bb33d306970db8e4a763393666783b941615: Status 404 returned error can't find the container with id aa816ca6f73a8033c457e144a438bb33d306970db8e4a763393666783b941615
Jul 31 21:25:28.281375 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:28.281339    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c" event={"ID":"b96e8fc3-4367-404d-8f5d-369050206263","Type":"ContainerStarted","Data":"7fc5ab624d0130980b384826da5e507cd75988c0ff33cc2fd58c015123696874"}
Jul 31 21:25:28.281561 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:28.281397    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c" event={"ID":"b96e8fc3-4367-404d-8f5d-369050206263","Type":"ContainerStarted","Data":"d25cb3889f1afb63c76f4a1a437d9c9922b95e4db22244cc9a8ef27587a10b5c"}
Jul 31 21:25:28.281561 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:28.281429    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c"
Jul 31 21:25:28.282988 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:28.282961    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct" event={"ID":"673b7321-853c-40bf-a9c8-2ed52b3939df","Type":"ContainerStarted","Data":"66ca64b0c71b6db70023343bccf0d34af1ae44679a22c0ac74d782ae235d0e23"}
Jul 31 21:25:28.283120 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:28.283010    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct" event={"ID":"673b7321-853c-40bf-a9c8-2ed52b3939df","Type":"ContainerStarted","Data":"aa816ca6f73a8033c457e144a438bb33d306970db8e4a763393666783b941615"}
Jul 31 21:25:28.283120 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:28.283086    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct"
Jul 31 21:25:28.297529 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:28.297449    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c" podStartSLOduration=1.297434673 podStartE2EDuration="1.297434673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:25:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:25:28.294958167 +0000 UTC m=+3336.900252531" watchObservedRunningTime="2026-07-31 21:25:28.297434673 +0000 UTC m=+3336.902729036"
Jul 31 21:25:28.310690 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:28.310638    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct" podStartSLOduration=1.310624061 podStartE2EDuration="1.310624061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:25:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:25:28.309170887 +0000 UTC m=+3336.914465250" watchObservedRunningTime="2026-07-31 21:25:28.310624061 +0000 UTC m=+3336.915918763"
Jul 31 21:25:39.292593 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:39.292557    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct"
Jul 31 21:25:39.293134 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:39.292793    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c"
Jul 31 21:25:50.184852 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:50.184807    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:25:57.247752 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:25:57.247708    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct_673b7321-853c-40bf-a9c8-2ed52b3939df/payload-processing/0.log"
Jul 31 21:26:04.978234 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:04.978202    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:26:42.045436 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:42.045403    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn_0fc7c3c9-decc-4560-9960-93bb24bd07c4/payload-processing/0.log"
Jul 31 21:26:42.295103 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:42.295071    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct_673b7321-853c-40bf-a9c8-2ed52b3939df/payload-processing/0.log"
Jul 31 21:26:42.570595 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:42.570531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:26:42.888146 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:42.888032    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:26:43.057283 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:43.057251    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:26:45.576530 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:45.576483    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:26:45.675145 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:45.675115    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:26:46.682866 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:46.682832    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:26:47.029985 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.029897    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:26:47.213320 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.213283    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:26:47.314048 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.313952    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:26:47.337488 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.337450    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct"]
Jul 31 21:26:47.341132 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.341113    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct"
Jul 31 21:26:47.343062 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.343040    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-69e90d\""
Jul 31 21:26:47.343203 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.343077    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-69e90d-dockercfg-lf8hp\""
Jul 31 21:26:47.351493 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.351469    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct"]
Jul 31 21:26:47.355789 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.355761    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xzvp\" (UniqueName: \"kubernetes.io/projected/c76622c0-90a1-4250-9a25-3c84459bac44-kube-api-access-7xzvp\") pod \"payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct\" (UID: \"c76622c0-90a1-4250-9a25-3c84459bac44\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct"
Jul 31 21:26:47.355892 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.355855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c76622c0-90a1-4250-9a25-3c84459bac44-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct\" (UID: \"c76622c0-90a1-4250-9a25-3c84459bac44\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct"
Jul 31 21:26:47.386381 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.386352    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9"]
Jul 31 21:26:47.389771 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.389754    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9"
Jul 31 21:26:47.397729 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.397691    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9"]
Jul 31 21:26:47.456260 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.456230    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c76622c0-90a1-4250-9a25-3c84459bac44-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct\" (UID: \"c76622c0-90a1-4250-9a25-3c84459bac44\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct"
Jul 31 21:26:47.456446 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.456316    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dltj\" (UniqueName: \"kubernetes.io/projected/85e9950f-217e-4cfa-9db4-9dc573b6a6d8-kube-api-access-5dltj\") pod \"payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9\" (UID: \"85e9950f-217e-4cfa-9db4-9dc573b6a6d8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9"
Jul 31 21:26:47.456446 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.456365    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85e9950f-217e-4cfa-9db4-9dc573b6a6d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9\" (UID: \"85e9950f-217e-4cfa-9db4-9dc573b6a6d8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9"
Jul 31 21:26:47.456446 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.456403    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xzvp\" (UniqueName: \"kubernetes.io/projected/c76622c0-90a1-4250-9a25-3c84459bac44-kube-api-access-7xzvp\") pod \"payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct\" (UID: \"c76622c0-90a1-4250-9a25-3c84459bac44\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct"
Jul 31 21:26:47.457083 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.457064    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c76622c0-90a1-4250-9a25-3c84459bac44-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct\" (UID: \"c76622c0-90a1-4250-9a25-3c84459bac44\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct"
Jul 31 21:26:47.464149 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.464116    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xzvp\" (UniqueName: \"kubernetes.io/projected/c76622c0-90a1-4250-9a25-3c84459bac44-kube-api-access-7xzvp\") pod \"payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct\" (UID: \"c76622c0-90a1-4250-9a25-3c84459bac44\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct"
Jul 31 21:26:47.557178 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.557139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dltj\" (UniqueName: \"kubernetes.io/projected/85e9950f-217e-4cfa-9db4-9dc573b6a6d8-kube-api-access-5dltj\") pod \"payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9\" (UID: \"85e9950f-217e-4cfa-9db4-9dc573b6a6d8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9"
Jul 31 21:26:47.557386 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.557189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85e9950f-217e-4cfa-9db4-9dc573b6a6d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9\" (UID: \"85e9950f-217e-4cfa-9db4-9dc573b6a6d8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9"
Jul 31 21:26:47.558163 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.558140    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85e9950f-217e-4cfa-9db4-9dc573b6a6d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9\" (UID: \"85e9950f-217e-4cfa-9db4-9dc573b6a6d8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9"
Jul 31 21:26:47.564870 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.564793    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dltj\" (UniqueName: \"kubernetes.io/projected/85e9950f-217e-4cfa-9db4-9dc573b6a6d8-kube-api-access-5dltj\") pod \"payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9\" (UID: \"85e9950f-217e-4cfa-9db4-9dc573b6a6d8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9"
Jul 31 21:26:47.652807 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.652771    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct"
Jul 31 21:26:47.702219 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.702187    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9"
Jul 31 21:26:47.805425 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.805391    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct"]
Jul 31 21:26:47.806961 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:26:47.806937    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc76622c0_90a1_4250_9a25_3c84459bac44.slice/crio-0c95d1a0cb4ee5c6011712a17c3746180c57251ef6a90cd10be4857f80cd8d1a WatchSource:0}: Error finding container 0c95d1a0cb4ee5c6011712a17c3746180c57251ef6a90cd10be4857f80cd8d1a: Status 404 returned error can't find the container with id 0c95d1a0cb4ee5c6011712a17c3746180c57251ef6a90cd10be4857f80cd8d1a
Jul 31 21:26:47.864011 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:47.863980    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9"]
Jul 31 21:26:47.865699 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:26:47.865674    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85e9950f_217e_4cfa_9db4_9dc573b6a6d8.slice/crio-f5c2eaca7d72dd76a92f4f3d3bb428d639253fca2537851825ea28f5297196ea WatchSource:0}: Error finding container f5c2eaca7d72dd76a92f4f3d3bb428d639253fca2537851825ea28f5297196ea: Status 404 returned error can't find the container with id f5c2eaca7d72dd76a92f4f3d3bb428d639253fca2537851825ea28f5297196ea
Jul 31 21:26:48.740966 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:48.740920    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct" event={"ID":"c76622c0-90a1-4250-9a25-3c84459bac44","Type":"ContainerStarted","Data":"ffb13e47252b50a80600a91d306be03e83f46cfb1087c1597a401021d5e244e0"}
Jul 31 21:26:48.741446 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:48.741107    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct"
Jul 31 21:26:48.741446 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:48.741163    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct" event={"ID":"c76622c0-90a1-4250-9a25-3c84459bac44","Type":"ContainerStarted","Data":"0c95d1a0cb4ee5c6011712a17c3746180c57251ef6a90cd10be4857f80cd8d1a"}
Jul 31 21:26:48.742460 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:48.742435    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9" event={"ID":"85e9950f-217e-4cfa-9db4-9dc573b6a6d8","Type":"ContainerStarted","Data":"1b36f68281aa1fe60d020ce526a1fafa77a2eeccdf1d67aec7150ff99b05be08"}
Jul 31 21:26:48.742586 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:48.742480    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9" event={"ID":"85e9950f-217e-4cfa-9db4-9dc573b6a6d8","Type":"ContainerStarted","Data":"f5c2eaca7d72dd76a92f4f3d3bb428d639253fca2537851825ea28f5297196ea"}
Jul 31 21:26:48.742586 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:48.742550    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9"
Jul 31 21:26:48.758223 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:48.758169    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct" podStartSLOduration=1.75815253 podStartE2EDuration="1.75815253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:26:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:48.755130791 +0000 UTC m=+3417.360425155" watchObservedRunningTime="2026-07-31 21:26:48.75815253 +0000 UTC m=+3417.363446892"
Jul 31 21:26:48.772749 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:48.772675    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9" podStartSLOduration=1.772653644 podStartE2EDuration="1.772653644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:26:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:48.77032328 +0000 UTC m=+3417.375617649" watchObservedRunningTime="2026-07-31 21:26:48.772653644 +0000 UTC m=+3417.377948009"
Jul 31 21:26:59.750948 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:59.750913    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9"
Jul 31 21:26:59.751541 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:26:59.750998    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct"
Jul 31 21:27:10.604760 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:10.604693    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:27:17.147681 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.147648    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:27:17.176387 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.176358    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct"]
Jul 31 21:27:17.177148 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.176632    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct" podUID="c76622c0-90a1-4250-9a25-3c84459bac44" containerName="payload-processing" containerID="cri-o://ffb13e47252b50a80600a91d306be03e83f46cfb1087c1597a401021d5e244e0" gracePeriod=30
Jul 31 21:27:17.186212 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.186185    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9"]
Jul 31 21:27:17.186451 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.186395    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9" podUID="85e9950f-217e-4cfa-9db4-9dc573b6a6d8" containerName="payload-pre-processing" containerID="cri-o://1b36f68281aa1fe60d020ce526a1fafa77a2eeccdf1d67aec7150ff99b05be08" gracePeriod=30
Jul 31 21:27:17.217646 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.217594    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:27:17.283997 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.283960    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:27:17.385093 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.385007    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:27:17.459751 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.459719    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct"
Jul 31 21:27:17.481974 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.481947    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9"
Jul 31 21:27:17.538076 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.538043    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xzvp\" (UniqueName: \"kubernetes.io/projected/c76622c0-90a1-4250-9a25-3c84459bac44-kube-api-access-7xzvp\") pod \"c76622c0-90a1-4250-9a25-3c84459bac44\" (UID: \"c76622c0-90a1-4250-9a25-3c84459bac44\") "
Jul 31 21:27:17.538259 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.538159    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c76622c0-90a1-4250-9a25-3c84459bac44-plugins-config-volume\") pod \"c76622c0-90a1-4250-9a25-3c84459bac44\" (UID: \"c76622c0-90a1-4250-9a25-3c84459bac44\") "
Jul 31 21:27:17.538531 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.538502    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c76622c0-90a1-4250-9a25-3c84459bac44-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c76622c0-90a1-4250-9a25-3c84459bac44" (UID: "c76622c0-90a1-4250-9a25-3c84459bac44"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:27:17.540317 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.540295    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c76622c0-90a1-4250-9a25-3c84459bac44-kube-api-access-7xzvp" (OuterVolumeSpecName: "kube-api-access-7xzvp") pod "c76622c0-90a1-4250-9a25-3c84459bac44" (UID: "c76622c0-90a1-4250-9a25-3c84459bac44"). InnerVolumeSpecName "kube-api-access-7xzvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:27:17.639165 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.639126    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85e9950f-217e-4cfa-9db4-9dc573b6a6d8-plugins-config-volume\") pod \"85e9950f-217e-4cfa-9db4-9dc573b6a6d8\" (UID: \"85e9950f-217e-4cfa-9db4-9dc573b6a6d8\") "
Jul 31 21:27:17.639335 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.639174    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dltj\" (UniqueName: \"kubernetes.io/projected/85e9950f-217e-4cfa-9db4-9dc573b6a6d8-kube-api-access-5dltj\") pod \"85e9950f-217e-4cfa-9db4-9dc573b6a6d8\" (UID: \"85e9950f-217e-4cfa-9db4-9dc573b6a6d8\") "
Jul 31 21:27:17.639484 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.639454    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xzvp\" (UniqueName: \"kubernetes.io/projected/c76622c0-90a1-4250-9a25-3c84459bac44-kube-api-access-7xzvp\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:27:17.639545 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.639491    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c76622c0-90a1-4250-9a25-3c84459bac44-plugins-config-volume\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:27:17.639545 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.639507    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85e9950f-217e-4cfa-9db4-9dc573b6a6d8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "85e9950f-217e-4cfa-9db4-9dc573b6a6d8" (UID: "85e9950f-217e-4cfa-9db4-9dc573b6a6d8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:27:17.641366 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.641344    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85e9950f-217e-4cfa-9db4-9dc573b6a6d8-kube-api-access-5dltj" (OuterVolumeSpecName: "kube-api-access-5dltj") pod "85e9950f-217e-4cfa-9db4-9dc573b6a6d8" (UID: "85e9950f-217e-4cfa-9db4-9dc573b6a6d8"). InnerVolumeSpecName "kube-api-access-5dltj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:27:17.703316 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.703281    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:27:17.740799 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.740771    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85e9950f-217e-4cfa-9db4-9dc573b6a6d8-plugins-config-volume\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:27:17.740799 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.740798    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dltj\" (UniqueName: \"kubernetes.io/projected/85e9950f-217e-4cfa-9db4-9dc573b6a6d8-kube-api-access-5dltj\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:27:17.921501 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.921462    2565 generic.go:356] "Generic (PLEG): container finished" podID="c76622c0-90a1-4250-9a25-3c84459bac44" containerID="ffb13e47252b50a80600a91d306be03e83f46cfb1087c1597a401021d5e244e0" exitCode=0
Jul 31 21:27:17.921501 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.921496    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct"
Jul 31 21:27:17.921830 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.921552    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct" event={"ID":"c76622c0-90a1-4250-9a25-3c84459bac44","Type":"ContainerDied","Data":"ffb13e47252b50a80600a91d306be03e83f46cfb1087c1597a401021d5e244e0"}
Jul 31 21:27:17.921830 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.921612    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct" event={"ID":"c76622c0-90a1-4250-9a25-3c84459bac44","Type":"ContainerDied","Data":"0c95d1a0cb4ee5c6011712a17c3746180c57251ef6a90cd10be4857f80cd8d1a"}
Jul 31 21:27:17.921830 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.921645    2565 scope.go:117] "RemoveContainer" containerID="ffb13e47252b50a80600a91d306be03e83f46cfb1087c1597a401021d5e244e0"
Jul 31 21:27:17.923052 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.923029    2565 generic.go:356] "Generic (PLEG): container finished" podID="85e9950f-217e-4cfa-9db4-9dc573b6a6d8" containerID="1b36f68281aa1fe60d020ce526a1fafa77a2eeccdf1d67aec7150ff99b05be08" exitCode=0
Jul 31 21:27:17.923148 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.923061    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9" event={"ID":"85e9950f-217e-4cfa-9db4-9dc573b6a6d8","Type":"ContainerDied","Data":"1b36f68281aa1fe60d020ce526a1fafa77a2eeccdf1d67aec7150ff99b05be08"}
Jul 31 21:27:17.923148 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.923073    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9"
Jul 31 21:27:17.923148 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.923105    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9" event={"ID":"85e9950f-217e-4cfa-9db4-9dc573b6a6d8","Type":"ContainerDied","Data":"f5c2eaca7d72dd76a92f4f3d3bb428d639253fca2537851825ea28f5297196ea"}
Jul 31 21:27:17.934097 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.934076    2565 scope.go:117] "RemoveContainer" containerID="ffb13e47252b50a80600a91d306be03e83f46cfb1087c1597a401021d5e244e0"
Jul 31 21:27:17.934347 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:27:17.934325    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffb13e47252b50a80600a91d306be03e83f46cfb1087c1597a401021d5e244e0\": container with ID starting with ffb13e47252b50a80600a91d306be03e83f46cfb1087c1597a401021d5e244e0 not found: ID does not exist" containerID="ffb13e47252b50a80600a91d306be03e83f46cfb1087c1597a401021d5e244e0"
Jul 31 21:27:17.934435 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.934354    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb13e47252b50a80600a91d306be03e83f46cfb1087c1597a401021d5e244e0"} err="failed to get container status \"ffb13e47252b50a80600a91d306be03e83f46cfb1087c1597a401021d5e244e0\": rpc error: code = NotFound desc = could not find container \"ffb13e47252b50a80600a91d306be03e83f46cfb1087c1597a401021d5e244e0\": container with ID starting with ffb13e47252b50a80600a91d306be03e83f46cfb1087c1597a401021d5e244e0 not found: ID does not exist"
Jul 31 21:27:17.934435 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.934377    2565 scope.go:117] "RemoveContainer" containerID="1b36f68281aa1fe60d020ce526a1fafa77a2eeccdf1d67aec7150ff99b05be08"
Jul 31 21:27:17.944370 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.944347    2565 scope.go:117] "RemoveContainer" containerID="1b36f68281aa1fe60d020ce526a1fafa77a2eeccdf1d67aec7150ff99b05be08"
Jul 31 21:27:17.944677 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:27:17.944634    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b36f68281aa1fe60d020ce526a1fafa77a2eeccdf1d67aec7150ff99b05be08\": container with ID starting with 1b36f68281aa1fe60d020ce526a1fafa77a2eeccdf1d67aec7150ff99b05be08 not found: ID does not exist" containerID="1b36f68281aa1fe60d020ce526a1fafa77a2eeccdf1d67aec7150ff99b05be08"
Jul 31 21:27:17.944798 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.944668    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b36f68281aa1fe60d020ce526a1fafa77a2eeccdf1d67aec7150ff99b05be08"} err="failed to get container status \"1b36f68281aa1fe60d020ce526a1fafa77a2eeccdf1d67aec7150ff99b05be08\": rpc error: code = NotFound desc = could not find container \"1b36f68281aa1fe60d020ce526a1fafa77a2eeccdf1d67aec7150ff99b05be08\": container with ID starting with 1b36f68281aa1fe60d020ce526a1fafa77a2eeccdf1d67aec7150ff99b05be08 not found: ID does not exist"
Jul 31 21:27:17.945754 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.945719    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct"]
Jul 31 21:27:17.948298 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.948268    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-69e90d-57dc7fcd58-zkfct"]
Jul 31 21:27:17.956832 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.956779    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9"]
Jul 31 21:27:17.958949 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:17.958928    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-69e90d-5b775999d8-p87f9"]
Jul 31 21:27:19.916311 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:19.916261    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85e9950f-217e-4cfa-9db4-9dc573b6a6d8" path="/var/lib/kubelet/pods/85e9950f-217e-4cfa-9db4-9dc573b6a6d8/volumes"
Jul 31 21:27:19.916714 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:19.916698    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c76622c0-90a1-4250-9a25-3c84459bac44" path="/var/lib/kubelet/pods/c76622c0-90a1-4250-9a25-3c84459bac44/volumes"
Jul 31 21:27:23.539134 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:23.539104    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:27:23.604076 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:23.604044    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:27:23.826049 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:23.825961    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:27:24.042381 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:24.042343    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:27:27.461177 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:27.461139    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4cb74-cgtlr"]
Jul 31 21:27:27.461563 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:27.461549    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85e9950f-217e-4cfa-9db4-9dc573b6a6d8" containerName="payload-pre-processing"
Jul 31 21:27:27.461563 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:27.461564    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="85e9950f-217e-4cfa-9db4-9dc573b6a6d8" containerName="payload-pre-processing"
Jul 31 21:27:27.461635 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:27.461582    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c76622c0-90a1-4250-9a25-3c84459bac44" containerName="payload-processing"
Jul 31 21:27:27.461635 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:27.461588    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c76622c0-90a1-4250-9a25-3c84459bac44" containerName="payload-processing"
Jul 31 21:27:27.461757 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:27.461645    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="85e9950f-217e-4cfa-9db4-9dc573b6a6d8" containerName="payload-pre-processing"
Jul 31 21:27:27.461757 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:27.461655    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c76622c0-90a1-4250-9a25-3c84459bac44" containerName="payload-processing"
Jul 31 21:27:27.465988 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:27.465972    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4cb74-cgtlr"
Jul 31 21:27:27.468038 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:27.468013    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 21:27:27.471355 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:27.471331    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4cb74-cgtlr"]
Jul 31 21:27:27.639346 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:27.639317    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7fbe52c-c9cd-4698-a162-d236bf7018bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b4cb74-cgtlr\" (UID: \"e7fbe52c-c9cd-4698-a162-d236bf7018bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4cb74-cgtlr"
Jul 31 21:27:27.740074 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:27.739987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7fbe52c-c9cd-4698-a162-d236bf7018bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b4cb74-cgtlr\" (UID: \"e7fbe52c-c9cd-4698-a162-d236bf7018bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4cb74-cgtlr"
Jul 31 21:27:27.740680 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:27.740658    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7fbe52c-c9cd-4698-a162-d236bf7018bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b4cb74-cgtlr\" (UID: \"e7fbe52c-c9cd-4698-a162-d236bf7018bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4cb74-cgtlr"
Jul 31 21:27:27.779929 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:27.779893    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4cb74-cgtlr"
Jul 31 21:27:27.931686 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:27.931659    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4cb74-cgtlr"]
Jul 31 21:27:27.934549 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:27:27.934522    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7fbe52c_c9cd_4698_a162_d236bf7018bc.slice/crio-85c121750f6ae2f460da1275fcd7ad8939edd75e02b1c1e3f46cb786d1f0a32e WatchSource:0}: Error finding container 85c121750f6ae2f460da1275fcd7ad8939edd75e02b1c1e3f46cb786d1f0a32e: Status 404 returned error can't find the container with id 85c121750f6ae2f460da1275fcd7ad8939edd75e02b1c1e3f46cb786d1f0a32e
Jul 31 21:27:27.981338 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:27.981304    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4cb74-cgtlr" event={"ID":"e7fbe52c-c9cd-4698-a162-d236bf7018bc","Type":"ContainerStarted","Data":"85c121750f6ae2f460da1275fcd7ad8939edd75e02b1c1e3f46cb786d1f0a32e"}
Jul 31 21:27:28.989649 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:28.989615    2565 generic.go:356] "Generic (PLEG): container finished" podID="e7fbe52c-c9cd-4698-a162-d236bf7018bc" containerID="84bde482ce19f9e379f9f9d31982bf80a60e728262300445b9c49e2bc144c1e0" exitCode=0
Jul 31 21:27:28.990082 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:28.989703    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4cb74-cgtlr" event={"ID":"e7fbe52c-c9cd-4698-a162-d236bf7018bc","Type":"ContainerDied","Data":"84bde482ce19f9e379f9f9d31982bf80a60e728262300445b9c49e2bc144c1e0"}
Jul 31 21:27:30.136509 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:30.136486    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4cb74-cgtlr"
Jul 31 21:27:30.162416 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:30.162383    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7fbe52c-c9cd-4698-a162-d236bf7018bc-maas-api-service-ca\") pod \"e7fbe52c-c9cd-4698-a162-d236bf7018bc\" (UID: \"e7fbe52c-c9cd-4698-a162-d236bf7018bc\") "
Jul 31 21:27:30.163070 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:30.163045    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7fbe52c-c9cd-4698-a162-d236bf7018bc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e7fbe52c-c9cd-4698-a162-d236bf7018bc" (UID: "e7fbe52c-c9cd-4698-a162-d236bf7018bc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:27:30.263561 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:30.263478    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7fbe52c-c9cd-4698-a162-d236bf7018bc-maas-api-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:27:31.003276 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:31.003242    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4cb74-cgtlr"
Jul 31 21:27:31.003539 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:31.003277    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4cb74-cgtlr" event={"ID":"e7fbe52c-c9cd-4698-a162-d236bf7018bc","Type":"ContainerDied","Data":"85c121750f6ae2f460da1275fcd7ad8939edd75e02b1c1e3f46cb786d1f0a32e"}
Jul 31 21:27:31.003539 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:31.003334    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85c121750f6ae2f460da1275fcd7ad8939edd75e02b1c1e3f46cb786d1f0a32e"
Jul 31 21:27:42.910192 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:42.910159    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"]
Jul 31 21:27:42.910694 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:42.910347    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7" podUID="481fdbca-62c3-4b4a-926d-90938c9dc581" containerName="maas-api" containerID="cri-o://c852b5b1099912b7be34d541823d18ace45ea0c8c980a31210db35e8b3a7eb1c" gracePeriod=30
Jul 31 21:27:42.935273 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:42.935224    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:27:42.963507 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:42.963471    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn"]
Jul 31 21:27:42.963814 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:42.963764    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn" podUID="0fc7c3c9-decc-4560-9960-93bb24bd07c4" containerName="payload-processing" containerID="cri-o://d2637b683497ee7b34f5d3ada062e59a1dfb53219196b0279a18528e80cd8aba" gracePeriod=30
Jul 31 21:27:42.973543 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:42.973513    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7"]
Jul 31 21:27:42.974179 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:42.974055    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7" podUID="a59352df-533c-411f-8f83-737160742355" containerName="payload-pre-processing" containerID="cri-o://c72b5e95aa1fa15882e9adc9835aa53d623d9fc2b9aed937fcab166b55d8d5ea" gracePeriod=30
Jul 31 21:27:43.017163 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.017127    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:27:43.072915 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.072877    2565 generic.go:356] "Generic (PLEG): container finished" podID="481fdbca-62c3-4b4a-926d-90938c9dc581" containerID="c852b5b1099912b7be34d541823d18ace45ea0c8c980a31210db35e8b3a7eb1c" exitCode=0
Jul 31 21:27:43.073056 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.072959    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7" event={"ID":"481fdbca-62c3-4b4a-926d-90938c9dc581","Type":"ContainerDied","Data":"c852b5b1099912b7be34d541823d18ace45ea0c8c980a31210db35e8b3a7eb1c"}
Jul 31 21:27:43.082037 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.082008    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:27:43.103327 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.103292    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4cb74-cgtlr"]
Jul 31 21:27:43.105870 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.105844    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b4cb74-cgtlr"]
Jul 31 21:27:43.182987 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.182945    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:27:43.254883 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.254552    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn"
Jul 31 21:27:43.280619 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.280507    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk7cr\" (UniqueName: \"kubernetes.io/projected/0fc7c3c9-decc-4560-9960-93bb24bd07c4-kube-api-access-mk7cr\") pod \"0fc7c3c9-decc-4560-9960-93bb24bd07c4\" (UID: \"0fc7c3c9-decc-4560-9960-93bb24bd07c4\") "
Jul 31 21:27:43.280619 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.280550    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fc7c3c9-decc-4560-9960-93bb24bd07c4-plugins-config-volume\") pod \"0fc7c3c9-decc-4560-9960-93bb24bd07c4\" (UID: \"0fc7c3c9-decc-4560-9960-93bb24bd07c4\") "
Jul 31 21:27:43.281097 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.280990    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fc7c3c9-decc-4560-9960-93bb24bd07c4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0fc7c3c9-decc-4560-9960-93bb24bd07c4" (UID: "0fc7c3c9-decc-4560-9960-93bb24bd07c4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:27:43.285572 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.285546    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fc7c3c9-decc-4560-9960-93bb24bd07c4-kube-api-access-mk7cr" (OuterVolumeSpecName: "kube-api-access-mk7cr") pod "0fc7c3c9-decc-4560-9960-93bb24bd07c4" (UID: "0fc7c3c9-decc-4560-9960-93bb24bd07c4"). InnerVolumeSpecName "kube-api-access-mk7cr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:27:43.299723 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.299704    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"
Jul 31 21:27:43.318457 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.318430    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7"
Jul 31 21:27:43.382012 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.381983    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/481fdbca-62c3-4b4a-926d-90938c9dc581-openshift-service-ca\") pod \"481fdbca-62c3-4b4a-926d-90938c9dc581\" (UID: \"481fdbca-62c3-4b4a-926d-90938c9dc581\") "
Jul 31 21:27:43.382181 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.382069    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nt24\" (UniqueName: \"kubernetes.io/projected/481fdbca-62c3-4b4a-926d-90938c9dc581-kube-api-access-8nt24\") pod \"481fdbca-62c3-4b4a-926d-90938c9dc581\" (UID: \"481fdbca-62c3-4b4a-926d-90938c9dc581\") "
Jul 31 21:27:43.382181 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.382114    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/481fdbca-62c3-4b4a-926d-90938c9dc581-maas-api-tls\") pod \"481fdbca-62c3-4b4a-926d-90938c9dc581\" (UID: \"481fdbca-62c3-4b4a-926d-90938c9dc581\") "
Jul 31 21:27:43.382181 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.382141    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a59352df-533c-411f-8f83-737160742355-plugins-config-volume\") pod \"a59352df-533c-411f-8f83-737160742355\" (UID: \"a59352df-533c-411f-8f83-737160742355\") "
Jul 31 21:27:43.382356 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.382302    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2p2g\" (UniqueName: \"kubernetes.io/projected/a59352df-533c-411f-8f83-737160742355-kube-api-access-q2p2g\") pod \"a59352df-533c-411f-8f83-737160742355\" (UID: \"a59352df-533c-411f-8f83-737160742355\") "
Jul 31 21:27:43.382439 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.382414    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/481fdbca-62c3-4b4a-926d-90938c9dc581-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "481fdbca-62c3-4b4a-926d-90938c9dc581" (UID: "481fdbca-62c3-4b4a-926d-90938c9dc581"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:27:43.382545 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.382515    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a59352df-533c-411f-8f83-737160742355-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a59352df-533c-411f-8f83-737160742355" (UID: "a59352df-533c-411f-8f83-737160742355"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:27:43.382681 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.382663    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/481fdbca-62c3-4b4a-926d-90938c9dc581-openshift-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:27:43.382782 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.382684    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a59352df-533c-411f-8f83-737160742355-plugins-config-volume\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:27:43.382782 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.382694    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk7cr\" (UniqueName: \"kubernetes.io/projected/0fc7c3c9-decc-4560-9960-93bb24bd07c4-kube-api-access-mk7cr\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:27:43.382782 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.382702    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fc7c3c9-decc-4560-9960-93bb24bd07c4-plugins-config-volume\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:27:43.384379 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.384358    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/481fdbca-62c3-4b4a-926d-90938c9dc581-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "481fdbca-62c3-4b4a-926d-90938c9dc581" (UID: "481fdbca-62c3-4b4a-926d-90938c9dc581"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:27:43.384459 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.384395    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/481fdbca-62c3-4b4a-926d-90938c9dc581-kube-api-access-8nt24" (OuterVolumeSpecName: "kube-api-access-8nt24") pod "481fdbca-62c3-4b4a-926d-90938c9dc581" (UID: "481fdbca-62c3-4b4a-926d-90938c9dc581"). InnerVolumeSpecName "kube-api-access-8nt24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:27:43.384459 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.384419    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a59352df-533c-411f-8f83-737160742355-kube-api-access-q2p2g" (OuterVolumeSpecName: "kube-api-access-q2p2g") pod "a59352df-533c-411f-8f83-737160742355" (UID: "a59352df-533c-411f-8f83-737160742355"). InnerVolumeSpecName "kube-api-access-q2p2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:27:43.483709 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.483644    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/481fdbca-62c3-4b4a-926d-90938c9dc581-maas-api-tls\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:27:43.483709 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.483668    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2p2g\" (UniqueName: \"kubernetes.io/projected/a59352df-533c-411f-8f83-737160742355-kube-api-access-q2p2g\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:27:43.483709 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.483678    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nt24\" (UniqueName: \"kubernetes.io/projected/481fdbca-62c3-4b4a-926d-90938c9dc581-kube-api-access-8nt24\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:27:43.501525 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.501497    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:27:43.915777 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:43.915673    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7fbe52c-c9cd-4698-a162-d236bf7018bc" path="/var/lib/kubelet/pods/e7fbe52c-c9cd-4698-a162-d236bf7018bc/volumes"
Jul 31 21:27:44.079667 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.079632    2565 generic.go:356] "Generic (PLEG): container finished" podID="a59352df-533c-411f-8f83-737160742355" containerID="c72b5e95aa1fa15882e9adc9835aa53d623d9fc2b9aed937fcab166b55d8d5ea" exitCode=0
Jul 31 21:27:44.079853 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.079673    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7"
Jul 31 21:27:44.079853 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.079719    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7" event={"ID":"a59352df-533c-411f-8f83-737160742355","Type":"ContainerDied","Data":"c72b5e95aa1fa15882e9adc9835aa53d623d9fc2b9aed937fcab166b55d8d5ea"}
Jul 31 21:27:44.079853 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.079806    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7" event={"ID":"a59352df-533c-411f-8f83-737160742355","Type":"ContainerDied","Data":"38431a2cfa3ba1246dfb382c7631673ba8361ea0895c32313eff21805faeff80"}
Jul 31 21:27:44.079853 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.079833    2565 scope.go:117] "RemoveContainer" containerID="c72b5e95aa1fa15882e9adc9835aa53d623d9fc2b9aed937fcab166b55d8d5ea"
Jul 31 21:27:44.081259 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.081238    2565 generic.go:356] "Generic (PLEG): container finished" podID="0fc7c3c9-decc-4560-9960-93bb24bd07c4" containerID="d2637b683497ee7b34f5d3ada062e59a1dfb53219196b0279a18528e80cd8aba" exitCode=0
Jul 31 21:27:44.081369 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.081287    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn"
Jul 31 21:27:44.081369 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.081316    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn" event={"ID":"0fc7c3c9-decc-4560-9960-93bb24bd07c4","Type":"ContainerDied","Data":"d2637b683497ee7b34f5d3ada062e59a1dfb53219196b0279a18528e80cd8aba"}
Jul 31 21:27:44.081369 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.081355    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn" event={"ID":"0fc7c3c9-decc-4560-9960-93bb24bd07c4","Type":"ContainerDied","Data":"b9b8aaacd902b03f68873411a7aa593c31e370b726ce72ab10fb714609e6872e"}
Jul 31 21:27:44.083028 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.083000    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"
Jul 31 21:27:44.083126 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.083037    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7" event={"ID":"481fdbca-62c3-4b4a-926d-90938c9dc581","Type":"ContainerDied","Data":"35b1ee5bcaedce27311b0528062a814a5febf4a21df9c2660a468be1381b0c4a"}
Jul 31 21:27:44.089906 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.089888    2565 scope.go:117] "RemoveContainer" containerID="c72b5e95aa1fa15882e9adc9835aa53d623d9fc2b9aed937fcab166b55d8d5ea"
Jul 31 21:27:44.090172 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:27:44.090150    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c72b5e95aa1fa15882e9adc9835aa53d623d9fc2b9aed937fcab166b55d8d5ea\": container with ID starting with c72b5e95aa1fa15882e9adc9835aa53d623d9fc2b9aed937fcab166b55d8d5ea not found: ID does not exist" containerID="c72b5e95aa1fa15882e9adc9835aa53d623d9fc2b9aed937fcab166b55d8d5ea"
Jul 31 21:27:44.090229 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.090182    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c72b5e95aa1fa15882e9adc9835aa53d623d9fc2b9aed937fcab166b55d8d5ea"} err="failed to get container status \"c72b5e95aa1fa15882e9adc9835aa53d623d9fc2b9aed937fcab166b55d8d5ea\": rpc error: code = NotFound desc = could not find container \"c72b5e95aa1fa15882e9adc9835aa53d623d9fc2b9aed937fcab166b55d8d5ea\": container with ID starting with c72b5e95aa1fa15882e9adc9835aa53d623d9fc2b9aed937fcab166b55d8d5ea not found: ID does not exist"
Jul 31 21:27:44.090229 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.090198    2565 scope.go:117] "RemoveContainer" containerID="d2637b683497ee7b34f5d3ada062e59a1dfb53219196b0279a18528e80cd8aba"
Jul 31 21:27:44.098503 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.098486    2565 scope.go:117] "RemoveContainer" containerID="d2637b683497ee7b34f5d3ada062e59a1dfb53219196b0279a18528e80cd8aba"
Jul 31 21:27:44.098777 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:27:44.098753    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2637b683497ee7b34f5d3ada062e59a1dfb53219196b0279a18528e80cd8aba\": container with ID starting with d2637b683497ee7b34f5d3ada062e59a1dfb53219196b0279a18528e80cd8aba not found: ID does not exist" containerID="d2637b683497ee7b34f5d3ada062e59a1dfb53219196b0279a18528e80cd8aba"
Jul 31 21:27:44.098840 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.098788    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2637b683497ee7b34f5d3ada062e59a1dfb53219196b0279a18528e80cd8aba"} err="failed to get container status \"d2637b683497ee7b34f5d3ada062e59a1dfb53219196b0279a18528e80cd8aba\": rpc error: code = NotFound desc = could not find container \"d2637b683497ee7b34f5d3ada062e59a1dfb53219196b0279a18528e80cd8aba\": container with ID starting with d2637b683497ee7b34f5d3ada062e59a1dfb53219196b0279a18528e80cd8aba not found: ID does not exist"
Jul 31 21:27:44.098840 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.098802    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"]
Jul 31 21:27:44.098840 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.098811    2565 scope.go:117] "RemoveContainer" containerID="c852b5b1099912b7be34d541823d18ace45ea0c8c980a31210db35e8b3a7eb1c"
Jul 31 21:27:44.104045 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.104026    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b4cb74-7d95bd7c8b-2p5m7"]
Jul 31 21:27:44.110844 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.110821    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn"]
Jul 31 21:27:44.113060 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.113042    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b4cb74-788d6b7fc8-vrxmn"]
Jul 31 21:27:44.121188 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.121169    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7"]
Jul 31 21:27:44.124660 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:44.124642    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b4cb74-6b779c9944-xtjg7"]
Jul 31 21:27:45.915901 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:45.915859    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fc7c3c9-decc-4560-9960-93bb24bd07c4" path="/var/lib/kubelet/pods/0fc7c3c9-decc-4560-9960-93bb24bd07c4/volumes"
Jul 31 21:27:45.916455 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:45.916433    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="481fdbca-62c3-4b4a-926d-90938c9dc581" path="/var/lib/kubelet/pods/481fdbca-62c3-4b4a-926d-90938c9dc581/volumes"
Jul 31 21:27:45.916871 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:45.916852    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a59352df-533c-411f-8f83-737160742355" path="/var/lib/kubelet/pods/a59352df-533c-411f-8f83-737160742355/volumes"
Jul 31 21:27:48.527158 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:27:48.527126    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:28:24.967397 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:28:24.967316    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:28:25.709653 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:28:25.709609    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:28:31.263490 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:28:31.263445    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:28:53.116688 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:28:53.116650    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:13.779804 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:13.779767    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:14.021378 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.021348    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:14.150156 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.150057    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5c3fd2-4p866"]
Jul 31 21:29:14.150488 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.150471    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a59352df-533c-411f-8f83-737160742355" containerName="payload-pre-processing"
Jul 31 21:29:14.150565 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.150490    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a59352df-533c-411f-8f83-737160742355" containerName="payload-pre-processing"
Jul 31 21:29:14.150565 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.150502    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fc7c3c9-decc-4560-9960-93bb24bd07c4" containerName="payload-processing"
Jul 31 21:29:14.150565 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.150508    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fc7c3c9-decc-4560-9960-93bb24bd07c4" containerName="payload-processing"
Jul 31 21:29:14.150565 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.150519    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7fbe52c-c9cd-4698-a162-d236bf7018bc" containerName="revoke-keys"
Jul 31 21:29:14.150565 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.150525    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7fbe52c-c9cd-4698-a162-d236bf7018bc" containerName="revoke-keys"
Jul 31 21:29:14.150565 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.150533    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="481fdbca-62c3-4b4a-926d-90938c9dc581" containerName="maas-api"
Jul 31 21:29:14.150565 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.150539    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="481fdbca-62c3-4b4a-926d-90938c9dc581" containerName="maas-api"
Jul 31 21:29:14.150963 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.150606    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fc7c3c9-decc-4560-9960-93bb24bd07c4" containerName="payload-processing"
Jul 31 21:29:14.150963 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.150616    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7fbe52c-c9cd-4698-a162-d236bf7018bc" containerName="revoke-keys"
Jul 31 21:29:14.150963 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.150625    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a59352df-533c-411f-8f83-737160742355" containerName="payload-pre-processing"
Jul 31 21:29:14.150963 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.150635    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="481fdbca-62c3-4b4a-926d-90938c9dc581" containerName="maas-api"
Jul 31 21:29:14.153818 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.153797    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5c3fd2-4p866"
Jul 31 21:29:14.155884 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.155862    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 21:29:14.161181 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.161153    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5c3fd2-4p866"]
Jul 31 21:29:14.252093 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.252053    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d56d917-2dca-432d-a922-755fb6c73a06-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-5c3fd2-4p866\" (UID: \"8d56d917-2dca-432d-a922-755fb6c73a06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5c3fd2-4p866"
Jul 31 21:29:14.353073 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.353043    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d56d917-2dca-432d-a922-755fb6c73a06-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-5c3fd2-4p866\" (UID: \"8d56d917-2dca-432d-a922-755fb6c73a06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5c3fd2-4p866"
Jul 31 21:29:14.353766 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.353720    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d56d917-2dca-432d-a922-755fb6c73a06-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-5c3fd2-4p866\" (UID: \"8d56d917-2dca-432d-a922-755fb6c73a06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5c3fd2-4p866"
Jul 31 21:29:14.466178 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.466145    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5c3fd2-4p866"
Jul 31 21:29:14.607395 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:14.607348    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5c3fd2-4p866"]
Jul 31 21:29:14.607909 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:29:14.607881    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d56d917_2dca_432d_a922_755fb6c73a06.slice/crio-8925695b8d77128adcae9363ce4e83349f14bf472beb87f9514e568f12e7b3b7 WatchSource:0}: Error finding container 8925695b8d77128adcae9363ce4e83349f14bf472beb87f9514e568f12e7b3b7: Status 404 returned error can't find the container with id 8925695b8d77128adcae9363ce4e83349f14bf472beb87f9514e568f12e7b3b7
Jul 31 21:29:15.584313 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:15.584271    2565 generic.go:356] "Generic (PLEG): container finished" podID="8d56d917-2dca-432d-a922-755fb6c73a06" containerID="bf9fad015248991c6a8150221e009f3f7bc9fd8f0065c9d97813ec3db1288222" exitCode=0
Jul 31 21:29:15.584704 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:15.584358    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5c3fd2-4p866" event={"ID":"8d56d917-2dca-432d-a922-755fb6c73a06","Type":"ContainerDied","Data":"bf9fad015248991c6a8150221e009f3f7bc9fd8f0065c9d97813ec3db1288222"}
Jul 31 21:29:15.584704 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:15.584416    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5c3fd2-4p866" event={"ID":"8d56d917-2dca-432d-a922-755fb6c73a06","Type":"ContainerStarted","Data":"8925695b8d77128adcae9363ce4e83349f14bf472beb87f9514e568f12e7b3b7"}
Jul 31 21:29:16.734518 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:16.734494    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5c3fd2-4p866"
Jul 31 21:29:16.877944 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:16.877855    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d56d917-2dca-432d-a922-755fb6c73a06-maas-api-service-ca\") pod \"8d56d917-2dca-432d-a922-755fb6c73a06\" (UID: \"8d56d917-2dca-432d-a922-755fb6c73a06\") "
Jul 31 21:29:16.878221 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:16.878197    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d56d917-2dca-432d-a922-755fb6c73a06-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8d56d917-2dca-432d-a922-755fb6c73a06" (UID: "8d56d917-2dca-432d-a922-755fb6c73a06"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:29:16.978971 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:16.978938    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d56d917-2dca-432d-a922-755fb6c73a06-maas-api-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:29:17.597035 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:17.597000    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5c3fd2-4p866" event={"ID":"8d56d917-2dca-432d-a922-755fb6c73a06","Type":"ContainerDied","Data":"8925695b8d77128adcae9363ce4e83349f14bf472beb87f9514e568f12e7b3b7"}
Jul 31 21:29:17.597217 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:17.597049    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8925695b8d77128adcae9363ce4e83349f14bf472beb87f9514e568f12e7b3b7"
Jul 31 21:29:17.597217 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:17.597013    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5c3fd2-4p866"
Jul 31 21:29:19.852846 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:19.852807    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:19.927229 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:19.927188    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:24.564381 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:24.564331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:24.590757 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:24.590714    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct"]
Jul 31 21:29:24.590996 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:24.590968    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct" podUID="673b7321-853c-40bf-a9c8-2ed52b3939df" containerName="payload-processing" containerID="cri-o://66ca64b0c71b6db70023343bccf0d34af1ae44679a22c0ac74d782ae235d0e23" gracePeriod=30
Jul 31 21:29:24.597772 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:24.597727    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c"]
Jul 31 21:29:24.599462 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:24.597959    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c" podUID="b96e8fc3-4367-404d-8f5d-369050206263" containerName="payload-pre-processing" containerID="cri-o://7fc5ab624d0130980b384826da5e507cd75988c0ff33cc2fd58c015123696874" gracePeriod=30
Jul 31 21:29:24.630419 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:24.630384    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:24.693121 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:24.693089    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:24.816101 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:24.816022    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:24.848943 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:24.848906    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5c3fd2-4p866"]
Jul 31 21:29:24.861928 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:24.861889    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5c3fd2-4p866"]
Jul 31 21:29:24.889217 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:24.889195    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct"
Jul 31 21:29:24.891944 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:24.891917    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c"
Jul 31 21:29:25.063089 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.063054    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7psz8\" (UniqueName: \"kubernetes.io/projected/673b7321-853c-40bf-a9c8-2ed52b3939df-kube-api-access-7psz8\") pod \"673b7321-853c-40bf-a9c8-2ed52b3939df\" (UID: \"673b7321-853c-40bf-a9c8-2ed52b3939df\") "
Jul 31 21:29:25.063286 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.063139    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/673b7321-853c-40bf-a9c8-2ed52b3939df-plugins-config-volume\") pod \"673b7321-853c-40bf-a9c8-2ed52b3939df\" (UID: \"673b7321-853c-40bf-a9c8-2ed52b3939df\") "
Jul 31 21:29:25.063286 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.063179    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b96e8fc3-4367-404d-8f5d-369050206263-plugins-config-volume\") pod \"b96e8fc3-4367-404d-8f5d-369050206263\" (UID: \"b96e8fc3-4367-404d-8f5d-369050206263\") "
Jul 31 21:29:25.063286 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.063194    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9ljn\" (UniqueName: \"kubernetes.io/projected/b96e8fc3-4367-404d-8f5d-369050206263-kube-api-access-g9ljn\") pod \"b96e8fc3-4367-404d-8f5d-369050206263\" (UID: \"b96e8fc3-4367-404d-8f5d-369050206263\") "
Jul 31 21:29:25.063598 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.063569    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/673b7321-853c-40bf-a9c8-2ed52b3939df-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "673b7321-853c-40bf-a9c8-2ed52b3939df" (UID: "673b7321-853c-40bf-a9c8-2ed52b3939df"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:29:25.063672 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.063573    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b96e8fc3-4367-404d-8f5d-369050206263-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b96e8fc3-4367-404d-8f5d-369050206263" (UID: "b96e8fc3-4367-404d-8f5d-369050206263"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:29:25.065365 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.065332    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/673b7321-853c-40bf-a9c8-2ed52b3939df-kube-api-access-7psz8" (OuterVolumeSpecName: "kube-api-access-7psz8") pod "673b7321-853c-40bf-a9c8-2ed52b3939df" (UID: "673b7321-853c-40bf-a9c8-2ed52b3939df"). InnerVolumeSpecName "kube-api-access-7psz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:29:25.065456 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.065421    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b96e8fc3-4367-404d-8f5d-369050206263-kube-api-access-g9ljn" (OuterVolumeSpecName: "kube-api-access-g9ljn") pod "b96e8fc3-4367-404d-8f5d-369050206263" (UID: "b96e8fc3-4367-404d-8f5d-369050206263"). InnerVolumeSpecName "kube-api-access-g9ljn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:29:25.164887 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.164856    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/673b7321-853c-40bf-a9c8-2ed52b3939df-plugins-config-volume\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:29:25.164887 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.164883    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b96e8fc3-4367-404d-8f5d-369050206263-plugins-config-volume\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:29:25.164887 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.164893    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9ljn\" (UniqueName: \"kubernetes.io/projected/b96e8fc3-4367-404d-8f5d-369050206263-kube-api-access-g9ljn\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:29:25.165114 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.164902    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7psz8\" (UniqueName: \"kubernetes.io/projected/673b7321-853c-40bf-a9c8-2ed52b3939df-kube-api-access-7psz8\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:29:25.242627 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.242582    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:25.647930 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.647896    2565 generic.go:356] "Generic (PLEG): container finished" podID="673b7321-853c-40bf-a9c8-2ed52b3939df" containerID="66ca64b0c71b6db70023343bccf0d34af1ae44679a22c0ac74d782ae235d0e23" exitCode=0
Jul 31 21:29:25.648437 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.647942    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct"
Jul 31 21:29:25.648437 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.647984    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct" event={"ID":"673b7321-853c-40bf-a9c8-2ed52b3939df","Type":"ContainerDied","Data":"66ca64b0c71b6db70023343bccf0d34af1ae44679a22c0ac74d782ae235d0e23"}
Jul 31 21:29:25.648437 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.648050    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct" event={"ID":"673b7321-853c-40bf-a9c8-2ed52b3939df","Type":"ContainerDied","Data":"aa816ca6f73a8033c457e144a438bb33d306970db8e4a763393666783b941615"}
Jul 31 21:29:25.648437 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.648085    2565 scope.go:117] "RemoveContainer" containerID="66ca64b0c71b6db70023343bccf0d34af1ae44679a22c0ac74d782ae235d0e23"
Jul 31 21:29:25.649469 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.649450    2565 generic.go:356] "Generic (PLEG): container finished" podID="b96e8fc3-4367-404d-8f5d-369050206263" containerID="7fc5ab624d0130980b384826da5e507cd75988c0ff33cc2fd58c015123696874" exitCode=0
Jul 31 21:29:25.649549 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.649473    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c" event={"ID":"b96e8fc3-4367-404d-8f5d-369050206263","Type":"ContainerDied","Data":"7fc5ab624d0130980b384826da5e507cd75988c0ff33cc2fd58c015123696874"}
Jul 31 21:29:25.649549 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.649504    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c"
Jul 31 21:29:25.649549 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.649535    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c" event={"ID":"b96e8fc3-4367-404d-8f5d-369050206263","Type":"ContainerDied","Data":"d25cb3889f1afb63c76f4a1a437d9c9922b95e4db22244cc9a8ef27587a10b5c"}
Jul 31 21:29:25.659021 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.658880    2565 scope.go:117] "RemoveContainer" containerID="66ca64b0c71b6db70023343bccf0d34af1ae44679a22c0ac74d782ae235d0e23"
Jul 31 21:29:25.659581 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:29:25.659563    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66ca64b0c71b6db70023343bccf0d34af1ae44679a22c0ac74d782ae235d0e23\": container with ID starting with 66ca64b0c71b6db70023343bccf0d34af1ae44679a22c0ac74d782ae235d0e23 not found: ID does not exist" containerID="66ca64b0c71b6db70023343bccf0d34af1ae44679a22c0ac74d782ae235d0e23"
Jul 31 21:29:25.659655 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.659590    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66ca64b0c71b6db70023343bccf0d34af1ae44679a22c0ac74d782ae235d0e23"} err="failed to get container status \"66ca64b0c71b6db70023343bccf0d34af1ae44679a22c0ac74d782ae235d0e23\": rpc error: code = NotFound desc = could not find container \"66ca64b0c71b6db70023343bccf0d34af1ae44679a22c0ac74d782ae235d0e23\": container with ID starting with 66ca64b0c71b6db70023343bccf0d34af1ae44679a22c0ac74d782ae235d0e23 not found: ID does not exist"
Jul 31 21:29:25.659655 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.659610    2565 scope.go:117] "RemoveContainer" containerID="7fc5ab624d0130980b384826da5e507cd75988c0ff33cc2fd58c015123696874"
Jul 31 21:29:25.668088 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.668064    2565 scope.go:117] "RemoveContainer" containerID="7fc5ab624d0130980b384826da5e507cd75988c0ff33cc2fd58c015123696874"
Jul 31 21:29:25.668356 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:29:25.668328    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fc5ab624d0130980b384826da5e507cd75988c0ff33cc2fd58c015123696874\": container with ID starting with 7fc5ab624d0130980b384826da5e507cd75988c0ff33cc2fd58c015123696874 not found: ID does not exist" containerID="7fc5ab624d0130980b384826da5e507cd75988c0ff33cc2fd58c015123696874"
Jul 31 21:29:25.668403 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.668366    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fc5ab624d0130980b384826da5e507cd75988c0ff33cc2fd58c015123696874"} err="failed to get container status \"7fc5ab624d0130980b384826da5e507cd75988c0ff33cc2fd58c015123696874\": rpc error: code = NotFound desc = could not find container \"7fc5ab624d0130980b384826da5e507cd75988c0ff33cc2fd58c015123696874\": container with ID starting with 7fc5ab624d0130980b384826da5e507cd75988c0ff33cc2fd58c015123696874 not found: ID does not exist"
Jul 31 21:29:25.672491 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.672459    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c"]
Jul 31 21:29:25.676307 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.676276    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5c3fd2-7559bbc864-vlv9c"]
Jul 31 21:29:25.686682 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.686660    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct"]
Jul 31 21:29:25.690311 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.690292    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5c3fd2-5474576bdb-9hzct"]
Jul 31 21:29:25.916119 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.916045    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="673b7321-853c-40bf-a9c8-2ed52b3939df" path="/var/lib/kubelet/pods/673b7321-853c-40bf-a9c8-2ed52b3939df/volumes"
Jul 31 21:29:25.916378 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.916366    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d56d917-2dca-432d-a922-755fb6c73a06" path="/var/lib/kubelet/pods/8d56d917-2dca-432d-a922-755fb6c73a06/volumes"
Jul 31 21:29:25.916677 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:25.916665    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b96e8fc3-4367-404d-8f5d-369050206263" path="/var/lib/kubelet/pods/b96e8fc3-4367-404d-8f5d-369050206263/volumes"
Jul 31 21:29:30.961446 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:30.961414    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:31.026622 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.026592    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:31.242852 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.242755    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:31.525687 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.525602    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:31.648897 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.648860    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75"]
Jul 31 21:29:31.649947 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.649919    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d56d917-2dca-432d-a922-755fb6c73a06" containerName="revoke-keys"
Jul 31 21:29:31.650116 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.650104    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d56d917-2dca-432d-a922-755fb6c73a06" containerName="revoke-keys"
Jul 31 21:29:31.650253 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.650242    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b96e8fc3-4367-404d-8f5d-369050206263" containerName="payload-pre-processing"
Jul 31 21:29:31.650326 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.650317    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b96e8fc3-4367-404d-8f5d-369050206263" containerName="payload-pre-processing"
Jul 31 21:29:31.650395 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.650386    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="673b7321-853c-40bf-a9c8-2ed52b3939df" containerName="payload-processing"
Jul 31 21:29:31.650464 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.650454    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="673b7321-853c-40bf-a9c8-2ed52b3939df" containerName="payload-processing"
Jul 31 21:29:31.650724 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.650710    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="673b7321-853c-40bf-a9c8-2ed52b3939df" containerName="payload-processing"
Jul 31 21:29:31.650863 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.650850    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b96e8fc3-4367-404d-8f5d-369050206263" containerName="payload-pre-processing"
Jul 31 21:29:31.650951 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.650942    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d56d917-2dca-432d-a922-755fb6c73a06" containerName="revoke-keys"
Jul 31 21:29:31.656645 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.656623    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75"
Jul 31 21:29:31.658863 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.658836    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75"]
Jul 31 21:29:31.659116 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.659090    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 21:29:31.728021 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.727983    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae50f4cd-23ba-49ea-a912-377e36c33016-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75\" (UID: \"ae50f4cd-23ba-49ea-a912-377e36c33016\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75"
Jul 31 21:29:31.829233 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.829152    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae50f4cd-23ba-49ea-a912-377e36c33016-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75\" (UID: \"ae50f4cd-23ba-49ea-a912-377e36c33016\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75"
Jul 31 21:29:31.829783 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.829765    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae50f4cd-23ba-49ea-a912-377e36c33016-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75\" (UID: \"ae50f4cd-23ba-49ea-a912-377e36c33016\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75"
Jul 31 21:29:31.969463 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:31.969428    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75"
Jul 31 21:29:32.111985 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:32.111951    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75"]
Jul 31 21:29:32.113651 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:29:32.113622    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae50f4cd_23ba_49ea_a912_377e36c33016.slice/crio-c8aa70ce9281f48102181c6d36ea7e0d45c9e2f3314e808b5e58f3fc2f94efed WatchSource:0}: Error finding container c8aa70ce9281f48102181c6d36ea7e0d45c9e2f3314e808b5e58f3fc2f94efed: Status 404 returned error can't find the container with id c8aa70ce9281f48102181c6d36ea7e0d45c9e2f3314e808b5e58f3fc2f94efed
Jul 31 21:29:32.690410 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:32.690376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75" event={"ID":"ae50f4cd-23ba-49ea-a912-377e36c33016","Type":"ContainerStarted","Data":"1329a73d753cf94ad5e56161bda7e21c8d0a049084b078f6d5ace12becde970b"}
Jul 31 21:29:32.690596 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:32.690436    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75" event={"ID":"ae50f4cd-23ba-49ea-a912-377e36c33016","Type":"ContainerStarted","Data":"c8aa70ce9281f48102181c6d36ea7e0d45c9e2f3314e808b5e58f3fc2f94efed"}
Jul 31 21:29:32.709961 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:32.709913    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75" podStartSLOduration=1.709898529 podStartE2EDuration="1.709898529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:29:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:29:32.70692043 +0000 UTC m=+3581.312214793" watchObservedRunningTime="2026-07-31 21:29:32.709898529 +0000 UTC m=+3581.315193059"
Jul 31 21:29:33.697826 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:33.697788    2565 generic.go:356] "Generic (PLEG): container finished" podID="ae50f4cd-23ba-49ea-a912-377e36c33016" containerID="1329a73d753cf94ad5e56161bda7e21c8d0a049084b078f6d5ace12becde970b" exitCode=0
Jul 31 21:29:33.698212 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:33.697838    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75" event={"ID":"ae50f4cd-23ba-49ea-a912-377e36c33016","Type":"ContainerDied","Data":"1329a73d753cf94ad5e56161bda7e21c8d0a049084b078f6d5ace12becde970b"}
Jul 31 21:29:34.840871 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:34.840843    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75"
Jul 31 21:29:34.958531 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:34.958435    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae50f4cd-23ba-49ea-a912-377e36c33016-maas-api-service-ca\") pod \"ae50f4cd-23ba-49ea-a912-377e36c33016\" (UID: \"ae50f4cd-23ba-49ea-a912-377e36c33016\") "
Jul 31 21:29:34.958822 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:34.958799    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae50f4cd-23ba-49ea-a912-377e36c33016-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ae50f4cd-23ba-49ea-a912-377e36c33016" (UID: "ae50f4cd-23ba-49ea-a912-377e36c33016"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:29:35.060065 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:35.060029    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae50f4cd-23ba-49ea-a912-377e36c33016-maas-api-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:29:35.710086 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:35.710055    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75"
Jul 31 21:29:35.710266 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:35.710089    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75" event={"ID":"ae50f4cd-23ba-49ea-a912-377e36c33016","Type":"ContainerDied","Data":"c8aa70ce9281f48102181c6d36ea7e0d45c9e2f3314e808b5e58f3fc2f94efed"}
Jul 31 21:29:35.710266 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:35.710134    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8aa70ce9281f48102181c6d36ea7e0d45c9e2f3314e808b5e58f3fc2f94efed"
Jul 31 21:29:42.368069 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.368036    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"]
Jul 31 21:29:42.368563 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.368221    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg" podUID="547d6511-7377-4536-aac1-9936f2e6685f" containerName="maas-api" containerID="cri-o://cd5e572becf2c49c5428fa4e68fbb7c9f7e27c9021a2c7c3304c44b8302f4dc9" gracePeriod=30
Jul 31 21:29:42.432081 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.432048    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:42.530336 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.530280    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:42.631142 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.631074    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"
Jul 31 21:29:42.681758 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.681695    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75"]
Jul 31 21:29:42.685244 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.685211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:42.685393 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.685328    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8de79c-wkn75"]
Jul 31 21:29:42.738321 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.738235    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/547d6511-7377-4536-aac1-9936f2e6685f-maas-api-tls\") pod \"547d6511-7377-4536-aac1-9936f2e6685f\" (UID: \"547d6511-7377-4536-aac1-9936f2e6685f\") "
Jul 31 21:29:42.738505 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.738355    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/547d6511-7377-4536-aac1-9936f2e6685f-openshift-service-ca\") pod \"547d6511-7377-4536-aac1-9936f2e6685f\" (UID: \"547d6511-7377-4536-aac1-9936f2e6685f\") "
Jul 31 21:29:42.738505 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.738406    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll6b5\" (UniqueName: \"kubernetes.io/projected/547d6511-7377-4536-aac1-9936f2e6685f-kube-api-access-ll6b5\") pod \"547d6511-7377-4536-aac1-9936f2e6685f\" (UID: \"547d6511-7377-4536-aac1-9936f2e6685f\") "
Jul 31 21:29:42.738822 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.738796    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/547d6511-7377-4536-aac1-9936f2e6685f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "547d6511-7377-4536-aac1-9936f2e6685f" (UID: "547d6511-7377-4536-aac1-9936f2e6685f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:29:42.740622 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.740595    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/547d6511-7377-4536-aac1-9936f2e6685f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "547d6511-7377-4536-aac1-9936f2e6685f" (UID: "547d6511-7377-4536-aac1-9936f2e6685f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:29:42.740702 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.740657    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/547d6511-7377-4536-aac1-9936f2e6685f-kube-api-access-ll6b5" (OuterVolumeSpecName: "kube-api-access-ll6b5") pod "547d6511-7377-4536-aac1-9936f2e6685f" (UID: "547d6511-7377-4536-aac1-9936f2e6685f"). InnerVolumeSpecName "kube-api-access-ll6b5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:29:42.749573 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.749547    2565 generic.go:356] "Generic (PLEG): container finished" podID="547d6511-7377-4536-aac1-9936f2e6685f" containerID="cd5e572becf2c49c5428fa4e68fbb7c9f7e27c9021a2c7c3304c44b8302f4dc9" exitCode=0
Jul 31 21:29:42.749665 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.749593    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"
Jul 31 21:29:42.749665 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.749628    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg" event={"ID":"547d6511-7377-4536-aac1-9936f2e6685f","Type":"ContainerDied","Data":"cd5e572becf2c49c5428fa4e68fbb7c9f7e27c9021a2c7c3304c44b8302f4dc9"}
Jul 31 21:29:42.749781 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.749700    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg" event={"ID":"547d6511-7377-4536-aac1-9936f2e6685f","Type":"ContainerDied","Data":"7d5999be01045ab126fb3e3216b32d07309cd495fd430df13c9abf34ede66852"}
Jul 31 21:29:42.749781 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.749748    2565 scope.go:117] "RemoveContainer" containerID="cd5e572becf2c49c5428fa4e68fbb7c9f7e27c9021a2c7c3304c44b8302f4dc9"
Jul 31 21:29:42.759515 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.759496    2565 scope.go:117] "RemoveContainer" containerID="cd5e572becf2c49c5428fa4e68fbb7c9f7e27c9021a2c7c3304c44b8302f4dc9"
Jul 31 21:29:42.759819 ip-10-0-128-218 kubenswrapper[2565]: E0731 21:29:42.759799    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd5e572becf2c49c5428fa4e68fbb7c9f7e27c9021a2c7c3304c44b8302f4dc9\": container with ID starting with cd5e572becf2c49c5428fa4e68fbb7c9f7e27c9021a2c7c3304c44b8302f4dc9 not found: ID does not exist" containerID="cd5e572becf2c49c5428fa4e68fbb7c9f7e27c9021a2c7c3304c44b8302f4dc9"
Jul 31 21:29:42.759895 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.759832    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd5e572becf2c49c5428fa4e68fbb7c9f7e27c9021a2c7c3304c44b8302f4dc9"} err="failed to get container status \"cd5e572becf2c49c5428fa4e68fbb7c9f7e27c9021a2c7c3304c44b8302f4dc9\": rpc error: code = NotFound desc = could not find container \"cd5e572becf2c49c5428fa4e68fbb7c9f7e27c9021a2c7c3304c44b8302f4dc9\": container with ID starting with cd5e572becf2c49c5428fa4e68fbb7c9f7e27c9021a2c7c3304c44b8302f4dc9 not found: ID does not exist"
Jul 31 21:29:42.783577 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.783544    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"]
Jul 31 21:29:42.788472 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.788436    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8de79c-5cd6d5b8bd-z5txg"]
Jul 31 21:29:42.839480 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.839446    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/547d6511-7377-4536-aac1-9936f2e6685f-openshift-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:29:42.839480 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.839476    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll6b5\" (UniqueName: \"kubernetes.io/projected/547d6511-7377-4536-aac1-9936f2e6685f-kube-api-access-ll6b5\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:29:42.839480 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:42.839486    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/547d6511-7377-4536-aac1-9936f2e6685f-maas-api-tls\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:29:43.098280 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:43.098230    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:43.915131 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:43.915098    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="547d6511-7377-4536-aac1-9936f2e6685f" path="/var/lib/kubelet/pods/547d6511-7377-4536-aac1-9936f2e6685f/volumes"
Jul 31 21:29:43.915516 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:43.915425    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae50f4cd-23ba-49ea-a912-377e36c33016" path="/var/lib/kubelet/pods/ae50f4cd-23ba-49ea-a912-377e36c33016/volumes"
Jul 31 21:29:44.741131 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:44.741093    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:50.288956 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:50.288922    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:50.416083 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:50.416029    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:50.618128 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:50.618039    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"]
Jul 31 21:29:50.618368 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:50.618341    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv" podUID="ce7b7ebd-e300-46ae-8c29-c7259d3f2517" containerName="istio-proxy" containerID="cri-o://b8c9d77b39590a25d0dc81b2215f1a3cd08af654a220814d7c6730b5f516cd3f" gracePeriod=30
Jul 31 21:29:50.659830 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:50.659796    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:50.943386 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:50.943358    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:29:52.207614 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:52.207584    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 21:29:52.212952 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:52.212886    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 21:29:52.221853 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:52.221825    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 21:29:52.226925 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:52.226905    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zf99r_211c1840-13e1-474b-9b24-f231cea1964e/ovn-acl-logging/0.log"
Jul 31 21:29:55.827437 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.827405    2565 generic.go:356] "Generic (PLEG): container finished" podID="ce7b7ebd-e300-46ae-8c29-c7259d3f2517" containerID="b8c9d77b39590a25d0dc81b2215f1a3cd08af654a220814d7c6730b5f516cd3f" exitCode=0
Jul 31 21:29:55.827876 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.827473    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv" event={"ID":"ce7b7ebd-e300-46ae-8c29-c7259d3f2517","Type":"ContainerDied","Data":"b8c9d77b39590a25d0dc81b2215f1a3cd08af654a220814d7c6730b5f516cd3f"}
Jul 31 21:29:55.827876 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.827529    2565 scope.go:117] "RemoveContainer" containerID="235ab84e3084bf8f8929c4834556f46f30abf1f9d014110b1d8b9ae462a37590"
Jul 31 21:29:55.875636 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.875609    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:29:55.971881 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.971850    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-data\") pod \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") "
Jul 31 21:29:55.971881 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.971887    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-token\") pod \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") "
Jul 31 21:29:55.972153 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.971917    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-envoy\") pod \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") "
Jul 31 21:29:55.972153 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.971961    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-credential-socket\") pod \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") "
Jul 31 21:29:55.972153 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.971980    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-workload-certs\") pod \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") "
Jul 31 21:29:55.972153 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.972003    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istiod-ca-cert\") pod \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") "
Jul 31 21:29:55.972153 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.972025    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7wbm\" (UniqueName: \"kubernetes.io/projected/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-kube-api-access-v7wbm\") pod \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") "
Jul 31 21:29:55.972153 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.972059    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-podinfo\") pod \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") "
Jul 31 21:29:55.972153 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.972087    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-workload-socket\") pod \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\" (UID: \"ce7b7ebd-e300-46ae-8c29-c7259d3f2517\") "
Jul 31 21:29:55.972509 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.972193    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-data" (OuterVolumeSpecName: "istio-data") pod "ce7b7ebd-e300-46ae-8c29-c7259d3f2517" (UID: "ce7b7ebd-e300-46ae-8c29-c7259d3f2517"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:29:55.972509 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.972315    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ce7b7ebd-e300-46ae-8c29-c7259d3f2517" (UID: "ce7b7ebd-e300-46ae-8c29-c7259d3f2517"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:29:55.972509 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.972313    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ce7b7ebd-e300-46ae-8c29-c7259d3f2517" (UID: "ce7b7ebd-e300-46ae-8c29-c7259d3f2517"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:29:55.972509 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.972408    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ce7b7ebd-e300-46ae-8c29-c7259d3f2517" (UID: "ce7b7ebd-e300-46ae-8c29-c7259d3f2517"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:29:55.972509 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.972440    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ce7b7ebd-e300-46ae-8c29-c7259d3f2517" (UID: "ce7b7ebd-e300-46ae-8c29-c7259d3f2517"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:29:55.972509 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.972467    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-credential-socket\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:29:55.972509 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.972489    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-workload-certs\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:29:55.972509 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.972502    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-data\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:29:55.974368 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.974335    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ce7b7ebd-e300-46ae-8c29-c7259d3f2517" (UID: "ce7b7ebd-e300-46ae-8c29-c7259d3f2517"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:29:55.974502 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.974379    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-token" (OuterVolumeSpecName: "istio-token") pod "ce7b7ebd-e300-46ae-8c29-c7259d3f2517" (UID: "ce7b7ebd-e300-46ae-8c29-c7259d3f2517"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:29:55.974502 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.974425    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-kube-api-access-v7wbm" (OuterVolumeSpecName: "kube-api-access-v7wbm") pod "ce7b7ebd-e300-46ae-8c29-c7259d3f2517" (UID: "ce7b7ebd-e300-46ae-8c29-c7259d3f2517"). InnerVolumeSpecName "kube-api-access-v7wbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:29:55.974613 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:55.974596    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ce7b7ebd-e300-46ae-8c29-c7259d3f2517" (UID: "ce7b7ebd-e300-46ae-8c29-c7259d3f2517"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 21:29:56.073436 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:56.073394    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-token\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:29:56.073436 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:56.073425    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-envoy\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:29:56.073436 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:56.073436    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istiod-ca-cert\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:29:56.073436 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:56.073444    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7wbm\" (UniqueName: \"kubernetes.io/projected/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-kube-api-access-v7wbm\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:29:56.073719 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:56.073453    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-istio-podinfo\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:29:56.073719 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:56.073461    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7b7ebd-e300-46ae-8c29-c7259d3f2517-workload-socket\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:29:56.834513 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:56.834483    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"
Jul 31 21:29:56.834513 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:56.834501    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv" event={"ID":"ce7b7ebd-e300-46ae-8c29-c7259d3f2517","Type":"ContainerDied","Data":"21157a890c8782ff7f6e2d6b329fc8bf9636bd158a726a864d2cabf0572f4d09"}
Jul 31 21:29:56.835080 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:56.834561    2565 scope.go:117] "RemoveContainer" containerID="b8c9d77b39590a25d0dc81b2215f1a3cd08af654a220814d7c6730b5f516cd3f"
Jul 31 21:29:56.862150 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:56.862120    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"]
Jul 31 21:29:56.871033 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:56.871004    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-8de79c-openshift-default-dbd7c47fb-jdbnv"]
Jul 31 21:29:57.914823 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:29:57.914791    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce7b7ebd-e300-46ae-8c29-c7259d3f2517" path="/var/lib/kubelet/pods/ce7b7ebd-e300-46ae-8c29-c7259d3f2517/volumes"
Jul 31 21:30:00.144974 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.144940    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6938c5-29758890-cdlwl"]
Jul 31 21:30:00.145340 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.145282    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce7b7ebd-e300-46ae-8c29-c7259d3f2517" containerName="istio-proxy"
Jul 31 21:30:00.145340 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.145293    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce7b7ebd-e300-46ae-8c29-c7259d3f2517" containerName="istio-proxy"
Jul 31 21:30:00.145340 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.145302    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce7b7ebd-e300-46ae-8c29-c7259d3f2517" containerName="istio-proxy"
Jul 31 21:30:00.145340 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.145307    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce7b7ebd-e300-46ae-8c29-c7259d3f2517" containerName="istio-proxy"
Jul 31 21:30:00.145340 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.145322    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae50f4cd-23ba-49ea-a912-377e36c33016" containerName="revoke-keys"
Jul 31 21:30:00.145340 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.145327    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae50f4cd-23ba-49ea-a912-377e36c33016" containerName="revoke-keys"
Jul 31 21:30:00.145340 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.145336    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="547d6511-7377-4536-aac1-9936f2e6685f" containerName="maas-api"
Jul 31 21:30:00.145340 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.145342    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="547d6511-7377-4536-aac1-9936f2e6685f" containerName="maas-api"
Jul 31 21:30:00.145584 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.145397    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae50f4cd-23ba-49ea-a912-377e36c33016" containerName="revoke-keys"
Jul 31 21:30:00.145584 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.145405    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="547d6511-7377-4536-aac1-9936f2e6685f" containerName="maas-api"
Jul 31 21:30:00.145584 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.145413    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce7b7ebd-e300-46ae-8c29-c7259d3f2517" containerName="istio-proxy"
Jul 31 21:30:00.145584 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.145419    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce7b7ebd-e300-46ae-8c29-c7259d3f2517" containerName="istio-proxy"
Jul 31 21:30:00.149950 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.149927    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6938c5-29758890-cdlwl"
Jul 31 21:30:00.152144 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.152121    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 21:30:00.152928 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.152910    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758890-mbt2q"]
Jul 31 21:30:00.156167 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.156144    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758890-mbt2q"
Jul 31 21:30:00.159802 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.159780    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6938c5-29758890-cdlwl"]
Jul 31 21:30:00.162588 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.162569    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6938c5-29758890-cdlwl"
Jul 31 21:30:00.177448 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.177417    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758890-mbt2q"]
Jul 31 21:30:00.199325 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.199302    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758890-mbt2q"
Jul 31 21:30:00.324937 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.324892    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6938c5-29758890-cdlwl"]
Jul 31 21:30:00.329991 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:30:00.329941    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod411627d8_3af6_436b_aaa2_1d66731c0e3f.slice/crio-d96516d8cd4d1ef20299132cd3453cdcfaceddb7facce87184e9793b683c2e00 WatchSource:0}: Error finding container d96516d8cd4d1ef20299132cd3453cdcfaceddb7facce87184e9793b683c2e00: Status 404 returned error can't find the container with id d96516d8cd4d1ef20299132cd3453cdcfaceddb7facce87184e9793b683c2e00
Jul 31 21:30:00.351750 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.351706    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758890-mbt2q"]
Jul 31 21:30:00.367862 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:30:00.367838    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f66b2ad_aad8_4665_a9c0_265ad611be39.slice/crio-0bc389175afd28bb25f0b06440becfcf66825e68d37167ef2f082071051a08b4 WatchSource:0}: Error finding container 0bc389175afd28bb25f0b06440becfcf66825e68d37167ef2f082071051a08b4: Status 404 returned error can't find the container with id 0bc389175afd28bb25f0b06440becfcf66825e68d37167ef2f082071051a08b4
Jul 31 21:30:00.859963 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.859874    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758890-mbt2q" event={"ID":"2f66b2ad-aad8-4665-a9c0-265ad611be39","Type":"ContainerStarted","Data":"066c7c2c7fcf8c2ad77c227dab4e77ebb5b278eda0983cef20a3add7dc7cf212"}
Jul 31 21:30:00.859963 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.859938    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758890-mbt2q" event={"ID":"2f66b2ad-aad8-4665-a9c0-265ad611be39","Type":"ContainerStarted","Data":"0bc389175afd28bb25f0b06440becfcf66825e68d37167ef2f082071051a08b4"}
Jul 31 21:30:00.861504 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.861478    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6938c5-29758890-cdlwl" event={"ID":"411627d8-3af6-436b-aaa2-1d66731c0e3f","Type":"ContainerStarted","Data":"8c43bb6b78e0b2562dfa083baeaf42ff578a3ec7a6e4ec735c8dbef9a9a9c1d4"}
Jul 31 21:30:00.861588 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.861525    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6938c5-29758890-cdlwl" event={"ID":"411627d8-3af6-436b-aaa2-1d66731c0e3f","Type":"ContainerStarted","Data":"d96516d8cd4d1ef20299132cd3453cdcfaceddb7facce87184e9793b683c2e00"}
Jul 31 21:30:00.879486 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.879431    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758890-mbt2q" podStartSLOduration=0.879416118 podStartE2EDuration="879.416118ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:00.87766543 +0000 UTC m=+3609.482959792" watchObservedRunningTime="2026-07-31 21:30:00.879416118 +0000 UTC m=+3609.484710459"
Jul 31 21:30:00.901724 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:00.901673    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6938c5-29758890-cdlwl" podStartSLOduration=0.901658318 podStartE2EDuration="901.658318ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:00.899487043 +0000 UTC m=+3609.504781407" watchObservedRunningTime="2026-07-31 21:30:00.901658318 +0000 UTC m=+3609.506952681"
Jul 31 21:30:01.623259 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:01.623179    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"]
Jul 31 21:30:01.623661 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:01.623412    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf" podUID="9b66542c-f15b-4fd3-a88f-230d3e523c46" containerName="maas-api" containerID="cri-o://a3a2e3eba688081f1e03196b6892ebbb25770c6a50f75444aecc347462f1f437" gracePeriod=30
Jul 31 21:30:01.692180 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:01.692146    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6938c5-29758890-cdlwl"]
Jul 31 21:30:01.742987 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:01.742935    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:30:01.870875 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:01.870846    2565 generic.go:356] "Generic (PLEG): container finished" podID="2f66b2ad-aad8-4665-a9c0-265ad611be39" containerID="066c7c2c7fcf8c2ad77c227dab4e77ebb5b278eda0983cef20a3add7dc7cf212" exitCode=0
Jul 31 21:30:01.871013 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:01.870940    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758890-mbt2q" event={"ID":"2f66b2ad-aad8-4665-a9c0-265ad611be39","Type":"ContainerDied","Data":"066c7c2c7fcf8c2ad77c227dab4e77ebb5b278eda0983cef20a3add7dc7cf212"}
Jul 31 21:30:01.872614 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:01.872590    2565 generic.go:356] "Generic (PLEG): container finished" podID="411627d8-3af6-436b-aaa2-1d66731c0e3f" containerID="8c43bb6b78e0b2562dfa083baeaf42ff578a3ec7a6e4ec735c8dbef9a9a9c1d4" exitCode=0
Jul 31 21:30:01.872614 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:01.872612    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6938c5-29758890-cdlwl" event={"ID":"411627d8-3af6-436b-aaa2-1d66731c0e3f","Type":"ContainerDied","Data":"8c43bb6b78e0b2562dfa083baeaf42ff578a3ec7a6e4ec735c8dbef9a9a9c1d4"}
Jul 31 21:30:01.874064 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:01.873938    2565 generic.go:356] "Generic (PLEG): container finished" podID="9b66542c-f15b-4fd3-a88f-230d3e523c46" containerID="a3a2e3eba688081f1e03196b6892ebbb25770c6a50f75444aecc347462f1f437" exitCode=0
Jul 31 21:30:01.874064 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:01.873995    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf" event={"ID":"9b66542c-f15b-4fd3-a88f-230d3e523c46","Type":"ContainerDied","Data":"a3a2e3eba688081f1e03196b6892ebbb25770c6a50f75444aecc347462f1f437"}
Jul 31 21:30:01.874064 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:01.874029    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf" event={"ID":"9b66542c-f15b-4fd3-a88f-230d3e523c46","Type":"ContainerDied","Data":"47ab68da224ae834d8d5b27700be960cb5deb685dae8947be3bcf12deea95c7d"}
Jul 31 21:30:01.874064 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:01.874047    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47ab68da224ae834d8d5b27700be960cb5deb685dae8947be3bcf12deea95c7d"
Jul 31 21:30:01.875304 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:01.875287    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"
Jul 31 21:30:01.896518 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:01.896490    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:30:02.009221 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:02.009187    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:30:02.031893 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:02.031857    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2rkc\" (UniqueName: \"kubernetes.io/projected/9b66542c-f15b-4fd3-a88f-230d3e523c46-kube-api-access-b2rkc\") pod \"9b66542c-f15b-4fd3-a88f-230d3e523c46\" (UID: \"9b66542c-f15b-4fd3-a88f-230d3e523c46\") "
Jul 31 21:30:02.032135 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:02.031955    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b66542c-f15b-4fd3-a88f-230d3e523c46-maas-api-tls\") pod \"9b66542c-f15b-4fd3-a88f-230d3e523c46\" (UID: \"9b66542c-f15b-4fd3-a88f-230d3e523c46\") "
Jul 31 21:30:02.032135 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:02.031989    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b66542c-f15b-4fd3-a88f-230d3e523c46-openshift-service-ca\") pod \"9b66542c-f15b-4fd3-a88f-230d3e523c46\" (UID: \"9b66542c-f15b-4fd3-a88f-230d3e523c46\") "
Jul 31 21:30:02.032453 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:02.032424    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b66542c-f15b-4fd3-a88f-230d3e523c46-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9b66542c-f15b-4fd3-a88f-230d3e523c46" (UID: "9b66542c-f15b-4fd3-a88f-230d3e523c46"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:30:02.034103 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:02.034079    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b66542c-f15b-4fd3-a88f-230d3e523c46-kube-api-access-b2rkc" (OuterVolumeSpecName: "kube-api-access-b2rkc") pod "9b66542c-f15b-4fd3-a88f-230d3e523c46" (UID: "9b66542c-f15b-4fd3-a88f-230d3e523c46"). InnerVolumeSpecName "kube-api-access-b2rkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:30:02.034277 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:02.034257    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b66542c-f15b-4fd3-a88f-230d3e523c46-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9b66542c-f15b-4fd3-a88f-230d3e523c46" (UID: "9b66542c-f15b-4fd3-a88f-230d3e523c46"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:30:02.133327 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:02.133234    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b66542c-f15b-4fd3-a88f-230d3e523c46-maas-api-tls\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:30:02.133327 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:02.133272    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b66542c-f15b-4fd3-a88f-230d3e523c46-openshift-service-ca\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:30:02.133327 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:02.133283    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2rkc\" (UniqueName: \"kubernetes.io/projected/9b66542c-f15b-4fd3-a88f-230d3e523c46-kube-api-access-b2rkc\") on node \"ip-10-0-128-218.ec2.internal\" DevicePath \"\""
Jul 31 21:30:02.370783 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:02.370725    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:30:02.879513 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:02.879479    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"
Jul 31 21:30:02.912307 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:02.912231    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"]
Jul 31 21:30:02.915888 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:02.915837    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6938c5-69c9f98fd9-s49lf"]
Jul 31 21:30:03.020577 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:03.020549    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758890-mbt2q"
Jul 31 21:30:03.055506 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:03.055481    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6938c5-29758890-cdlwl"
Jul 31 21:30:03.886648 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:03.886614    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758890-mbt2q"
Jul 31 21:30:03.887108 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:03.886615    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758890-mbt2q" event={"ID":"2f66b2ad-aad8-4665-a9c0-265ad611be39","Type":"ContainerDied","Data":"0bc389175afd28bb25f0b06440becfcf66825e68d37167ef2f082071051a08b4"}
Jul 31 21:30:03.887108 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:03.886801    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0bc389175afd28bb25f0b06440becfcf66825e68d37167ef2f082071051a08b4"
Jul 31 21:30:03.887948 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:03.887924    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6938c5-29758890-cdlwl" event={"ID":"411627d8-3af6-436b-aaa2-1d66731c0e3f","Type":"ContainerDied","Data":"d96516d8cd4d1ef20299132cd3453cdcfaceddb7facce87184e9793b683c2e00"}
Jul 31 21:30:03.887948 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:03.887940    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6938c5-29758890-cdlwl"
Jul 31 21:30:03.888123 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:03.887973    2565 scope.go:117] "RemoveContainer" containerID="8c43bb6b78e0b2562dfa083baeaf42ff578a3ec7a6e4ec735c8dbef9a9a9c1d4"
Jul 31 21:30:03.916372 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:03.916319    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b66542c-f15b-4fd3-a88f-230d3e523c46" path="/var/lib/kubelet/pods/9b66542c-f15b-4fd3-a88f-230d3e523c46/volumes"
Jul 31 21:30:03.916746 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:03.916714    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6938c5-29758890-cdlwl"]
Jul 31 21:30:03.918061 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:03.918043    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6938c5-29758890-cdlwl"]
Jul 31 21:30:05.914714 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:05.914679    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="411627d8-3af6-436b-aaa2-1d66731c0e3f" path="/var/lib/kubelet/pods/411627d8-3af6-436b-aaa2-1d66731c0e3f/volumes"
Jul 31 21:30:09.701310 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:09.701272    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:30:09.806559 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:09.806527    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:30:09.995260 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:09.995166    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:30:10.285541 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:10.285461    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:30:16.540118 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:16.540088    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bcc9b8b78-jb86f_b72075ef-3822-4a63-83bc-058d4c7104a9/manager/0.log"
Jul 31 21:30:16.892641 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:16.892559    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786d856849-fr5cl_888fa80c-242a-489f-bf27-e61948de6262/copy-manifests/0.log"
Jul 31 21:30:16.901778 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:16.901721    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786d856849-fr5cl_888fa80c-242a-489f-bf27-e61948de6262/manager/0.log"
Jul 31 21:30:17.510332 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:17.510298    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-684dcf84d-hbz5h_07ffe8d2-f071-4521-9dee-2a66f79f90d9/maas-api/0.log"
Jul 31 21:30:17.853151 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:17.853081    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29758890-mbt2q_2f66b2ad-aad8-4665-a9c0-265ad611be39/cleanup/0.log"
Jul 31 21:30:19.847883 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:19.847853    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5_80308491-badf-47ee-b32b-1197787217fc/istio-proxy/0.log"
Jul 31 21:30:19.966990 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:19.966959    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mvtcm_e34a8bb7-0beb-44a2-b666-09931d0bd8ad/discovery/0.log"
Jul 31 21:30:20.429373 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:20.429339    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-gfts2_b3f18a04-895e-4a99-8eef-ce01940c27a5/payload-pre-processing/0.log"
Jul 31 21:30:20.661750 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:20.661713    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bc9d75b56-fmv5h_ff238e54-d1f3-4c02-87f1-857f3b510b84/router/0.log"
Jul 31 21:30:21.147989 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:21.147958    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-hdsg7_880ec7a4-d8a9-4b01-abcc-fa173bb30250/main/0.log"
Jul 31 21:30:21.490486 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:21.490461    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dbsk7_322213fd-b4ef-4382-9194-eaa47143d604/main/0.log"
Jul 31 21:30:27.382956 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:27.382919    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:30:27.512799 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:27.512767    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log" limit=1024
Jul 31 21:30:30.442625 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:30.442595    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h7klt_d6c4d228-4d34-47bd-9881-60e38a8a56e3/global-pull-secret-syncer/0.log"
Jul 31 21:30:30.630502 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:30.627894    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c5d4j_512e2144-7eb2-4aff-af11-30f449160993/konnectivity-agent/0.log"
Jul 31 21:30:30.803594 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:30.803515    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-218.ec2.internal_968e482da3adef699dc32ad47471cf95/haproxy/0.log"
Jul 31 21:30:37.935312 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:37.935284    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-sxw2g_ed08f05d-1fb1-46a5-8c13-102bea748361/cluster-monitoring-operator/0.log"
Jul 31 21:30:38.307887 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:38.307811    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p2hlc_079fc084-28ef-4ae5-a5a8-8854662e29ff/node-exporter/0.log"
Jul 31 21:30:38.331706 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:38.331687    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p2hlc_079fc084-28ef-4ae5-a5a8-8854662e29ff/kube-rbac-proxy/0.log"
Jul 31 21:30:38.356714 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:38.356690    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p2hlc_079fc084-28ef-4ae5-a5a8-8854662e29ff/init-textfile/0.log"
Jul 31 21:30:40.591429 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.591387    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"]
Jul 31 21:30:40.591948 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.591903    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="411627d8-3af6-436b-aaa2-1d66731c0e3f" containerName="cleanup"
Jul 31 21:30:40.591948 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.591921    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="411627d8-3af6-436b-aaa2-1d66731c0e3f" containerName="cleanup"
Jul 31 21:30:40.592078 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.591957    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b66542c-f15b-4fd3-a88f-230d3e523c46" containerName="maas-api"
Jul 31 21:30:40.592078 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.591967    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b66542c-f15b-4fd3-a88f-230d3e523c46" containerName="maas-api"
Jul 31 21:30:40.592078 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.591980    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f66b2ad-aad8-4665-a9c0-265ad611be39" containerName="cleanup"
Jul 31 21:30:40.592078 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.591989    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f66b2ad-aad8-4665-a9c0-265ad611be39" containerName="cleanup"
Jul 31 21:30:40.592078 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.592074    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="411627d8-3af6-436b-aaa2-1d66731c0e3f" containerName="cleanup"
Jul 31 21:30:40.592323 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.592086    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b66542c-f15b-4fd3-a88f-230d3e523c46" containerName="maas-api"
Jul 31 21:30:40.592323 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.592097    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f66b2ad-aad8-4665-a9c0-265ad611be39" containerName="cleanup"
Jul 31 21:30:40.594874 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.594852    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:40.597387 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.597362    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hpvlq\"/\"openshift-service-ca.crt\""
Jul 31 21:30:40.597782 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.597764    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hpvlq\"/\"kube-root-ca.crt\""
Jul 31 21:30:40.597881 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.597838    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hpvlq\"/\"default-dockercfg-869gk\""
Jul 31 21:30:40.604159 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.604136    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"]
Jul 31 21:30:40.669318 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.669280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6c681a00-67a5-4723-9849-ea20975aadd1-proc\") pod \"perf-node-gather-daemonset-lgdz5\" (UID: \"6c681a00-67a5-4723-9849-ea20975aadd1\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:40.669519 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.669351    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c681a00-67a5-4723-9849-ea20975aadd1-lib-modules\") pod \"perf-node-gather-daemonset-lgdz5\" (UID: \"6c681a00-67a5-4723-9849-ea20975aadd1\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:40.669519 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.669421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c681a00-67a5-4723-9849-ea20975aadd1-sys\") pod \"perf-node-gather-daemonset-lgdz5\" (UID: \"6c681a00-67a5-4723-9849-ea20975aadd1\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:40.669519 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.669487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psvng\" (UniqueName: \"kubernetes.io/projected/6c681a00-67a5-4723-9849-ea20975aadd1-kube-api-access-psvng\") pod \"perf-node-gather-daemonset-lgdz5\" (UID: \"6c681a00-67a5-4723-9849-ea20975aadd1\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:40.669519 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.669514    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6c681a00-67a5-4723-9849-ea20975aadd1-podres\") pod \"perf-node-gather-daemonset-lgdz5\" (UID: \"6c681a00-67a5-4723-9849-ea20975aadd1\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:40.770889 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.770853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6c681a00-67a5-4723-9849-ea20975aadd1-proc\") pod \"perf-node-gather-daemonset-lgdz5\" (UID: \"6c681a00-67a5-4723-9849-ea20975aadd1\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:40.771045 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.770920    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c681a00-67a5-4723-9849-ea20975aadd1-lib-modules\") pod \"perf-node-gather-daemonset-lgdz5\" (UID: \"6c681a00-67a5-4723-9849-ea20975aadd1\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:40.771045 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.770948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c681a00-67a5-4723-9849-ea20975aadd1-sys\") pod \"perf-node-gather-daemonset-lgdz5\" (UID: \"6c681a00-67a5-4723-9849-ea20975aadd1\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:40.771045 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.770984    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psvng\" (UniqueName: \"kubernetes.io/projected/6c681a00-67a5-4723-9849-ea20975aadd1-kube-api-access-psvng\") pod \"perf-node-gather-daemonset-lgdz5\" (UID: \"6c681a00-67a5-4723-9849-ea20975aadd1\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:40.771045 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.771006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6c681a00-67a5-4723-9849-ea20975aadd1-podres\") pod \"perf-node-gather-daemonset-lgdz5\" (UID: \"6c681a00-67a5-4723-9849-ea20975aadd1\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:40.771045 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.771004    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6c681a00-67a5-4723-9849-ea20975aadd1-proc\") pod \"perf-node-gather-daemonset-lgdz5\" (UID: \"6c681a00-67a5-4723-9849-ea20975aadd1\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:40.771265 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.771066    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c681a00-67a5-4723-9849-ea20975aadd1-sys\") pod \"perf-node-gather-daemonset-lgdz5\" (UID: \"6c681a00-67a5-4723-9849-ea20975aadd1\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:40.771265 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.771122    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c681a00-67a5-4723-9849-ea20975aadd1-lib-modules\") pod \"perf-node-gather-daemonset-lgdz5\" (UID: \"6c681a00-67a5-4723-9849-ea20975aadd1\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:40.771265 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.771127    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6c681a00-67a5-4723-9849-ea20975aadd1-podres\") pod \"perf-node-gather-daemonset-lgdz5\" (UID: \"6c681a00-67a5-4723-9849-ea20975aadd1\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:40.779233 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.779212    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psvng\" (UniqueName: \"kubernetes.io/projected/6c681a00-67a5-4723-9849-ea20975aadd1-kube-api-access-psvng\") pod \"perf-node-gather-daemonset-lgdz5\" (UID: \"6c681a00-67a5-4723-9849-ea20975aadd1\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:40.906022 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.905943    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:40.947650 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.947617    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/2.log"
Jul 31 21:30:40.952198 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:40.952175    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-fmf72_2cfe485d-9832-42d7-bf3f-03ee9f76fc84/console-operator/3.log"
Jul 31 21:30:41.054099 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:41.054069    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"]
Jul 31 21:30:41.055975 ip-10-0-128-218 kubenswrapper[2565]: W0731 21:30:41.055949    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6c681a00_67a5_4723_9849_ea20975aadd1.slice/crio-11e27d04f3715dd2354613d06ac9dec8c30d14561d406b5762e5c3d0183193b4 WatchSource:0}: Error finding container 11e27d04f3715dd2354613d06ac9dec8c30d14561d406b5762e5c3d0183193b4: Status 404 returned error can't find the container with id 11e27d04f3715dd2354613d06ac9dec8c30d14561d406b5762e5c3d0183193b4
Jul 31 21:30:41.086239 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:41.086200    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5" event={"ID":"6c681a00-67a5-4723-9849-ea20975aadd1","Type":"ContainerStarted","Data":"11e27d04f3715dd2354613d06ac9dec8c30d14561d406b5762e5c3d0183193b4"}
Jul 31 21:30:41.573076 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:41.573031    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76964bb886-c4n5s_8478f274-b96d-4114-bd30-f6f44d94fd17/console/0.log"
Jul 31 21:30:42.093577 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:42.093534    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5" event={"ID":"6c681a00-67a5-4723-9849-ea20975aadd1","Type":"ContainerStarted","Data":"7cfa23e31254614069ed7e2462be9a747feb82d0bfd04839038a80fa305b1920"}
Jul 31 21:30:42.093987 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:42.093640    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:42.117983 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:42.117871    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5" podStartSLOduration=2.117851143 podStartE2EDuration="2.117851143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:30:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:42.116603654 +0000 UTC m=+3650.721898019" watchObservedRunningTime="2026-07-31 21:30:42.117851143 +0000 UTC m=+3650.723145507"
Jul 31 21:30:42.233128 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:42.233095    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-t7lf9_fa145089-9180-41ec-9e64-fad46e720174/volume-data-source-validator/0.log"
Jul 31 21:30:43.356857 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:43.356829    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tsqzv_c565a1e5-6a0d-4655-93ae-606d7f18049c/dns/0.log"
Jul 31 21:30:43.379381 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:43.379355    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tsqzv_c565a1e5-6a0d-4655-93ae-606d7f18049c/kube-rbac-proxy/0.log"
Jul 31 21:30:43.403824 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:43.403805    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2xczz_bfe17aaf-bbc8-4d32-bb96-e5feb85f9d8f/dns-node-resolver/0.log"
Jul 31 21:30:44.064512 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:44.064479    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ttm25_e0d719da-980c-4f82-8dbe-c0c416ce0a66/node-ca/0.log"
Jul 31 21:30:44.979411 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:44.979375    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5_80308491-badf-47ee-b32b-1197787217fc/istio-proxy/0.log"
Jul 31 21:30:45.152255 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:45.152211    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mvtcm_e34a8bb7-0beb-44a2-b666-09931d0bd8ad/discovery/0.log"
Jul 31 21:30:45.274964 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:45.274885    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-gfts2_b3f18a04-895e-4a99-8eef-ce01940c27a5/payload-pre-processing/0.log"
Jul 31 21:30:45.332926 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:45.332870    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bc9d75b56-fmv5h_ff238e54-d1f3-4c02-87f1-857f3b510b84/router/0.log"
Jul 31 21:30:46.109441 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:46.109408    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-68khq_b24a63c2-0cf8-478c-a622-869116d09329/serve-healthcheck-canary/0.log"
Jul 31 21:30:46.621517 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:46.621480    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-vfkvs_d8329200-4000-4de4-8ef7-abf447f2e636/insights-operator/0.log"
Jul 31 21:30:46.622105 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:46.622085    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-vfkvs_d8329200-4000-4de4-8ef7-abf447f2e636/insights-operator/1.log"
Jul 31 21:30:46.774434 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:46.774404    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ztzkk_2ed7357c-b4e0-4cc7-a96c-5752b81bde53/kube-rbac-proxy/0.log"
Jul 31 21:30:46.795523 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:46.795499    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ztzkk_2ed7357c-b4e0-4cc7-a96c-5752b81bde53/exporter/0.log"
Jul 31 21:30:46.818529 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:46.818494    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ztzkk_2ed7357c-b4e0-4cc7-a96c-5752b81bde53/extractor/0.log"
Jul 31 21:30:48.109183 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:48.109156    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-lgdz5"
Jul 31 21:30:49.698232 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:49.698199    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bcc9b8b78-jb86f_b72075ef-3822-4a63-83bc-058d4c7104a9/manager/0.log"
Jul 31 21:30:49.892827 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:49.892799    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786d856849-fr5cl_888fa80c-242a-489f-bf27-e61948de6262/manager/0.log"
Jul 31 21:30:49.915221 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:49.915197    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786d856849-fr5cl_888fa80c-242a-489f-bf27-e61948de6262/copy-manifests/0.log"
Jul 31 21:30:51.419711 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:51.419679    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5_80308491-badf-47ee-b32b-1197787217fc/istio-proxy/0.log"
Jul 31 21:30:51.476376 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:51.476348    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-595ffc7687-jnprh_175cc4e2-895f-4318-9b34-04cb812d9300/manager/0.log"
Jul 31 21:30:51.516651 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:51.516618    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-cgtdh_141de2d6-c064-4611-a316-9fb2439f68f6/openshift-lws-operator/0.log"
Jul 31 21:30:51.576024 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:51.575994    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mvtcm_e34a8bb7-0beb-44a2-b666-09931d0bd8ad/discovery/0.log"
Jul 31 21:30:51.664260 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:51.664231    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-gfts2_b3f18a04-895e-4a99-8eef-ce01940c27a5/payload-pre-processing/0.log"
Jul 31 21:30:51.716007 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:51.715975    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bc9d75b56-fmv5h_ff238e54-d1f3-4c02-87f1-857f3b510b84/router/0.log"
Jul 31 21:30:52.484792 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:52.484759    2565 scope.go:117] "RemoveContainer" containerID="a3a2e3eba688081f1e03196b6892ebbb25770c6a50f75444aecc347462f1f437"
Jul 31 21:30:53.143842 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:53.143817    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cgd9t5_80308491-badf-47ee-b32b-1197787217fc/istio-proxy/0.log"
Jul 31 21:30:53.327991 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:53.327958    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mvtcm_e34a8bb7-0beb-44a2-b666-09931d0bd8ad/discovery/0.log"
Jul 31 21:30:53.422877 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:53.422789    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-gfts2_b3f18a04-895e-4a99-8eef-ce01940c27a5/payload-pre-processing/0.log"
Jul 31 21:30:53.475267 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:53.475240    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bc9d75b56-fmv5h_ff238e54-d1f3-4c02-87f1-857f3b510b84/router/0.log"
Jul 31 21:30:56.868752 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:56.868693    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-z9sj5_f405b67c-4d95-4880-8ad3-2915433fe139/kube-storage-version-migrator-operator/1.log"
Jul 31 21:30:56.869692 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:56.869673    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-z9sj5_f405b67c-4d95-4880-8ad3-2915433fe139/kube-storage-version-migrator-operator/0.log"
Jul 31 21:30:58.246221 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:58.246193    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vfbbm_732589ca-b2a0-48d3-aa09-0ab535fb7d94/kube-multus-additional-cni-plugins/0.log"
Jul 31 21:30:58.274509 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:58.274485    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vfbbm_732589ca-b2a0-48d3-aa09-0ab535fb7d94/egress-router-binary-copy/0.log"
Jul 31 21:30:58.296804 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:58.296786    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vfbbm_732589ca-b2a0-48d3-aa09-0ab535fb7d94/cni-plugins/0.log"
Jul 31 21:30:58.333087 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:58.333058    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vfbbm_732589ca-b2a0-48d3-aa09-0ab535fb7d94/bond-cni-plugin/0.log"
Jul 31 21:30:58.355648 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:58.355622    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vfbbm_732589ca-b2a0-48d3-aa09-0ab535fb7d94/routeoverride-cni/0.log"
Jul 31 21:30:58.376250 ip-10-0-128-218 kubenswrapper[2565]: I0731 21:30:58.376226    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vfbbm_732589ca-b2a0-48d3-aa09-0ab535fb7d94/whereabouts-cni-bincopy/0.log"